2024-03-07T07:15:56.644 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-07T07:15:56.645 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/acls} --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970 -- /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/orig.config.yaml 2024-03-07T07:15:56.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T07:15:56.785 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970 branch: wip-lusov-qdb description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/acls} email: null first_in_suite: false job_id: '7583970' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-qdb ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Reduced data availability - Degraded data redundancy sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 kclient: syntax: v2 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 owner: scheduled_leonidus@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9221 sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 sleep_before_teardown: 0 subset: 111/10000 suite: fs suite_branch: wip-lusov-qdb suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDjGICKhvRDijBnv5tRIjBVpkGl23gDM76uebAyb2PPUrtYDh7ARwqDW5uAzFNt0GfiDMuH/EiiJ0jYIHfaw0oA= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCXGBTrTKe7QVMym/vyxAxzz9JqVjdNSTspfFbFMRZB7Z8V9CzuGMe5DpYnLlA1snmJzSbUjKR3HNzxY3JIAIA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-07_05:46:12 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-07T07:15:56.785 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa; will attempt to use it 2024-03-07T07:15:56.786 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks 2024-03-07T07:15:56.786 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-07T07:15:56.788 INFO:teuthology.task.internal:Checking packages... 2024-03-07T07:15:56.812 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8b896a9e145796119f0451201dc4d53ddac97db0' 2024-03-07T07:15:56.812 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-07T07:15:56.812 INFO:teuthology.packaging:ref: None 2024-03-07T07:15:56.812 INFO:teuthology.packaging:tag: None 2024-03-07T07:15:56.812 INFO:teuthology.packaging:branch: wip-lusov-qdb 2024-03-07T07:15:56.812 INFO:teuthology.packaging:sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T07:15:56.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-qdb 2024-03-07T07:15:56.976 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:15:56.978 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-07T07:15:56.983 INFO:teuthology.task.internal:no buildpackages task found 2024-03-07T07:15:56.983 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-07T07:15:57.002 INFO:teuthology.task.internal:Saving configuration 2024-03-07T07:15:57.019 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-07T07:15:57.024 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-07T07:15:57.049 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-07 07:10:12.202014', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP0NlEp/2MGGZhvP6pB1zEVE/VK9FxUWO3Lf90Mmb5Mv'} 2024-03-07T07:15:57.075 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-07 07:10:12.203342', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPfdFh7wj+DmwD5nKRliYnYeXZMyMLzItn7s17AU6vfa'} 2024-03-07T07:15:57.075 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-07T07:15:57.080 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-07T07:15:57.080 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-07T07:15:57.080 INFO:teuthology.run_tasks:Running task console_log... 2024-03-07T07:15:57.156 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f575eebef70>, signals=[15]) 2024-03-07T07:15:57.156 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-07T07:15:57.161 INFO:teuthology.task.internal:Opening connections... 2024-03-07T07:15:57.161 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:15:57.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:15:57.248 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:15:57.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:15:57.343 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-07T07:15:57.349 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-03-07T07:15:57.354 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-03-07T07:15:57.354 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-03-07T07:15:57.399 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-07T07:15:57.399 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2024-03-07T07:15:57.399 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2024-03-07T07:15:57.399 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-07T07:15:57.400 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2024-03-07T07:15:57.400 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2024-03-07T07:15:57.400 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2024-03-07T07:15:57.400 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-07T07:15:57.400 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-07T07:15:57.400 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-07T07:15:57.400 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-07T07:15:57.400 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2024-03-07T07:15:57.401 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-03-07T07:15:57.426 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-03-07T07:15:57.431 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-03-07T07:15:57.432 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-07T07:15:57.479 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-07T07:15:57.479 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-07T07:15:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-03-07T07:15:57.480 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-07T07:15:57.500 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-07T07:15:57.508 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-07T07:15:57.513 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-07T07:15:57.514 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-03-07T07:15:57.516 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-03-07T07:15:57.527 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-07T07:15:57.532 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-07T07:15:57.532 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-03-07T07:15:57.565 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-03-07T07:15:57.637 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-07T07:15:57.690 INFO:teuthology.run_tasks:Running task kernel... 2024-03-07T07:15:57.705 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-07T07:15:57.705 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-03-07T07:15:57.705 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-07T07:15:57.705 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-07T07:15:57.706 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-07T07:15:57.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:15:57.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-03-07T07:15:57.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:15:57.715 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-03-07T07:15:58.046 DEBUG:teuthology.task.kernel:sha1 for client.1 is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T07:15:58.046 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-07T07:15:58.046 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-03-07T07:15:58.048 DEBUG:teuthology.task.kernel:sha1 for client.0 is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T07:15:58.048 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-07T07:15:58.048 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-03-07T07:15:58.053 INFO:teuthology.orchestra.run.smithi161.stdout:5.15.0-56-generic 2024-03-07T07:15:58.053 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T07:15:58.054 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-07T07:15:58.054 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-03-07T07:15:58.055 DEBUG:teuthology.orchestra.run.smithi161:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-07T07:15:58.056 INFO:teuthology.orchestra.run.smithi084.stdout:5.15.0-56-generic 2024-03-07T07:15:58.056 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T07:15:58.056 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-07T07:15:58.056 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-03-07T07:15:58.056 DEBUG:teuthology.orchestra.run.smithi084:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-07T07:15:58.112 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-07T07:15:58.120 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-07T07:15:58.247 INFO:teuthology.orchestra.run.smithi084.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: git config --global init.defaultBranch 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: 2024-03-07T07:15:58.248 INFO:teuthology.orchestra.run.smithi084.stderr:hint: git branch -m 2024-03-07T07:15:58.249 INFO:teuthology.orchestra.run.smithi084.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-07T07:15:58.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-07T07:15:58.256 INFO:teuthology.orchestra.run.smithi161.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-07T07:15:58.256 INFO:teuthology.orchestra.run.smithi161.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-07T07:15:58.256 INFO:teuthology.orchestra.run.smithi161.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-07T07:15:58.256 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2024-03-07T07:15:58.256 INFO:teuthology.orchestra.run.smithi161.stderr:hint: git config --global init.defaultBranch 2024-03-07T07:15:58.256 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2024-03-07T07:15:58.256 INFO:teuthology.orchestra.run.smithi161.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-07T07:15:58.257 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-07T07:15:58.257 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2024-03-07T07:15:58.257 INFO:teuthology.orchestra.run.smithi161.stderr:hint: git branch -m 2024-03-07T07:15:58.257 INFO:teuthology.orchestra.run.smithi161.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-07T07:15:58.259 DEBUG:teuthology.orchestra.run.smithi161:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-07T07:15:58.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-07T07:15:58.327 DEBUG:teuthology.orchestra.run.smithi161:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-07T07:15:58.376 DEBUG:teuthology.orchestra.run.smithi084:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-07T07:15:58.385 DEBUG:teuthology.orchestra.run.smithi161:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-07T07:16:47.232 INFO:teuthology.orchestra.run.smithi161.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-07T07:16:47.233 INFO:teuthology.orchestra.run.smithi161.stderr: * [new branch] main -> origin/main 2024-03-07T07:16:47.265 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190312 -> 20190312 2024-03-07T07:16:47.265 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190416 -> 20190416 2024-03-07T07:16:47.265 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190514 -> 20190514 2024-03-07T07:16:47.265 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190618 -> 20190618 2024-03-07T07:16:47.266 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190717 -> 20190717 2024-03-07T07:16:47.266 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190815 -> 20190815 2024-03-07T07:16:47.266 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190923 -> 20190923 2024-03-07T07:16:47.267 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20191022 -> 20191022 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20191215 -> 20191215 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200122 -> 20200122 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200316 -> 20200316 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200421 -> 20200421 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200519 -> 20200519 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200619 -> 20200619 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200721 -> 20200721 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200817 -> 20200817 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200918 -> 20200918 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201022 -> 20201022 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201118 -> 20201118 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201218 -> 20201218 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210208 -> 20210208 2024-03-07T07:16:47.268 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210315 -> 20210315 2024-03-07T07:16:47.269 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210511 -> 20210511 2024-03-07T07:16:47.269 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210716 -> 20210716 2024-03-07T07:16:47.271 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210818 -> 20210818 2024-03-07T07:16:47.271 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210919 -> 20210919 2024-03-07T07:16:47.271 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20211027 -> 20211027 2024-03-07T07:16:47.271 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20211216 -> 20211216 2024-03-07T07:16:47.271 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220209 -> 20220209 2024-03-07T07:16:47.271 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220310 -> 20220310 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220411 -> 20220411 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220509 -> 20220509 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220610 -> 20220610 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220708 -> 20220708 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220815 -> 20220815 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220913 -> 20220913 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221012 -> 20221012 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221109 -> 20221109 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221214 -> 20221214 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230117 -> 20230117 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230210 -> 20230210 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230310 -> 20230310 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230404 -> 20230404 2024-03-07T07:16:47.272 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230515 -> 20230515 2024-03-07T07:16:47.273 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230625 -> 20230625 2024-03-07T07:16:47.273 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230804 -> 20230804 2024-03-07T07:16:47.273 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230919 -> 20230919 2024-03-07T07:16:47.273 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20231030 -> 20231030 2024-03-07T07:16:47.273 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20231111 -> 20231111 2024-03-07T07:16:47.273 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20231211 -> 20231211 2024-03-07T07:16:47.273 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20240115 -> 20240115 2024-03-07T07:16:47.273 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20240220 -> 20240220 2024-03-07T07:16:47.315 INFO:teuthology.orchestra.run.smithi084.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-07T07:16:47.315 INFO:teuthology.orchestra.run.smithi084.stderr: * [new branch] main -> origin/main 2024-03-07T07:16:47.348 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20190312 -> 20190312 2024-03-07T07:16:47.349 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20190416 -> 20190416 2024-03-07T07:16:47.349 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20190514 -> 20190514 2024-03-07T07:16:47.349 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20190618 -> 20190618 2024-03-07T07:16:47.349 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20190717 -> 20190717 2024-03-07T07:16:47.349 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20190815 -> 20190815 2024-03-07T07:16:47.349 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20190923 -> 20190923 2024-03-07T07:16:47.349 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20191022 -> 20191022 2024-03-07T07:16:47.349 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20191215 -> 20191215 2024-03-07T07:16:47.351 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20200122 -> 20200122 2024-03-07T07:16:47.351 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20200316 -> 20200316 2024-03-07T07:16:47.351 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20200421 -> 20200421 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20200519 -> 20200519 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20200619 -> 20200619 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20200721 -> 20200721 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20200817 -> 20200817 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20200918 -> 20200918 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20201022 -> 20201022 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20201118 -> 20201118 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20201218 -> 20201218 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20210208 -> 20210208 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20210315 -> 20210315 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20210511 -> 20210511 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20210716 -> 20210716 2024-03-07T07:16:47.352 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20210818 -> 20210818 2024-03-07T07:16:47.353 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20210919 -> 20210919 2024-03-07T07:16:47.353 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20211027 -> 20211027 2024-03-07T07:16:47.353 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20211216 -> 20211216 2024-03-07T07:16:47.353 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20220209 -> 20220209 2024-03-07T07:16:47.355 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20220310 -> 20220310 2024-03-07T07:16:47.355 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20220411 -> 20220411 2024-03-07T07:16:47.355 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20220509 -> 20220509 2024-03-07T07:16:47.355 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20220610 -> 20220610 2024-03-07T07:16:47.355 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20220708 -> 20220708 2024-03-07T07:16:47.355 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20220815 -> 20220815 2024-03-07T07:16:47.355 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20220913 -> 20220913 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20221012 -> 20221012 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20221109 -> 20221109 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20221214 -> 20221214 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20230117 -> 20230117 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20230210 -> 20230210 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20230310 -> 20230310 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20230404 -> 20230404 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20230515 -> 20230515 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20230625 -> 20230625 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20230804 -> 20230804 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20230919 -> 20230919 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20231030 -> 20231030 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20231111 -> 20231111 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20231211 -> 20231211 2024-03-07T07:16:47.356 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20240115 -> 20240115 2024-03-07T07:16:47.357 INFO:teuthology.orchestra.run.smithi084.stderr: * [new tag] 20240220 -> 20240220 2024-03-07T07:16:51.443 INFO:teuthology.orchestra.run.smithi161.stderr:Updating files: 51% (1835/3573) Updating files: 52% (1858/3573) Updating files: 53% (1894/3573) Updating files: 54% (1930/3573) Updating files: 55% (1966/3573) Updating files: 56% (2001/3573) Updating files: 57% (2037/3573) Updating files: 58% (2073/3573) Updating files: 59% (2109/3573) Updating files: 60% (2144/3573) Updating files: 61% (2180/3573) Updating files: 62% (2216/3573) Updating files: 63% (2251/3573) Updating files: 64% (2287/3573) Updating files: 64% (2317/3573) Updating files: 65% (2323/3573) Updating files: 66% (2359/3573) Updating files: 67% (2394/3573) Updating files: 68% (2430/3573) Updating files: 69% (2466/3573) Updating files: 70% (2502/3573) Updating files: 71% (2537/3573) Updating files: 72% (2573/3573) Updating files: 73% (2609/3573) Updating files: 74% (2645/3573) Updating files: 75% (2680/3573) Updating files: 76% (2716/3573) Updating files: 77% (2752/3573) Updating files: 78% (2787/3573) Updating files: 79% (2823/3573) Updating files: 79% (2833/3573) Updating files: 80% (2859/3573) Updating files: 81% (2895/3573) Updating files: 82% (2930/3573) Updating files: 83% (2966/3573) Updating files: 84% (3002/3573) Updating files: 85% (3038/3573) Updating files: 86% (3073/3573) Updating files: 87% (3109/3573) Updating files: 88% (3145/3573) Updating files: 89% (3180/3573) Updating files: 90% (3216/3573) Updating files: 91% (3252/3573) Updating files: 91% (3287/3573) Updating files: 92% (3288/3573) Updating files: 93% (3323/3573) Updating files: 94% (3359/3573) Updating files: 95% (3395/3573) Updating files: 96% (3431/3573) Updating files: 97% (3466/3573) Updating files: 98% (3502/3573) Updating files: 99% (3538/3573) Updating files: 100% (3573/3573) Updating files: 100% (3573/3573), done. 2024-03-07T07:16:51.448 INFO:teuthology.orchestra.run.smithi161.stdout:HEAD is now at d13f88bc Merge branch 'robot/pr-0-1709648065' into 'main' 2024-03-07T07:16:51.469 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.1... 2024-03-07T07:16:51.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T07:16:51.517 INFO:teuthology.orchestra.run.smithi084.stderr:Updating files: 51% (1837/3573) Updating files: 52% (1858/3573) Updating files: 53% (1894/3573) Updating files: 54% (1930/3573) Updating files: 55% (1966/3573) Updating files: 56% (2001/3573) Updating files: 57% (2037/3573) Updating files: 58% (2073/3573) Updating files: 59% (2109/3573) Updating files: 60% (2144/3573) Updating files: 61% (2180/3573) Updating files: 62% (2216/3573) Updating files: 63% (2251/3573) Updating files: 64% (2287/3573) Updating files: 64% (2318/3573) Updating files: 65% (2323/3573) Updating files: 66% (2359/3573) Updating files: 67% (2394/3573) Updating files: 68% (2430/3573) Updating files: 69% (2466/3573) Updating files: 70% (2502/3573) Updating files: 71% (2537/3573) Updating files: 72% (2573/3573) Updating files: 73% (2609/3573) Updating files: 74% (2645/3573) Updating files: 75% (2680/3573) Updating files: 76% (2716/3573) Updating files: 77% (2752/3573) Updating files: 78% (2787/3573) Updating files: 79% (2823/3573) Updating files: 79% (2835/3573) Updating files: 80% (2859/3573) Updating files: 81% (2895/3573) Updating files: 82% (2930/3573) Updating files: 83% (2966/3573) Updating files: 84% (3002/3573) Updating files: 85% (3038/3573) Updating files: 86% (3073/3573) Updating files: 87% (3109/3573) Updating files: 88% (3145/3573) Updating files: 89% (3180/3573) Updating files: 90% (3216/3573) Updating files: 91% (3252/3573) Updating files: 92% (3288/3573) Updating files: 92% (3306/3573) Updating files: 93% (3323/3573) Updating files: 94% (3359/3573) Updating files: 95% (3395/3573) Updating files: 96% (3431/3573) Updating files: 97% (3466/3573) Updating files: 98% (3502/3573) Updating files: 99% (3538/3573) Updating files: 100% (3573/3573) Updating files: 100% (3573/3573), done. 2024-03-07T07:16:51.522 INFO:teuthology.orchestra.run.smithi084.stdout:HEAD is now at d13f88bc Merge branch 'robot/pr-0-1709648065' into 'main' 2024-03-07T07:16:51.543 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.0... 2024-03-07T07:16:51.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T07:16:51.622 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/ 2024-03-07T07:16:51.623 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-rc7-gdd5c1cd17167_6.8.0-rc7-gdd5c1cd17167-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/ --input-file=- 2024-03-07T07:16:51.625 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi161.front.sepia.ceph.com to complete... 2024-03-07T07:16:51.689 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/ 2024-03-07T07:16:51.689 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-rc7-gdd5c1cd17167_6.8.0-rc7-gdd5c1cd17167-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/ --input-file=- 2024-03-07T07:16:51.692 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi084.front.sepia.ceph.com to complete... 2024-03-07T07:16:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07 07:16:53 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/linux-image-6.8.0-rc7-gdd5c1cd17167_6.8.0-rc7-gdd5c1cd17167-1_amd64.deb [39270848/39270848] -> "/tmp/linux-image.deb" [1] 2024-03-07T07:16:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:FINISHED --2024-03-07 07:16:53-- 2024-03-07T07:16:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:Total wall clock time: 1.6s 2024-03-07T07:16:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:Downloaded: 1 files, 37M in 1.4s (25.9 MB/s) 2024-03-07T07:16:53.238 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.1... 2024-03-07T07:16:53.238 DEBUG:teuthology.orchestra.run.smithi161:> sudo dpkg -i /tmp/linux-image.deb 2024-03-07T07:16:53.450 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-6.8.0-rc7-gdd5c1cd17167. 2024-03-07T07:16:55.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07 07:16:54 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/linux-image-6.8.0-rc7-gdd5c1cd17167_6.8.0-rc7-gdd5c1cd17167-1_amd64.deb [39270848/39270848] -> "/tmp/linux-image.deb" [1] 2024-03-07T07:16:55.022 INFO:teuthology.orchestra.run.smithi084.stderr:FINISHED --2024-03-07 07:16:54-- 2024-03-07T07:16:55.022 INFO:teuthology.orchestra.run.smithi084.stderr:Total wall clock time: 3.3s 2024-03-07T07:16:55.023 INFO:teuthology.orchestra.run.smithi084.stderr:Downloaded: 1 files, 37M in 3.1s (12.1 MB/s) 2024-03-07T07:16:55.027 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.0... 2024-03-07T07:16:55.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo dpkg -i /tmp/linux-image.deb 2024-03-07T07:16:55.244 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-image-6.8.0-rc7-gdd5c1cd17167. 2024-03-07T07:16:55.471 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-07T07:16:55.476 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-07T07:16:55.573 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-6.8.0-rc7-gdd5c1cd17167 (6.8.0-rc7-gdd5c1cd17167-1) ... 2024-03-07T07:16:57.265 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-07T07:16:57.269 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-07T07:16:57.364 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-6.8.0-rc7-gdd5c1cd17167 (6.8.0-rc7-gdd5c1cd17167-1) ... 2024-03-07T07:16:58.848 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-6.8.0-rc7-gdd5c1cd17167 (6.8.0-rc7-gdd5c1cd17167-1) ... 2024-03-07T07:16:58.957 INFO:teuthology.orchestra.run.smithi161.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-6.8.0-rc7-gdd5c1cd17167 (6.8.0-rc7-gdd5c1cd17167-1) ... 2024-03-07T07:17:01.065 INFO:teuthology.orchestra.run.smithi084.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:19.271 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2024-03-07T07:17:19.288 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-07T07:17:19.317 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-03-07T07:17:19.652 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:19.671 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:19.944 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-07T07:17:19.954 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-07T07:17:20.020 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-07T07:17:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-07T07:17:20.191 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-07T07:17:20.191 INFO:teuthology.orchestra.run.smithi161.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-07T07:17:20.191 INFO:teuthology.orchestra.run.smithi161.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-07T07:17:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-03-07T07:17:20.405 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-deb -c /tmp/linux-image.deb 2024-03-07T07:17:20.413 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./ 2024-03-07T07:17:20.413 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./boot/ 2024-03-07T07:17:20.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 4474396 2024-03-06 15:59 ./boot/System.map-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:20.427 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 170903 2024-03-06 15:59 ./boot/config-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:20.427 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11551744 2024-03-06 15:59 ./boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/ 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/ 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/postinst.d/ 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/postrm.d/ 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/preinst.d/ 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/prerm.d/ 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/ 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/ 2024-03-07T07:17:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/ 2024-03-07T07:17:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/ 2024-03-07T07:17:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/ 2024-03-07T07:17:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/ 2024-03-07T07:17:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ 2024-03-07T07:17:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 490441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 106689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 152137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-07T07:17:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/ 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/ 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/ 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpuid.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/msr.ko 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/ 2024-03-07T07:17:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 353961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-07T07:17:20.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 886129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-07T07:17:20.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2294353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-07T07:17:20.472 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ 2024-03-07T07:17:20.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/af_alg.ko 2024-03-07T07:17:20.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/algif_hash.ko 2024-03-07T07:17:20.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/algif_skcipher.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/asymmetric_keys/ 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/ 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-07T07:17:20.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cryptd.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-07T07:17:20.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_simd.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lrw.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-07T07:17:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-07T07:17:20.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xts.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_extlog.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/apei/ 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/apei/einj.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-07T07:17:20.477 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 88305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-07T07:17:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_legacy.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-07T07:17:20.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_radisys.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rz1000.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-07T07:17:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-07T07:17:20.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/ 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/ 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/ 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/ 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 964745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 169697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-07T07:17:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/ 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 116393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/ 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 110321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 98185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 263633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/ 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 98105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/ 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/applicom.ko 2024-03-07T07:17:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/ 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 148513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 139305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-07T07:17:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/ 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/nvram.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/ 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-07T07:17:20.485 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/ 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/ 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-palmas.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-si5351.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-twl6040.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-wm831x.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/ 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ 2024-03-07T07:17:20.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ 2024-03-07T07:17:20.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-07T07:17:20.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 246777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-07T07:17:20.487 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/ 2024-03-07T07:17:20.487 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/ 2024-03-07T07:17:20.487 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-07T07:17:20.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 570217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-07T07:17:20.550 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-07T07:17:20.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/ 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/ 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/ 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-07T07:17:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/ 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-gpio.ko 2024-03-07T07:17:20.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max14577.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max77693.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max8997.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-palmas.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/ 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/efi/ 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/ 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-07T07:17:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-arizona.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-da9052.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-da9055.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-dln2.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-generic.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-kempld.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max7300.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max730x.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max732x.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-07T07:17:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-sch.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-vx855.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/ 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-a4tech.ko 2024-03-07T07:17:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-apple.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-belkin.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cherry.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-chicony.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cp2112.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cypress.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ezkey.ko 2024-03-07T07:17:20.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-generic.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kensington.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-07T07:17:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lg-g15.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-magicmouse.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-microsoft.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-monterey.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ntrig.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-07T07:17:20.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-07T07:17:20.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-07T07:17:20.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 269209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/ 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 218865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/ 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-07T07:17:20.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 305385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-07T07:17:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-07T07:17:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 99505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc2103.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-07T07:17:20.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hih6130.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 140129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/jc42.ko 2024-03-07T07:17:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-07T07:17:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-07T07:17:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-07T07:17:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-07T07:17:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-07T07:17:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 79833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-07T07:17:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/ 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/ 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/ 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-07T07:17:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-07T07:17:20.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-07T07:17:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/ 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 273513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 883841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 324233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 282329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ 2024-03-07T07:17:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 493129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/ 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 420529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/ 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 741609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 296785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 153705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/usnic/ 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 169089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-07T07:17:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 266529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 111329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 128657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 129793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/ 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/evbug.ko 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/ff-memless.ko 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/ 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-07T07:17:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/ 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lm8323.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lm8333.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-07T07:17:20.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/qt1070.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/qt2160.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/stowaway.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/matrix-keymap.ko 2024-03-07T07:17:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/ 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 335857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/psmouse.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/ 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 109553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-07T07:17:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ct82c710.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/parkbd.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/pcips2.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ps2mult.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serport.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/ 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-88pm860x.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-adp5520.ko 2024-03-07T07:17:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-bd2802.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-da903x.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-da9052.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-gpio.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3533.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm355x.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3642.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp8788.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-max8997.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-mc13783.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-07T07:17:20.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca9532.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca955x.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca963x.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-tca6507.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-wm8350.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-07T07:17:20.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/ 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/ 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 647033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bufio.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 155801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-era.ko 2024-03-07T07:17:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-mirror.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-region-hash.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 109497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-snapshot.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 181761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-zero.ko 2024-03-07T07:17:20.585 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/ 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 199825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 126361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 368481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/ 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/ 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 178041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-07T07:17:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/ 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm800.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm805.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm80x.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/arizona-i2c.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/arizona.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/bcm590xx.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/dln2.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/janz-cmodio.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/kempld-core.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lm3533-core.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-07T07:17:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lp3943.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/max8907.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/menf21bmc.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/retu-mfd.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/si476x-core.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-07T07:17:20.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/tps65010.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/tps6507x.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wm8994.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ad525x_dpot.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/ 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/ 2024-03-07T07:17:20.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/core.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/ 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ds1682.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/dummy-irq.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/echo/ 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/echo/echo.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/ 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/genwqe/ 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 152041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-07T07:17:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hmc6352.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ibmasm/ 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ics932s401.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/ 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/ 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 313545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/phantom.ko 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ti-st/ 2024-03-07T07:17:20.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/ 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 183513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/ 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 491561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/ 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/ 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 105929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-07T07:17:20.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 458969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/ 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 130657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-07T07:17:20.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/ 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/ 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/ 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/ 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/ 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/ 2024-03-07T07:17:20.594 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 90185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/ 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 176689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1434449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-07T07:17:20.595 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 128425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 131265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 314321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/ 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 323681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/ 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 193537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 347161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1045321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-07T07:17:20.596 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 166129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/ 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 204185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/ 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 141153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-07T07:17:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/ 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/ 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 281193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fujitsu/ 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 90297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-07T07:17:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 295673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 584297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 245977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 944449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 288481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/ 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 514337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-07T07:17:20.599 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 734689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 151649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/ 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/ 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-07T07:17:20.600 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 727377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 278825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1121537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 95569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-07T07:17:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/ 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/ 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 151193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/ 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 136793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/ 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/ 2024-03-07T07:17:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 227841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 671985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/ 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/ 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 194057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/ 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-07T07:17:20.687 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/ 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1066817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/ 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/ 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/ 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/ 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-07T07:17:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 495641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/ 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 166041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/ 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/ 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 92337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/ 2024-03-07T07:17:20.689 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 79993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/ 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/ 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/ 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/defxx.ko 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/skfp/ 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 217025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-07T07:17:20.690 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/ 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 237241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/ 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/ 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-07T07:17:20.691 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/ 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-07T07:17:20.692 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 76561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 99001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/plip/ 2024-03-07T07:17:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/plip/plip.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sb1000.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/ 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-07T07:17:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/ 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/ 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 144345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/ 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 307233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-07T07:17:20.695 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/ 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/ 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/ 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 267721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/ 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 131297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-07T07:17:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/ 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/ 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pci-stub.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/ 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 146129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-07T07:17:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/ 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/broadcom/ 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/samsung/ 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/ 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/ 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/ 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/ 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-07T07:17:20.698 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/ 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 131937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-07T07:17:20.699 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/ 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-07T07:17:20.700 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/ 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/da9030_battery.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/da9052-battery.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-07T07:17:20.701 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/gpio-charger.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max14577_charger.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max17042_battery.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max8903_charger.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max8925_power.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/sbs-battery.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/test_power.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-07T07:17:20.702 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm831x_power.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm8350_power.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/ 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/ 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/ 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/ 2024-03-07T07:17:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9052.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9055.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9063.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-07T07:17:20.704 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8907.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8925.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8997.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8998.ko 2024-03-07T07:17:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-palmas.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-07T07:17:20.706 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 135249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/ 2024-03-07T07:17:20.707 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 271385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/ 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 356833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 295953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic94xx/ 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 189089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/ 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/ 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 246913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/ 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1171857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-07T07:17:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/ 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 238369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/ 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 115305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/ 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 308905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/ 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 76033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 146809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-07T07:17:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/ 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 212329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/ 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 157713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fdomain.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/ 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 294881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 201721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/imm.ko 2024-03-07T07:17:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 265937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/ 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 317129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/ 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 315337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 145489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/ 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 216345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/ 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2193953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-07T07:17:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/ 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 310665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/ 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 659585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/ 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/ 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-07T07:17:20.712 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/ 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 366305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ppa.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/ 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1876657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/ 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 558897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qlogicfas408.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 261073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 173921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-07T07:17:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 280105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 115705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 164865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/xen-scsifront.ko 2024-03-07T07:17:20.714 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 129345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/ 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/ 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 736665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/ 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 931433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/ 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-07T07:17:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/ 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/ 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-07T07:17:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/moxa.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/mxser.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-07T07:17:20.717 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/ 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/ 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/altera_uart.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/ 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/rp2.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/ 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ 2024-03-07T07:17:20.718 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 545377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/ 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_mf624.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_netx.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-07T07:17:20.719 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/ 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/c67x00/ 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 145753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/ 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-07T07:17:20.720 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/common/ 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/common/ulpi.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc2/ 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/ 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 452785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/ 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/ 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-07T07:17:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 92401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/ 2024-03-07T07:17:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-07T07:17:20.723 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 161193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/ 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 157593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 65873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-07T07:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 65993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 156321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/ 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811_cs.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/ 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-07T07:17:20.725 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/cytherm.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ehset.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-07T07:17:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/lvstest.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/ 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbtest.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/mon/ 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/mon/usbmon.ko 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/musb/ 2024-03-07T07:17:20.727 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 301593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/ 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-07T07:17:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/f81232.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 175097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 136977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-07T07:17:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/metro-usb.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mxuport.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 191817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-07T07:17:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usbserial.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ 2024-03-07T07:17:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-07T07:17:20.732 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 180281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/ 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/ 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/ 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 162841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 76433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/ 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-07T07:17:20.733 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/ 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/ 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/bd6107.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-07T07:17:20.734 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/ 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-07T07:17:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/ 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-07T07:17:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/acquirewdt.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/advantechwdt.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-07T07:17:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/dw_wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-07T07:17:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/retu_wdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-07T07:17:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/ 2024-03-07T07:17:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/ 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 176337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-scsiback.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/ 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/ 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 158217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/adfs/ 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/adfs/adfs.ko 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/ 2024-03-07T07:17:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 163433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/afs/ 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1019049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/afs/kafs.ko 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/autofs/ 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/autofs/autofs4.ko 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/ 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/bfs/ 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/bfs/bfs.ko 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/ 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 3487249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/ 2024-03-07T07:17:20.742 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 305841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1335369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/ 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/configfs/ 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/configfs/configfs.ko 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/ 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/ 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 644161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/efs/ 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/efs/efs.ko 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/ 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1527625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/ 2024-03-07T07:17:20.743 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/freevxfs/ 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/freevxfs/freevxfs.ko 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/ 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/ 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1231233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/ 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 141625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/ 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 223177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hpfs/ 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 193481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hpfs/hpfs.ko 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/ 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-07T07:17:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/ 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 420329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/ 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 281617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/ 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 88897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/ 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 490409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/ 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/ 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/ 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/ 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 117361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-07T07:17:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1058273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv2.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 120169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2041705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/ 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/ 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1511641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/ 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 582409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/ 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-07T07:17:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ascii.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-07T07:17:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 142569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 165641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 118017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-07T07:17:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-07T07:17:20.749 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ntfs/ 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 220457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ntfs/ntfs.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 244633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 440633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2590681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/omfs/ 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/omfs/omfs.ko 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/ 2024-03-07T07:17:20.750 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 360897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx4/ 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx4/qnx4.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx6/ 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx6/qnx6.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/ 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_tree.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_v1.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_v2.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/ 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 532161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/ 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-07T07:17:20.751 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/ 2024-03-07T07:17:20.752 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/ 2024-03-07T07:17:20.752 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2712385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-07T07:17:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/ 2024-03-07T07:17:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-07T07:17:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-07T07:17:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/ 2024-03-07T07:17:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 134705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-07T07:17:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/ 2024-03-07T07:17:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 91281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-07T07:17:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/ 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 248329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 162737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/ 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 4035417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/ 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/locking/ 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/locking/locktorture.ko 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/time/ 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/time/test_udelay.ko 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-07T07:17:20.796 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc7.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/ 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/interval_tree_test.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/ 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/ 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-07T07:17:20.797 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/memory-notifier-error-inject.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/notifier-error-inject.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/percpu_test.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/pm-notifier-error-inject.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/ 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/rbtree_test.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/ 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test-kstrtox.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test-string_helpers.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 4863217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_bpf.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_firmware.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_module.ko 2024-03-07T07:17:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_user_copy.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/xz/ 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/xz/xz_dec_test.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/ 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/ 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-07T07:17:20.799 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/ 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/ 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/ 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 198809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-07T07:17:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/ 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 667353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/ 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 790545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-07T07:17:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-07T07:17:20.802 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/ 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1046689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/ 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/ 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 194441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/ 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 390033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-07T07:17:20.803 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/hsr/ 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/hsr/hsr.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 284665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-07T07:17:20.804 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-07T07:17:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-07T07:17:20.806 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-07T07:17:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 79921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_gre.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-07T07:17:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/mip6.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-07T07:17:20.809 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-07T07:17:20.810 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/ 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/ 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/lapb/ 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/lapb/lapb.ko 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/ 2024-03-07T07:17:20.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 268449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc2.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/ 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 309361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/ 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 99985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-07T07:17:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 111665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 110329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 412433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-07T07:17:20.813 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 411665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-07T07:17:20.814 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 118081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 92217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-07T07:17:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 96489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 623337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-07T07:17:20.816 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_osf.ko 2024-03-07T07:17:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_synproxy.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tproxy.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/x_tables.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-07T07:17:20.818 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-07T07:17:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-07T07:17:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-07T07:17:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-07T07:17:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpudp.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/ 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/ 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/ 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 384137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-07T07:17:20.823 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/ 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/ 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/phonet.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/pn_pep.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/ 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 253945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 165049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rxrpc/ 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 828145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rxrpc/rxrpc.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/ 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-07T07:17:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_cgroup.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-07T07:17:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq_codel.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-07T07:17:20.826 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/ 2024-03-07T07:17:20.827 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 932785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/ 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/ 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 336969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1513769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/ 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 704697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/ 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 867121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/ 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-07T07:17:20.828 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/ 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 98089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/x25/ 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 131209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/x25/x25.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/ 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_algo.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 105209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_user.ko 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/ 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/ 2024-03-07T07:17:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 642283 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 625640 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7677 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23498 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9916 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70732 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 147214 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 233213 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 210 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72614 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 879 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 257955 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 312782 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/ 2024-03-07T07:17:20.830 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/ 2024-03-07T07:17:20.831 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/doc/ 2024-03-07T07:17:20.831 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/ 2024-03-07T07:17:20.831 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 173 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/changelog.Debian.gz 2024-03-07T07:17:20.831 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 691 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/copyright 2024-03-07T07:17:20.836 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:20.836 INFO:teuthology.task.kernel:searching for kernel 6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:20.836 DEBUG:teuthology.orchestra.run.smithi161:> egrep '(submenu|menuentry.*6.8.0-rc7-gdd5c1cd17167).*{' /boot/grub/grub.cfg 2024-03-07T07:17:20.844 INFO:teuthology.orchestra.run.smithi161.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-07T07:17:20.844 INFO:teuthology.orchestra.run.smithi161.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc7-gdd5c1cd17167-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-07T07:17:20.844 INFO:teuthology.orchestra.run.smithi161.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc7-gdd5c1cd17167-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-07T07:17:20.844 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-07T07:17:20.845 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:20.845 DEBUG:teuthology.orchestra.run.smithi161:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-07T07:17:20.888 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi161.front.sepia.ceph.com to complete... 2024-03-07T07:17:21.333 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2024-03-07T07:17:21.334 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-07T07:17:21.362 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-03-07T07:17:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:21.574 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:21.806 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-07T07:17:21.811 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-07T07:17:21.856 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-07T07:17:21.860 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-07T07:17:22.010 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-07T07:17:22.010 INFO:teuthology.orchestra.run.smithi161.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-07T07:17:22.010 INFO:teuthology.orchestra.run.smithi161.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-07T07:17:22.020 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-03-07T07:17:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub' 2024-03-07T07:17:22.387 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-07T07:17:22.409 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-03-07T07:17:22.682 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:23.005 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-07T07:17:23.015 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-07T07:17:23.079 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-07T07:17:23.083 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-07T07:17:23.220 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-07T07:17:23.220 INFO:teuthology.orchestra.run.smithi084.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-07T07:17:23.220 INFO:teuthology.orchestra.run.smithi084.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-07T07:17:23.259 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-03-07T07:17:23.439 DEBUG:teuthology.orchestra.run.smithi084:> dpkg-deb -c /tmp/linux-image.deb 2024-03-07T07:17:23.489 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./ 2024-03-07T07:17:23.489 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./boot/ 2024-03-07T07:17:23.490 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 4474396 2024-03-06 15:59 ./boot/System.map-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:23.499 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 170903 2024-03-06 15:59 ./boot/config-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:23.500 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11551744 2024-03-06 15:59 ./boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/ 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/ 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/postinst.d/ 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/postrm.d/ 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/preinst.d/ 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/prerm.d/ 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/ 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/ 2024-03-07T07:17:23.517 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/ 2024-03-07T07:17:23.518 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/ 2024-03-07T07:17:23.518 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/ 2024-03-07T07:17:23.518 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/ 2024-03-07T07:17:23.518 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ 2024-03-07T07:17:23.518 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 490441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-07T07:17:23.521 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-07T07:17:23.521 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-07T07:17:23.521 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-07T07:17:23.521 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 93073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-07T07:17:23.521 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 106689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-07T07:17:23.521 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 152137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 83849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-07T07:17:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/ 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/ 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/ 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpuid.ko 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/msr.ko 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/ 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 353961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 886129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-07T07:17:23.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 2294353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-07T07:17:23.613 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ 2024-03-07T07:17:23.613 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/af_alg.ko 2024-03-07T07:17:23.613 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/algif_hash.ko 2024-03-07T07:17:23.613 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/algif_skcipher.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/asymmetric_keys/ 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/ 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-07T07:17:23.614 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-07T07:17:23.615 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cryptd.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_simd.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-07T07:17:23.616 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lrw.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-07T07:17:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 143025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-07T07:17:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xts.ko 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_extlog.ko 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/apei/ 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/apei/einj.ko 2024-03-07T07:17:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 104417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 89929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 88305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci.ko 2024-03-07T07:17:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-07T07:17:23.621 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 52169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_legacy.ko 2024-03-07T07:17:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-07T07:17:23.623 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_radisys.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rz1000.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-07T07:17:23.624 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 83249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-07T07:17:23.625 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/ 2024-03-07T07:17:23.626 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 124385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/ 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/ 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 113801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/ 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 964745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 169697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/ 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 94209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 116393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/ 2024-03-07T07:17:23.627 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 110321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 98185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 263633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/ 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 98105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/ 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/applicom.ko 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/ 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-07T07:17:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 148513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 139305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-07T07:17:23.629 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/ 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 84001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/nvram.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/ 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-07T07:17:23.630 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/ 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/ 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-palmas.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-si5351.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-twl6040.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-wm831x.ko 2024-03-07T07:17:23.631 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/ 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 246777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/ 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/ 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 570217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-07T07:17:23.632 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/ 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/ 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/ 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ 2024-03-07T07:17:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 122793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 80297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-07T07:17:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 56729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/ 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-gpio.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max14577.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max77693.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max8997.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-palmas.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/ 2024-03-07T07:17:23.635 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/efi/ 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/ 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-arizona.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-da9052.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-da9055.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-dln2.ko 2024-03-07T07:17:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 77745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-generic.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-kempld.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max7300.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max730x.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max732x.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-07T07:17:23.637 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-sch.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-vx855.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/ 2024-03-07T07:17:23.638 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-a4tech.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-apple.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-belkin.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cherry.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-chicony.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 60657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cp2112.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cypress.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-07T07:17:23.639 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ezkey.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-generic.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-07T07:17:23.640 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kensington.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lg-g15.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 57969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 101537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 80897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-magicmouse.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-microsoft.ko 2024-03-07T07:17:23.641 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-monterey.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ntrig.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 72841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-07T07:17:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-07T07:17:23.643 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-07T07:17:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 143377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 269209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/ 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 125625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-07T07:17:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 218865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/ 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 64297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 89529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 305385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 66793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-07T07:17:23.646 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 97881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 74313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 69305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-07T07:17:23.647 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 99505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-07T07:17:23.648 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc2103.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 66889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 94593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-07T07:17:23.649 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hih6130.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 140129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/jc42.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-07T07:17:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 72737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-07T07:17:23.651 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 108745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-07T07:17:23.652 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-07T07:17:23.653 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 119841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 82713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 54337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-07T07:17:23.654 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 82473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-07T07:17:23.655 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-07T07:17:23.656 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 43441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 52361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 79833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 71249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 63193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 71225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-07T07:17:23.657 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 101377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 119409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/ 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/ 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/ 2024-03-07T07:17:23.658 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-07T07:17:23.659 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-07T07:17:23.660 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-07T07:17:23.661 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/ 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ 2024-03-07T07:17:23.662 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 273513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 883841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 69177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 324233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 97825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 282329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 66049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 493129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/ 2024-03-07T07:17:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 420529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/ 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 741609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 296785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 153705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/usnic/ 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 169089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-07T07:17:23.664 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 266529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 100257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 111329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 128657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 129793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/ 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/evbug.ko 2024-03-07T07:17:23.665 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/ff-memless.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/ 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/ 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-07T07:17:23.666 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lm8323.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lm8333.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/qt1070.ko 2024-03-07T07:17:23.667 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/qt2160.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/stowaway.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/matrix-keymap.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/ 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-07T07:17:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 123177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 89377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 335857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/psmouse.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/ 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 109553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-07T07:17:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ct82c710.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/parkbd.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/pcips2.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ps2mult.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serport.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/ 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-88pm860x.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-adp5520.ko 2024-03-07T07:17:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-bd2802.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-da903x.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-da9052.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-gpio.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3533.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm355x.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3642.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp8788.ko 2024-03-07T07:17:23.671 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-max8997.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-mc13783.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca9532.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca955x.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca963x.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-tca6507.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-wm8350.ko 2024-03-07T07:17:23.672 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/ 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/ 2024-03-07T07:17:23.673 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 647033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 93313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bufio.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 155801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 107929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-era.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-07T07:17:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-mirror.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 77865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-region-hash.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 109497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-snapshot.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 181761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-07T07:17:23.675 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-zero.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/ 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 199825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 100833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 126361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 368481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/ 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/ 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 178041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 63233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-07T07:17:23.676 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 123225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 80977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 52921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/ 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm800.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm805.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm80x.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/arizona-i2c.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 123625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/arizona.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/bcm590xx.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-07T07:17:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/dln2.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/janz-cmodio.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/kempld-core.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lm3533-core.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lp3943.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 56961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/max8907.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/menf21bmc.ko 2024-03-07T07:17:23.678 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/retu-mfd.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 80329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/si476x-core.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/tps65010.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/tps6507x.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wm8994.ko 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ 2024-03-07T07:17:23.679 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ad525x_dpot.ko 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/ 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/ 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/core.ko 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/ 2024-03-07T07:17:23.680 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ds1682.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/dummy-irq.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/echo/ 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/echo/echo.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/ 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/genwqe/ 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 152041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-07T07:17:23.681 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hmc6352.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ibmasm/ 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 72505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ics932s401.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/ 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/ 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 125849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-07T07:17:23.682 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 56361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 313545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/phantom.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ti-st/ 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 74289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/ 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 183513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/ 2024-03-07T07:17:23.683 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 491561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/ 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/ 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 105929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 458969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/ 2024-03-07T07:17:23.684 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 130657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 68777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 64609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 101673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/ 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 54617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/ 2024-03-07T07:17:23.685 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 69161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/ 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/ 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/ 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 54609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 87449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/ 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 97185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-07T07:17:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 102481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 90185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 81313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 69537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/ 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 78377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 176689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1434449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-07T07:17:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 128425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 131265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 314321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/ 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 323681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/ 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 193537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-07T07:17:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 347161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1045321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 166129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/ 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 204185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-07T07:17:23.689 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/ 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 69425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 141153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 62825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/ 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 60665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-07T07:17:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 62825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/ 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 281193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fujitsu/ 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 90297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-07T07:17:23.691 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 295673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 584297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 245977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 944449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 288481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/ 2024-03-07T07:17:23.692 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 514337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-07T07:17:23.693 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-07T07:17:23.693 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 93465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-07T07:17:23.693 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-07T07:17:23.693 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 734689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-07T07:17:23.693 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-07T07:17:23.695 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 151649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-07T07:17:23.695 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 86985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-07T07:17:23.695 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/ 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 102433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 122601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/ 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 727377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 278825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1121537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-07T07:17:23.696 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 52977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 95569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/ 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 108401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 73609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-07T07:17:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/ 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 151193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/ 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 136793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/ 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/ 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 227841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 87009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-07T07:17:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 671985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/ 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/ 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 83801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 194057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/ 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 104001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/ 2024-03-07T07:17:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1066817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-07T07:17:23.830 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/ 2024-03-07T07:17:23.830 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/ 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 54721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 63193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/ 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 73249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 68041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/ 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-07T07:17:23.831 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 495641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/ 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 103177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 166041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 66265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 78713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/ 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-07T07:17:23.832 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/ 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 92337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/ 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 79993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 83713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/ 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/ 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/ 2024-03-07T07:17:23.833 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/defxx.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/skfp/ 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 217025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 74721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/ 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 237241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/ 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 85841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 62889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-07T07:17:23.834 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/ 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/ 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-07T07:17:23.835 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 81953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 76561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-07T07:17:23.836 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 99001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/plip/ 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 43761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/plip/plip.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-07T07:17:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sb1000.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/ 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 64617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/ 2024-03-07T07:17:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 107225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 86881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/ 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 144345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/ 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 307233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/ 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 143993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-07T07:17:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/ 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/ 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 267721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 103353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/ 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 131297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 85209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/ 2024-03-07T07:17:23.840 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/ 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pci-stub.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/ 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 146129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 62065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 112785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-07T07:17:23.841 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/ 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/broadcom/ 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/samsung/ 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/ 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/ 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 69025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/ 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/ 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-07T07:17:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/ 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 73593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 131937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-07T07:17:23.843 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/ 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-07T07:17:23.844 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/ 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 54953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/da9030_battery.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/da9052-battery.ko 2024-03-07T07:17:23.845 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/gpio-charger.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max14577_charger.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max17042_battery.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max8903_charger.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max8925_power.ko 2024-03-07T07:17:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/sbs-battery.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/test_power.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm831x_power.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm8350_power.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/ 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/ 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/ 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-07T07:17:23.847 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/ 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9052.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9055.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9063.ko 2024-03-07T07:17:23.848 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 68473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-07T07:17:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8907.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8925.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8997.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8998.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-07T07:17:23.850 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-palmas.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-07T07:17:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 77521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 57713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-07T07:17:23.852 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 135249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/ 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 271385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 100529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/ 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 356833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 295953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic94xx/ 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 189089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-07T07:17:23.853 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/ 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 108257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/ 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 246913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/ 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1171857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/ 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 238369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/ 2024-03-07T07:17:23.854 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 115305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/ 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 308905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/ 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 76033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 101417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 146809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 75969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-07T07:17:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/ 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 212329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 60497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/ 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 78217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 157713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fdomain.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/ 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 294881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 201721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-07T07:17:23.856 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/imm.ko 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 43969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 265937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 101873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/ 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 317129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 52857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/ 2024-03-07T07:17:23.857 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 315337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 145489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/ 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 216345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/ 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 2193953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/ 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 73465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 310665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 85513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/ 2024-03-07T07:17:23.858 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 659585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/ 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 119465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 78033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/ 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 81545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/ 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 366305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 124593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ppa.ko 2024-03-07T07:17:23.859 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/ 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1876657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 85185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/ 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 558897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qlogicfas408.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 261073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 173921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 280105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-07T07:17:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 97617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 73857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 115705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 164865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/xen-scsifront.ko 2024-03-07T07:17:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 129345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/ 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/ 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 736665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/ 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 931433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 122481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/ 2024-03-07T07:17:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 75497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/ 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/ 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-07T07:17:23.863 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-07T07:17:23.864 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 78329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 57769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/moxa.ko 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/mxser.ko 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 108481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/ 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/ 2024-03-07T07:17:23.865 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/altera_uart.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 72481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/ 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 101969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/rp2.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/ 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 545377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-07T07:17:23.866 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/ 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_mf624.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_netx.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-07T07:17:23.867 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/ 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/c67x00/ 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 73201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 145753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/ 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 87001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-07T07:17:23.868 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 89761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/common/ 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/common/ulpi.ko 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc2/ 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/ 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 452785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-07T07:17:23.869 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/ 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/ 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 60321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 92401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 50937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 122241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-07T07:17:23.870 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 57625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 85505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/ 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-07T07:17:23.871 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 62361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 161193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/ 2024-03-07T07:17:23.872 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 157593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 52921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 69609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 75961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 74977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 73009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 65873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-07T07:17:23.873 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 65993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 81401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 156321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/ 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 80009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 87249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 78769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811_cs.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-07T07:17:23.874 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/ 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/cytherm.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ehset.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-07T07:17:23.875 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/lvstest.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/ 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 64737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-07T07:17:23.876 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbtest.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/mon/ 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 72801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/mon/usbmon.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/musb/ 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 301593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/ 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-07T07:17:23.877 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/f81232.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 175097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-07T07:17:23.878 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 136977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 124737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 107425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-07T07:17:23.879 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/metro-usb.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 66353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 78121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 56241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mxuport.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 191817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 54257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-07T07:17:23.880 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-07T07:17:23.881 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 125513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usbserial.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 52753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-07T07:17:23.882 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 180281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/ 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 71001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 104041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/ 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/ 2024-03-07T07:17:23.883 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 162841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 103649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 76433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/ 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 113657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 57993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 89049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/ 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/ 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-07T07:17:23.884 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/bd6107.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-07T07:17:23.885 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/ 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/ 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-07T07:17:23.886 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 56329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 103025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-07T07:17:23.887 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/acquirewdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/advantechwdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/dw_wdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-07T07:17:23.888 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-07T07:17:23.889 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/retu_wdt.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-07T07:17:23.890 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-07T07:17:23.891 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/ 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/ 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 176337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 71145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-scsiback.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/ 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-07T07:17:23.892 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/ 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 158217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/adfs/ 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/adfs/adfs.ko 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/ 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 163433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/afs/ 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1019049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/afs/kafs.ko 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/autofs/ 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 103185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/autofs/autofs4.ko 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/ 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 64585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/bfs/ 2024-03-07T07:17:23.893 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 41001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/bfs/bfs.ko 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/ 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 3487249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/ 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 305841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1335369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/ 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 97713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/configfs/ 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 108545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/configfs/configfs.ko 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/ 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-07T07:17:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/ 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 644161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/efs/ 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/efs/efs.ko 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/ 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1527625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/ 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/freevxfs/ 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/freevxfs/freevxfs.ko 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/ 2024-03-07T07:17:23.895 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/ 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1231233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/ 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 141625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/ 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 223177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hpfs/ 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 193481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hpfs/hpfs.ko 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/ 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 74689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/ 2024-03-07T07:17:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 420329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/ 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 281617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/ 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 88897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/ 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 490409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/ 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/ 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 81433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/ 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/ 2024-03-07T07:17:23.897 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 117361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1058273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 66345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv2.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 120169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 2041705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/ 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/ 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1511641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/ 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 582409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/ 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-07T07:17:23.898 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ascii.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-07T07:17:23.899 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-07T07:17:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-07T07:17:23.903 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 94033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 142569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 165641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 118017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-07T07:17:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-07T07:17:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ntfs/ 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 220457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ntfs/ntfs.ko 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 244633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 440633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 54161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 2590681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-07T07:17:23.906 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/omfs/ 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/omfs/omfs.ko 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/ 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 360897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 56929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx4/ 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx4/qnx4.ko 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx6/ 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 46601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx6/qnx6.ko 2024-03-07T07:17:23.907 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/ 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_tree.ko 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_v1.ko 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_v2.ko 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/ 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 532161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/ 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/ 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/ 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 2712385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/ 2024-03-07T07:17:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/ 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 134705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/ 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 91281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/ 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 248329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 162737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/ 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 4035417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/ 2024-03-07T07:17:23.909 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/locking/ 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 80481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/locking/locktorture.ko 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/time/ 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/time/test_udelay.ko 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 60257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc7.ko 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/ 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-07T07:17:23.910 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/interval_tree_test.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/ 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/ 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/memory-notifier-error-inject.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/notifier-error-inject.ko 2024-03-07T07:17:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/percpu_test.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/pm-notifier-error-inject.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/ 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 143257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/rbtree_test.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/ 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test-kstrtox.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test-string_helpers.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 4863217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_bpf.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_firmware.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_module.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_user_copy.ko 2024-03-07T07:17:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/xz/ 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/xz/xz_dec_test.ko 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/ 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/ 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-07T07:17:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/ 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/ 2024-03-07T07:17:23.914 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 82865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/ 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 198809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/ 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 667353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/ 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 790545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ 2024-03-07T07:17:23.915 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-07T07:17:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/ 2024-03-07T07:17:23.917 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1046689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/ 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 125761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/ 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 194441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 58737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/ 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 390033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-07T07:17:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/hsr/ 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 102033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/hsr/hsr.ko 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 284665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 47873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-07T07:17:23.919 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 51209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 61505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-07T07:17:23.920 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-07T07:17:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-07T07:17:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-07T07:17:23.923 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 45041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-07T07:17:23.924 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 79921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_gre.ko 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 94161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 54265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/mip6.ko 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ 2024-03-07T07:17:23.925 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-07T07:17:23.926 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-07T07:17:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 74873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/ 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 84457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-07T07:17:23.928 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/ 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 125201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 25809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 53225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/lapb/ 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/lapb/lapb.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/ 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-07T07:17:23.929 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 268449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc2.ko 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/ 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 309361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/ 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 119689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-07T07:17:23.930 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 99985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 100273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 102545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 102337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 111665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 59185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 108337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 112137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 112401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 110329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 113281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ 2024-03-07T07:17:23.931 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 412433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-07T07:17:23.932 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 411665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 118081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 108305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-07T07:17:23.933 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 66529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 92217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 96489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-07T07:17:23.934 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 44129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 623337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 42569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 22929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-07T07:17:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 40753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-07T07:17:23.936 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_osf.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_synproxy.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tproxy.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 89225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/x_tables.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-07T07:17:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 18073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 38769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-07T07:17:23.938 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-07T07:17:23.939 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 43193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-07T07:17:23.940 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-07T07:17:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-07T07:17:23.942 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 29993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 16809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 8449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpudp.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/ 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 14433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-07T07:17:23.943 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/ 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 12329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/ 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 384137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/ 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/ 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 112521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/phonet.ko 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/pn_pep.ko 2024-03-07T07:17:23.944 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/ 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 253945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 165049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 68129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rxrpc/ 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 828145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rxrpc/rxrpc.ko 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/ 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 37081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-07T07:17:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 43409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 19177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_cgroup.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 39513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 62649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 13313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-07T07:17:23.946 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 33417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 34649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq_codel.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 35449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 49841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 21969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 66441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-07T07:17:23.947 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 30217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 36145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 27401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 24769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 48529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 32809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 26785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 31313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-07T07:17:23.948 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 28265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/ 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 932785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/ 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/ 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 336969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 55009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 1513769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/ 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 704697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-07T07:17:23.949 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/ 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 10393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 867121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/ 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/ 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 87737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 67937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 98089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 11073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 17809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/x25/ 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 131209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/x25/x25.ko 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/ 2024-03-07T07:17:23.950 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_algo.ko 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 20545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 105209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_user.ko 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/ 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/ 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 15433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 642283 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 625640 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 7677 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 23498 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 9916 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 70732 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-07T07:17:23.951 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 147214 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 233213 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 210 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 72614 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 879 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 257955 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 312782 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/ 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/ 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/doc/ 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/ 2024-03-07T07:17:23.952 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 173 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/changelog.Debian.gz 2024-03-07T07:17:23.953 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r-- root/root 691 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/copyright 2024-03-07T07:17:23.957 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:23.957 INFO:teuthology.task.kernel:searching for kernel 6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:23.957 DEBUG:teuthology.orchestra.run.smithi084:> egrep '(submenu|menuentry.*6.8.0-rc7-gdd5c1cd17167).*{' /boot/grub/grub.cfg 2024-03-07T07:17:23.964 INFO:teuthology.orchestra.run.smithi084.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-07T07:17:23.964 INFO:teuthology.orchestra.run.smithi084.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc7-gdd5c1cd17167-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-07T07:17:23.965 INFO:teuthology.orchestra.run.smithi084.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc7-gdd5c1cd17167-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-07T07:17:23.965 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-07T07:17:23.965 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:23.965 DEBUG:teuthology.orchestra.run.smithi084:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-07T07:17:24.008 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi084.front.sepia.ceph.com to complete... 2024-03-07T07:17:24.366 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub' 2024-03-07T07:17:24.367 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-07T07:17:24.375 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-03-07T07:17:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:24.556 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:17:24.798 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-07T07:17:24.803 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-07T07:17:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-07T07:17:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-07T07:17:24.954 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-07T07:17:24.954 INFO:teuthology.orchestra.run.smithi084.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-07T07:17:24.955 INFO:teuthology.orchestra.run.smithi084.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-07T07:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-03-07T07:17:53.160 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-07T07:17:53.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-07T07:17:53.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:17:56.091 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-07T07:17:56.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-07T07:17:56.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:18:11.516 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-07T07:18:14.592 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-07T07:18:20.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-07T07:18:20.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:18:23.580 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-07T07:18:23.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-07T07:18:23.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:18:26.652 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-07T07:18:35.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-07T07:18:35.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:18:38.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-07T07:18:38.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:18:57.088 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-07T07:19:12.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-07T07:19:12.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:19:12.769 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-03-07T07:19:13.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-07T07:19:13.685 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-07T07:19:13.686 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-03-07T07:19:13.733 INFO:teuthology.orchestra.run.smithi084.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:19:13.733 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:19:13.733 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-07T07:19:13.733 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-07T07:19:14.734 DEBUG:teuthology.parallel:result is None 2024-03-07T07:19:35.591 DEBUG:teuthology.orchestra.remote:timed out 2024-03-07T07:19:50.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-07T07:19:50.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:19:50.918 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-03-07T07:19:51.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-07T07:19:51.501 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-07T07:19:51.501 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-03-07T07:19:51.550 INFO:teuthology.orchestra.run.smithi161.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:19:51.551 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:19:51.551 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-07T07:19:51.551 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-07T07:19:52.554 DEBUG:teuthology.parallel:result is None 2024-03-07T07:19:52.554 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-07T07:19:52.567 INFO:teuthology.task.internal:Creating test directory... 2024-03-07T07:19:52.567 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-07T07:19:52.571 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-07T07:19:52.579 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-07T07:19:52.585 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-07T07:19:52.594 INFO:teuthology.task.internal:Creating archive directory... 2024-03-07T07:19:52.595 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-07T07:19:52.620 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-07T07:19:52.956 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-07T07:19:52.963 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-07T07:19:52.963 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-07T07:19:52.966 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-07T07:19:53.056 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-07T07:19:53.064 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-07T07:19:53.078 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-07T07:19:53.086 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-07T07:19:53.089 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-07T07:19:53.096 INFO:teuthology.task.internal:Configuring sudo... 2024-03-07T07:19:53.096 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-07T07:19:53.099 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-07T07:19:53.120 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-07T07:19:53.129 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-07T07:19:53.129 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-07T07:19:53.168 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-07T07:19:53.177 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-07T07:19:53.230 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-07T07:19:53.282 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:19:53.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-07T07:19:53.356 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-07T07:19:53.365 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-07T07:19:53.415 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:19:53.416 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-07T07:19:53.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-03-07T07:19:53.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-03-07T07:19:53.597 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-07T07:19:53.605 INFO:teuthology.task.internal:Starting timer... 2024-03-07T07:19:53.605 INFO:teuthology.run_tasks:Running task pcp... 2024-03-07T07:19:53.616 INFO:teuthology.run_tasks:Running task selinux... 2024-03-07T07:19:53.624 DEBUG:teuthology.task.selinux:Excluding smithi084: OS 'ubuntu' does not support SELinux 2024-03-07T07:19:53.624 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2024-03-07T07:19:53.624 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-07T07:19:53.624 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-07T07:19:53.624 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-07T07:19:53.625 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-07T07:19:53.633 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-07T07:19:53.639 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-07T07:19:53.762 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-07T07:19:53.779 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-07T07:19:53.780 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-07T07:27:24.139 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2024-03-07T07:27:24.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-07T07:27:24.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:27:24.227 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-03-07T07:27:24.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-07T07:27:24.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-07T07:27:24.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T07:27:24.443 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-03-07T07:27:24.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-07T07:27:24.555 INFO:teuthology.run_tasks:Running task clock... 2024-03-07T07:27:24.566 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-07T07:27:24.566 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-07T07:27:24.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-07T07:27:24.570 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-07T07:27:24.570 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-07T07:27:24.606 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-07T07:27:24.606 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Command line: ntpd -gq 2024-03-07T07:27:24.606 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: ---------------------------------------------------- 2024-03-07T07:27:24.606 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: ntp-4 is maintained by Network Time Foundation, 2024-03-07T07:27:24.606 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-07T07:27:24.606 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: corporation. Support and training for ntp-4 are 2024-03-07T07:27:24.607 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: available at https://www.nwtime.org/support 2024-03-07T07:27:24.607 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: ---------------------------------------------------- 2024-03-07T07:27:24.607 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: proto: precision = 0.042 usec (-24) 2024-03-07T07:27:24.607 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: basedate set to 2022-02-04 2024-03-07T07:27:24.607 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: gps base set to 2022-02-06 (week 2196) 2024-03-07T07:27:24.607 INFO:teuthology.orchestra.run.smithi084.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-07T07:27:24.607 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-07T07:27:24.608 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: restrict ::: KOD does nothing without LIMITED. 2024-03-07T07:27:24.608 INFO:teuthology.orchestra.run.smithi084.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-07T07:27:24.609 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Listen and drop on 0 v6wildcard [::]:123 2024-03-07T07:27:24.609 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-07T07:27:24.609 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Listen normally on 2 lo 127.0.0.1:123 2024-03-07T07:27:24.609 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Listen normally on 3 enp3s0f1 172.21.15.84:123 2024-03-07T07:27:24.609 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Listen normally on 4 lo [::1]:123 2024-03-07T07:27:24.609 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d751%5]:123 2024-03-07T07:27:24.609 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:24 ntpd[17155]: Listening on routing socket on fd #22 for interface updates 2024-03-07T07:27:24.640 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-07T07:27:24.640 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Command line: ntpd -gq 2024-03-07T07:27:24.640 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: ---------------------------------------------------- 2024-03-07T07:27:24.640 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: ntp-4 is maintained by Network Time Foundation, 2024-03-07T07:27:24.641 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-07T07:27:24.641 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: corporation. Support and training for ntp-4 are 2024-03-07T07:27:24.641 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: available at https://www.nwtime.org/support 2024-03-07T07:27:24.641 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: ---------------------------------------------------- 2024-03-07T07:27:24.641 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: proto: precision = 0.042 usec (-24) 2024-03-07T07:27:24.641 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: basedate set to 2022-02-04 2024-03-07T07:27:24.642 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: gps base set to 2022-02-06 (week 2196) 2024-03-07T07:27:24.642 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-07T07:27:24.642 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-07T07:27:24.642 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: restrict ::: KOD does nothing without LIMITED. 2024-03-07T07:27:24.642 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-07T07:27:24.643 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Listen and drop on 0 v6wildcard [::]:123 2024-03-07T07:27:24.643 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-07T07:27:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Listen normally on 2 lo 127.0.0.1:123 2024-03-07T07:27:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2024-03-07T07:27:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Listen normally on 4 lo [::1]:123 2024-03-07T07:27:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2024-03-07T07:27:24.644 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:24 ntpd[17184]: Listening on routing socket on fd #22 for interface updates 2024-03-07T07:27:25.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:25 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:25.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:25 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:25.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:25 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:25.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:25 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:25.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:25 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:25.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:25 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:25.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:25 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:25.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:25 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:25.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:25 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:25.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:25 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:25.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:25 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:25.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:25 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:26.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:26 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:26.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:26 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:27 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:27.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:27 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:27 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:27.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:27 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:27 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:27.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:27 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:27.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:27.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:27.644 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.644 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:27.644 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:27.644 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:27.644 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:27.644 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:27.644 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:27 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:28.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:28.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:28 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:29.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:29 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:29 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:29 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:29 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:29 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:29 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:29 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:29.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:29 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:29.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:29.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:29 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:30.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:30.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:30 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:31.606 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:31 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:31.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:31 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:31.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:31 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:31.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:31 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:31.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:31 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:31.607 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:31 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:31.608 INFO:teuthology.orchestra.run.smithi084.stdout: 7 Mar 07:27:31 ntpd[17155]: ntpd: time slew +0.001969 s 2024-03-07T07:27:31.608 INFO:teuthology.orchestra.run.smithi084.stdout:ntpd: time slew +0.001969s 2024-03-07T07:27:31.609 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:31 ntpd[17155]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-07T07:27:31.609 INFO:teuthology.orchestra.run.smithi084.stderr: 7 Mar 07:27:31 ntpd[17155]: can't open /var/log/ntpstats/loopstats.20240307: Permission denied 2024-03-07T07:27:31.641 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240307: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-07T07:27:31.642 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240307: Permission denied 2024-03-07T07:27:31.643 INFO:teuthology.orchestra.run.smithi161.stdout: 7 Mar 07:27:31 ntpd[17184]: ntpd: time slew +0.000495 s 2024-03-07T07:27:31.643 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew +0.000495s 2024-03-07T07:27:31.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-07T07:27:31.643 INFO:teuthology.orchestra.run.smithi161.stderr: 7 Mar 07:27:31 ntpd[17184]: can't open /var/log/ntpstats/loopstats.20240307: Permission denied 2024-03-07T07:27:31.714 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2024-03-07T07:27:31.715 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2024-03-07T07:27:31.715 INFO:teuthology.orchestra.run.smithi084.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:27:31.715 INFO:teuthology.orchestra.run.smithi084.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:27:31.715 INFO:teuthology.orchestra.run.smithi084.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:27:31.715 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:27:31.732 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-03-07T07:27:31.732 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-03-07T07:27:31.732 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:27:31.732 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:27:31.733 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:27:31.733 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:27:31.734 INFO:teuthology.run_tasks:Running task install... 2024-03-07T07:27:31.743 DEBUG:teuthology.task.install:project ceph 2024-03-07T07:27:31.743 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}} 2024-03-07T07:27:31.743 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'} 2024-03-07T07:27:31.743 INFO:teuthology.task.install:Using flavor: default 2024-03-07T07:27:31.749 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-07T07:27:31.749 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-07T07:27:31.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-key list | grep Ceph 2024-03-07T07:27:31.750 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2024-03-07T07:27:31.863 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-07T07:27:31.873 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-07T07:27:31.912 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-07T07:27:31.913 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph.com (release key) 2024-03-07T07:27:31.914 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-07T07:27:31.914 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-07T07:27:31.914 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T07:27:31.923 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-07T07:27:31.923 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2024-03-07T07:27:31.924 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-07T07:27:31.924 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-07T07:27:31.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T07:27:32.062 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default/ 2024-03-07T07:27:32.062 INFO:teuthology.task.install.deb:Package version is 19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:27:32.137 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default/ 2024-03-07T07:27:32.138 INFO:teuthology.task.install.deb:Package version is 19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:27:32.187 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:27:32.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-07T07:27:32.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2024-03-07T07:27:32.310 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:27:32.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-07T07:27:32.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-03-07T07:27:32.399 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-07T07:27:32.408 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-07T07:27:32.411 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-07T07:27:32.428 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-07T07:27:32.504 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy InRelease 2024-03-07T07:27:32.513 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-07T07:27:32.522 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-07T07:27:32.540 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-07T07:27:32.542 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-07T07:27:32.558 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy InRelease 2024-03-07T07:27:32.577 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-07T07:27:32.579 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-07T07:27:32.601 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-07T07:27:32.614 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-07T07:27:32.622 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-07T07:27:32.633 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-07T07:27:32.654 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-03-07T07:27:32.662 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-03-07T07:27:32.980 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 28.9 kB in 1s (52.6 kB/s) 2024-03-07T07:27:33.094 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 28.9 kB in 1s (52.7 kB/s) 2024-03-07T07:27:33.952 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-03-07T07:27:33.966 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1848-g8b896a9e-1jammy cephadm=19.0.0-1848-g8b896a9e-1jammy ceph-mds=19.0.0-1848-g8b896a9e-1jammy ceph-mgr=19.0.0-1848-g8b896a9e-1jammy ceph-common=19.0.0-1848-g8b896a9e-1jammy ceph-fuse=19.0.0-1848-g8b896a9e-1jammy ceph-test=19.0.0-1848-g8b896a9e-1jammy ceph-volume=19.0.0-1848-g8b896a9e-1jammy radosgw=19.0.0-1848-g8b896a9e-1jammy python3-rados=19.0.0-1848-g8b896a9e-1jammy python3-rgw=19.0.0-1848-g8b896a9e-1jammy python3-cephfs=19.0.0-1848-g8b896a9e-1jammy python3-rbd=19.0.0-1848-g8b896a9e-1jammy libcephfs2=19.0.0-1848-g8b896a9e-1jammy libcephfs-dev=19.0.0-1848-g8b896a9e-1jammy librados2=19.0.0-1848-g8b896a9e-1jammy librbd1=19.0.0-1848-g8b896a9e-1jammy rbd-fuse=19.0.0-1848-g8b896a9e-1jammy python3-cephfs=19.0.0-1848-g8b896a9e-1jammy cephfs-shell=19.0.0-1848-g8b896a9e-1jammy cephfs-top=19.0.0-1848-g8b896a9e-1jammy cephfs-mirror=19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:27:34.038 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-03-07T07:27:34.039 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-03-07T07:27:34.053 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1848-g8b896a9e-1jammy cephadm=19.0.0-1848-g8b896a9e-1jammy ceph-mds=19.0.0-1848-g8b896a9e-1jammy ceph-mgr=19.0.0-1848-g8b896a9e-1jammy ceph-common=19.0.0-1848-g8b896a9e-1jammy ceph-fuse=19.0.0-1848-g8b896a9e-1jammy ceph-test=19.0.0-1848-g8b896a9e-1jammy ceph-volume=19.0.0-1848-g8b896a9e-1jammy radosgw=19.0.0-1848-g8b896a9e-1jammy python3-rados=19.0.0-1848-g8b896a9e-1jammy python3-rgw=19.0.0-1848-g8b896a9e-1jammy python3-cephfs=19.0.0-1848-g8b896a9e-1jammy python3-rbd=19.0.0-1848-g8b896a9e-1jammy libcephfs2=19.0.0-1848-g8b896a9e-1jammy libcephfs-dev=19.0.0-1848-g8b896a9e-1jammy librados2=19.0.0-1848-g8b896a9e-1jammy librbd1=19.0.0-1848-g8b896a9e-1jammy rbd-fuse=19.0.0-1848-g8b896a9e-1jammy python3-cephfs=19.0.0-1848-g8b896a9e-1jammy cephfs-shell=19.0.0-1848-g8b896a9e-1jammy cephfs-top=19.0.0-1848-g8b896a9e-1jammy cephfs-mirror=19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:27:34.126 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-03-07T07:27:34.215 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2024-03-07T07:27:34.215 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2024-03-07T07:27:34.294 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-03-07T07:27:34.295 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-03-07T07:27:34.381 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2024-03-07T07:27:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-07T07:27:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-07T07:27:34.382 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-07T07:27:34.382 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-07T07:27:34.382 INFO:teuthology.orchestra.run.smithi084.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-07T07:27:34.382 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-07T07:27:34.383 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2024-03-07T07:27:34.383 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-07T07:27:34.383 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-07T07:27:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-07T07:27:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-07T07:27:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-07T07:27:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-07T07:27:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-07T07:27:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-07T07:27:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-07T07:27:34.387 INFO:teuthology.orchestra.run.smithi084.stdout:Recommended packages: 2024-03-07T07:27:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: btrfs-tools 2024-03-07T07:27:34.453 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-03-07T07:27:34.453 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-07T07:27:34.453 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-07T07:27:34.453 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-07T07:27:34.453 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-07T07:27:34.453 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-07T07:27:34.453 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-07T07:27:34.454 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-03-07T07:27:34.454 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-07T07:27:34.454 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-07T07:27:34.454 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-07T07:27:34.455 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-07T07:27:34.455 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-07T07:27:34.456 INFO:teuthology.orchestra.run.smithi161.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-07T07:27:34.456 INFO:teuthology.orchestra.run.smithi161.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-07T07:27:34.456 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-07T07:27:34.456 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-07T07:27:34.456 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-07T07:27:34.457 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2024-03-07T07:27:34.458 INFO:teuthology.orchestra.run.smithi161.stdout: btrfs-tools 2024-03-07T07:27:34.535 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2024-03-07T07:27:34.535 INFO:teuthology.orchestra.run.smithi084.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-07T07:27:34.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-07T07:27:34.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-07T07:27:34.536 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-07T07:27:34.536 INFO:teuthology.orchestra.run.smithi084.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-07T07:27:34.536 INFO:teuthology.orchestra.run.smithi084.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-07T07:27:34.536 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-07T07:27:34.536 INFO:teuthology.orchestra.run.smithi084.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-07T07:27:34.536 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-07T07:27:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-07T07:27:34.538 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-07T07:27:34.538 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-07T07:27:34.538 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-07T07:27:34.538 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-07T07:27:34.538 INFO:teuthology.orchestra.run.smithi084.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-07T07:27:34.538 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-07T07:27:34.538 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-07T07:27:34.538 INFO:teuthology.orchestra.run.smithi084.stdout: socat unzip xmlstarlet zip 2024-03-07T07:27:34.606 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-03-07T07:27:34.606 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-07T07:27:34.606 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-07T07:27:34.606 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-07T07:27:34.606 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-07T07:27:34.606 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-07T07:27:34.606 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-07T07:27:34.607 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-07T07:27:34.608 INFO:teuthology.orchestra.run.smithi161.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-07T07:27:34.608 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-07T07:27:34.608 INFO:teuthology.orchestra.run.smithi161.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-07T07:27:34.609 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-07T07:27:34.610 INFO:teuthology.orchestra.run.smithi161.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-07T07:27:34.610 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-07T07:27:34.610 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-07T07:27:34.610 INFO:teuthology.orchestra.run.smithi161.stdout: socat unzip xmlstarlet zip 2024-03-07T07:27:34.610 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 124 newly installed, 0 to remove and 278 not upgraded. 2024-03-07T07:27:34.610 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 177 MB of archives. 2024-03-07T07:27:34.611 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 735 MB of additional disk space will be used. 2024-03-07T07:27:34.611 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-07T07:27:34.631 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-07T07:27:34.643 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-07T07:27:34.680 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 124 newly installed, 0 to remove and 278 not upgraded. 2024-03-07T07:27:34.681 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 177 MB of archives. 2024-03-07T07:27:34.681 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 735 MB of additional disk space will be used. 2024-03-07T07:27:34.681 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-07T07:27:34.682 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1848-g8b896a9e-1jammy [3,556 kB] 2024-03-07T07:27:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-07T07:27:34.704 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-07T07:27:34.713 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-07T07:27:34.720 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-07T07:27:34.724 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-07T07:27:34.738 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-07T07:27:34.763 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-07T07:27:34.784 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-07T07:27:34.787 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-07T07:27:34.789 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-07T07:27:34.794 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-07T07:27:34.796 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-07T07:27:34.799 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-07T07:27:34.799 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-07T07:27:34.806 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-07T07:27:34.808 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-07T07:27:34.808 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-07T07:27:34.810 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-07T07:27:34.812 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-07T07:27:34.812 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-07T07:27:34.830 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-07T07:27:34.832 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-07T07:27:34.834 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-07T07:27:34.835 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-07T07:27:34.835 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-07T07:27:34.836 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1848-g8b896a9e-1jammy [3,556 kB] 2024-03-07T07:27:34.851 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-07T07:27:34.851 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-07T07:27:34.851 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-07T07:27:34.852 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-07T07:27:34.852 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-07T07:27:34.859 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-07T07:27:34.861 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-07T07:27:34.869 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-07T07:27:34.872 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-07T07:27:34.873 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-07T07:27:34.874 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-07T07:27:34.875 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-07T07:27:34.878 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-07T07:27:34.878 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-07T07:27:34.879 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-07T07:27:34.880 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-07T07:27:34.882 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-07T07:27:34.884 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-07T07:27:34.885 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-07T07:27:34.886 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-07T07:27:34.895 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-07T07:27:34.896 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-07T07:27:34.896 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-07T07:27:34.896 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-07T07:27:34.898 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-07T07:27:34.908 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-07T07:27:34.908 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-07T07:27:34.908 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-07T07:27:34.909 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-07T07:27:34.909 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-07T07:27:34.915 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-07T07:27:34.915 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-07T07:27:34.921 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-07T07:27:34.921 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-07T07:27:34.921 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-07T07:27:34.926 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-07T07:27:34.926 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-07T07:27:34.926 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-07T07:27:34.926 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-07T07:27:34.927 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-07T07:27:34.936 INFO:teuthology.orchestra.run.smithi084.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-07T07:27:34.937 INFO:teuthology.orchestra.run.smithi084.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-07T07:27:34.939 INFO:teuthology.orchestra.run.smithi084.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-07T07:27:34.940 INFO:teuthology.orchestra.run.smithi084.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-07T07:27:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-07T07:27:34.946 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-07T07:27:34.947 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-07T07:27:34.949 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-07T07:27:34.949 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-07T07:27:34.950 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-07T07:27:34.951 INFO:teuthology.orchestra.run.smithi084.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1848-g8b896a9e-1jammy [3,221 kB] 2024-03-07T07:27:34.956 INFO:teuthology.orchestra.run.smithi084.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-07T07:27:34.958 INFO:teuthology.orchestra.run.smithi084.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-07T07:27:34.959 INFO:teuthology.orchestra.run.smithi084.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-07T07:27:34.960 INFO:teuthology.orchestra.run.smithi084.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-07T07:27:34.962 INFO:teuthology.orchestra.run.smithi084.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-07T07:27:34.982 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-07T07:27:34.983 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-07T07:27:34.983 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-07T07:27:34.984 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-07T07:27:34.985 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-07T07:27:35.013 INFO:teuthology.orchestra.run.smithi084.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-07T07:27:35.014 INFO:teuthology.orchestra.run.smithi084.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-07T07:27:35.015 INFO:teuthology.orchestra.run.smithi084.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-07T07:27:35.016 INFO:teuthology.orchestra.run.smithi084.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-07T07:27:35.017 INFO:teuthology.orchestra.run.smithi084.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-07T07:27:35.019 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-07T07:27:35.019 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-07T07:27:35.025 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-07T07:27:35.025 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-07T07:27:35.026 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-07T07:27:35.038 INFO:teuthology.orchestra.run.smithi084.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-07T07:27:35.040 INFO:teuthology.orchestra.run.smithi084.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-07T07:27:35.040 INFO:teuthology.orchestra.run.smithi084.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-07T07:27:35.055 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-07T07:27:35.056 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-07T07:27:35.058 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-07T07:27:35.059 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-07T07:27:35.060 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-07T07:27:35.063 INFO:teuthology.orchestra.run.smithi084.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-07T07:27:35.063 INFO:teuthology.orchestra.run.smithi084.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-07T07:27:35.064 INFO:teuthology.orchestra.run.smithi084.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-07T07:27:35.064 INFO:teuthology.orchestra.run.smithi084.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-07T07:27:35.065 INFO:teuthology.orchestra.run.smithi084.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-07T07:27:35.065 INFO:teuthology.orchestra.run.smithi084.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-07T07:27:35.076 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-07T07:27:35.077 INFO:teuthology.orchestra.run.smithi084.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1848-g8b896a9e-1jammy [712 kB] 2024-03-07T07:27:35.078 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-07T07:27:35.079 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-07T07:27:35.079 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-07T07:27:35.081 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-07T07:27:35.089 INFO:teuthology.orchestra.run.smithi084.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-07T07:27:35.089 INFO:teuthology.orchestra.run.smithi084.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-07T07:27:35.096 INFO:teuthology.orchestra.run.smithi084.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-07T07:27:35.107 INFO:teuthology.orchestra.run.smithi084.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1848-g8b896a9e-1jammy [356 kB] 2024-03-07T07:27:35.119 INFO:teuthology.orchestra.run.smithi084.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1848-g8b896a9e-1jammy [32.8 kB] 2024-03-07T07:27:35.119 INFO:teuthology.orchestra.run.smithi084.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1848-g8b896a9e-1jammy [180 kB] 2024-03-07T07:27:35.122 INFO:teuthology.orchestra.run.smithi084.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-07T07:27:35.124 INFO:teuthology.orchestra.run.smithi084.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-07T07:27:35.125 INFO:teuthology.orchestra.run.smithi084.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-07T07:27:35.127 INFO:teuthology.orchestra.run.smithi084.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1848-g8b896a9e-1jammy [64.5 kB] 2024-03-07T07:27:35.129 INFO:teuthology.orchestra.run.smithi084.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1848-g8b896a9e-1jammy [330 kB] 2024-03-07T07:27:35.131 INFO:teuthology.orchestra.run.smithi084.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-07T07:27:35.136 INFO:teuthology.orchestra.run.smithi084.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-07T07:27:35.137 INFO:teuthology.orchestra.run.smithi084.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-07T07:27:35.138 INFO:teuthology.orchestra.run.smithi084.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-07T07:27:35.144 INFO:teuthology.orchestra.run.smithi084.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1848-g8b896a9e-1jammy [6,571 kB] 2024-03-07T07:27:35.146 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-07T07:27:35.147 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-07T07:27:35.148 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-07T07:27:35.148 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-07T07:27:35.150 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-07T07:27:35.162 INFO:teuthology.orchestra.run.smithi084.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-07T07:27:35.170 INFO:teuthology.orchestra.run.smithi084.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-07T07:27:35.171 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-07T07:27:35.171 INFO:teuthology.orchestra.run.smithi084.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-07T07:27:35.173 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-07T07:27:35.174 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-07T07:27:35.194 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-07T07:27:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-07T07:27:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-07T07:27:35.196 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-07T07:27:35.196 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-07T07:27:35.197 INFO:teuthology.orchestra.run.smithi084.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-07T07:27:35.197 INFO:teuthology.orchestra.run.smithi084.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-07T07:27:35.197 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-07T07:27:35.198 INFO:teuthology.orchestra.run.smithi084.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-07T07:27:35.199 INFO:teuthology.orchestra.run.smithi084.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-07T07:27:35.200 INFO:teuthology.orchestra.run.smithi084.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-07T07:27:35.201 INFO:teuthology.orchestra.run.smithi084.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-07T07:27:35.209 INFO:teuthology.orchestra.run.smithi084.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-07T07:27:35.215 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-07T07:27:35.216 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-07T07:27:35.219 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-07T07:27:35.220 INFO:teuthology.orchestra.run.smithi084.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-07T07:27:35.220 INFO:teuthology.orchestra.run.smithi084.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-07T07:27:35.221 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-07T07:27:35.223 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-07T07:27:35.224 INFO:teuthology.orchestra.run.smithi084.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-07T07:27:35.236 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-07T07:27:35.239 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-07T07:27:35.242 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-07T07:27:35.243 INFO:teuthology.orchestra.run.smithi084.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-07T07:27:35.243 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-07T07:27:35.244 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-07T07:27:35.262 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-07T07:27:35.267 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-07T07:27:35.268 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-07T07:27:35.271 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-07T07:27:35.272 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-07T07:27:35.283 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-07T07:27:35.283 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-07T07:27:35.285 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-07T07:27:35.286 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-07T07:27:35.293 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-07T07:27:35.304 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-07T07:27:35.304 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-07T07:27:35.306 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-07T07:27:35.307 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-07T07:27:35.422 INFO:teuthology.orchestra.run.smithi084.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1848-g8b896a9e-1jammy [112 kB] 2024-03-07T07:27:35.426 INFO:teuthology.orchestra.run.smithi084.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1848-g8b896a9e-1jammy [466 kB] 2024-03-07T07:27:35.446 INFO:teuthology.orchestra.run.smithi084.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1848-g8b896a9e-1jammy [24.9 MB] 2024-03-07T07:27:35.520 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1848-g8b896a9e-1jammy [3,221 kB] 2024-03-07T07:27:35.798 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1848-g8b896a9e-1jammy [712 kB] 2024-03-07T07:27:35.857 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1848-g8b896a9e-1jammy [356 kB] 2024-03-07T07:27:35.885 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1848-g8b896a9e-1jammy [32.8 kB] 2024-03-07T07:27:35.887 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1848-g8b896a9e-1jammy [180 kB] 2024-03-07T07:27:35.902 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1848-g8b896a9e-1jammy [64.5 kB] 2024-03-07T07:27:35.907 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1848-g8b896a9e-1jammy [330 kB] 2024-03-07T07:27:35.932 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1848-g8b896a9e-1jammy [6,571 kB] 2024-03-07T07:27:36.372 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1848-g8b896a9e-1jammy [112 kB] 2024-03-07T07:27:36.377 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1848-g8b896a9e-1jammy [466 kB] 2024-03-07T07:27:36.405 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1848-g8b896a9e-1jammy [24.9 MB] 2024-03-07T07:27:37.148 INFO:teuthology.orchestra.run.smithi084.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1848-g8b896a9e-1jammy [5,079 kB] 2024-03-07T07:27:37.630 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1848-g8b896a9e-1jammy [5,079 kB] 2024-03-07T07:27:37.774 INFO:teuthology.orchestra.run.smithi084.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1848-g8b896a9e-1jammy [244 kB] 2024-03-07T07:27:37.793 INFO:teuthology.orchestra.run.smithi084.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1848-g8b896a9e-1jammy [124 kB] 2024-03-07T07:27:37.801 INFO:teuthology.orchestra.run.smithi084.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1848-g8b896a9e-1jammy [1,525 kB] 2024-03-07T07:27:37.889 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1848-g8b896a9e-1jammy [244 kB] 2024-03-07T07:27:37.891 INFO:teuthology.orchestra.run.smithi084.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1848-g8b896a9e-1jammy [6,252 kB] 2024-03-07T07:27:37.895 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1848-g8b896a9e-1jammy [124 kB] 2024-03-07T07:27:37.898 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1848-g8b896a9e-1jammy [1,525 kB] 2024-03-07T07:27:37.975 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1848-g8b896a9e-1jammy [6,252 kB] 2024-03-07T07:27:38.272 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1848-g8b896a9e-1jammy [22.8 MB] 2024-03-07T07:27:38.570 INFO:teuthology.orchestra.run.smithi084.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1848-g8b896a9e-1jammy [22.8 MB] 2024-03-07T07:27:39.334 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1848-g8b896a9e-1jammy [14.0 kB] 2024-03-07T07:27:39.334 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1848-g8b896a9e-1jammy [868 kB] 2024-03-07T07:27:39.367 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1848-g8b896a9e-1jammy [2,383 kB] 2024-03-07T07:27:39.478 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1848-g8b896a9e-1jammy [777 kB] 2024-03-07T07:27:39.511 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1848-g8b896a9e-1jammy [144 kB] 2024-03-07T07:27:39.518 INFO:teuthology.orchestra.run.smithi161.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1848-g8b896a9e-1jammy [1,922 kB] 2024-03-07T07:27:39.607 INFO:teuthology.orchestra.run.smithi161.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1848-g8b896a9e-1jammy [8,625 kB] 2024-03-07T07:27:40.052 INFO:teuthology.orchestra.run.smithi161.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1848-g8b896a9e-1jammy [14.2 kB] 2024-03-07T07:27:40.148 INFO:teuthology.orchestra.run.smithi161.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1848-g8b896a9e-1jammy [49.9 MB] 2024-03-07T07:27:40.690 INFO:teuthology.orchestra.run.smithi084.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1848-g8b896a9e-1jammy [14.0 kB] 2024-03-07T07:27:40.690 INFO:teuthology.orchestra.run.smithi084.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1848-g8b896a9e-1jammy [868 kB] 2024-03-07T07:27:40.745 INFO:teuthology.orchestra.run.smithi084.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1848-g8b896a9e-1jammy [2,383 kB] 2024-03-07T07:27:40.913 INFO:teuthology.orchestra.run.smithi084.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1848-g8b896a9e-1jammy [777 kB] 2024-03-07T07:27:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1848-g8b896a9e-1jammy [144 kB] 2024-03-07T07:27:40.978 INFO:teuthology.orchestra.run.smithi084.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1848-g8b896a9e-1jammy [1,922 kB] 2024-03-07T07:27:41.116 INFO:teuthology.orchestra.run.smithi084.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1848-g8b896a9e-1jammy [8,625 kB] 2024-03-07T07:27:41.652 INFO:teuthology.orchestra.run.smithi084.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1848-g8b896a9e-1jammy [14.2 kB] 2024-03-07T07:27:41.652 INFO:teuthology.orchestra.run.smithi084.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1848-g8b896a9e-1jammy [49.9 MB] 2024-03-07T07:27:43.972 INFO:teuthology.orchestra.run.smithi161.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1848-g8b896a9e-1jammy [121 kB] 2024-03-07T07:27:43.973 INFO:teuthology.orchestra.run.smithi161.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1848-g8b896a9e-1jammy [228 kB] 2024-03-07T07:27:43.996 INFO:teuthology.orchestra.run.smithi161.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1848-g8b896a9e-1jammy [34.0 kB] 2024-03-07T07:27:43.998 INFO:teuthology.orchestra.run.smithi161.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1848-g8b896a9e-1jammy [23.4 kB] 2024-03-07T07:27:44.000 INFO:teuthology.orchestra.run.smithi161.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1848-g8b896a9e-1jammy [38.5 kB] 2024-03-07T07:27:44.004 INFO:teuthology.orchestra.run.smithi161.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1848-g8b896a9e-1jammy [13.0 MB] 2024-03-07T07:27:44.188 INFO:teuthology.orchestra.run.smithi084.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1848-g8b896a9e-1jammy [121 kB] 2024-03-07T07:27:44.188 INFO:teuthology.orchestra.run.smithi084.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1848-g8b896a9e-1jammy [228 kB] 2024-03-07T07:27:44.190 INFO:teuthology.orchestra.run.smithi084.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1848-g8b896a9e-1jammy [34.0 kB] 2024-03-07T07:27:44.191 INFO:teuthology.orchestra.run.smithi084.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1848-g8b896a9e-1jammy [23.4 kB] 2024-03-07T07:27:44.191 INFO:teuthology.orchestra.run.smithi084.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1848-g8b896a9e-1jammy [38.5 kB] 2024-03-07T07:27:44.192 INFO:teuthology.orchestra.run.smithi084.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1848-g8b896a9e-1jammy [13.0 MB] 2024-03-07T07:27:44.761 INFO:teuthology.orchestra.run.smithi084.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1848-g8b896a9e-1jammy [91.3 kB] 2024-03-07T07:27:45.376 INFO:teuthology.orchestra.run.smithi161.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1848-g8b896a9e-1jammy [91.3 kB] 2024-03-07T07:27:45.390 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 177 MB in 10s (17.4 MB/s) 2024-03-07T07:27:45.510 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-07T07:27:45.576 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-07T07:27:45.580 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-07T07:27:45.625 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-07T07:27:45.911 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-07T07:27:45.925 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-07T07:27:45.969 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-07T07:27:46.004 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 177 MB in 11s (16.5 MB/s) 2024-03-07T07:27:46.151 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-07T07:27:46.217 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-07T07:27:46.221 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-07T07:27:46.266 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-07T07:27:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cmd2. 2024-03-07T07:27:46.319 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-07T07:27:46.355 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-07T07:27:46.536 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-07T07:27:46.551 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-07T07:27:46.578 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-07T07:27:46.717 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-07T07:27:46.722 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-07T07:27:46.809 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-07T07:27:46.888 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cmd2. 2024-03-07T07:27:46.902 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-07T07:27:46.954 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-07T07:27:47.154 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-07T07:27:47.167 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-07T07:27:47.204 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-07T07:27:47.282 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-07T07:27:47.296 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-07T07:27:47.383 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-07T07:27:47.531 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-07T07:27:47.546 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-07T07:27:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-07T07:27:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-07T07:27:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-07T07:27:47.790 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-07T07:27:48.080 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-07T07:27:48.094 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-07T07:27:48.147 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-07T07:27:48.343 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-07T07:27:48.358 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-07T07:27:48.410 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:27:48.542 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-07T07:27:48.555 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-07T07:27:48.608 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:27:48.755 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-07T07:27:48.769 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-07T07:27:48.805 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:27:48.970 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-07T07:27:48.983 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-07T07:27:49.028 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:27:49.184 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-07T07:27:49.199 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-07T07:27:49.243 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:27:49.390 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-07T07:27:49.403 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-07T07:27:49.447 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:27:49.554 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-07T07:27:49.569 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-07T07:27:49.604 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-07T07:27:49.759 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-07T07:27:49.773 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-07T07:27:49.817 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-07T07:27:49.890 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librados2. 2024-03-07T07:27:49.905 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../010-librados2_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:49.948 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librados2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:50.162 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librados2. 2024-03-07T07:27:50.176 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-librados2_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:50.221 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:50.384 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librbd1. 2024-03-07T07:27:50.399 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../011-librbd1_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:50.443 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librbd1 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:50.656 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librbd1. 2024-03-07T07:27:50.670 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-librbd1_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:50.714 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:50.904 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs2. 2024-03-07T07:27:50.918 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:50.962 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:51.108 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2024-03-07T07:27:51.122 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:51.158 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:51.214 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rados. 2024-03-07T07:27:51.230 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:51.265 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rados (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:51.411 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2024-03-07T07:27:51.425 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:51.469 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:51.592 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-07T07:27:51.607 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:27:51.650 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-argparse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:51.797 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-07T07:27:51.810 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:27:51.855 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:51.911 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cephfs. 2024-03-07T07:27:51.926 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:51.969 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cephfs (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:52.107 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2024-03-07T07:27:52.120 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:52.165 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:52.288 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-07T07:27:52.303 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:27:52.347 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-common (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:52.681 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-07T07:27:52.696 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:27:52.708 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-prettytable. 2024-03-07T07:27:52.723 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-07T07:27:52.743 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:52.767 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-07T07:27:53.013 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2024-03-07T07:27:53.027 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-07T07:27:53.072 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-07T07:27:53.144 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rbd. 2024-03-07T07:27:53.159 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:53.194 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rbd (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2024-03-07T07:27:53.338 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:53.382 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:53.572 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-07T07:27:53.587 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-07T07:27:53.630 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-07T07:27:53.701 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-07T07:27:53.716 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-07T07:27:53.760 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-07T07:27:53.916 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-07T07:27:53.931 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-07T07:27:53.974 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-07T07:27:54.054 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-07T07:27:54.068 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-07T07:27:54.104 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-07T07:27:54.302 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-07T07:27:54.317 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-07T07:27:54.352 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-07T07:27:54.381 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-07T07:27:54.396 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-07T07:27:54.431 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-07T07:27:54.697 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua5.1. 2024-03-07T07:27:54.712 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-07T07:27:54.751 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua5.1. 2024-03-07T07:27:54.755 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-07T07:27:54.766 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-07T07:27:54.809 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-07T07:27:55.092 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-any. 2024-03-07T07:27:55.107 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-07T07:27:55.129 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-any. 2024-03-07T07:27:55.142 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-07T07:27:55.144 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-07T07:27:55.187 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-07T07:27:55.352 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package zip. 2024-03-07T07:27:55.367 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-07T07:27:55.402 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking zip (3.0-12build2) ... 2024-03-07T07:27:55.431 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package zip. 2024-03-07T07:27:55.446 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-07T07:27:55.481 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking zip (3.0-12build2) ... 2024-03-07T07:27:55.755 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package unzip. 2024-03-07T07:27:55.770 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-07T07:27:55.776 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package unzip. 2024-03-07T07:27:55.790 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-07T07:27:55.834 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-07T07:27:55.847 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-07T07:27:56.238 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package luarocks. 2024-03-07T07:27:56.251 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package luarocks. 2024-03-07T07:27:56.253 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-07T07:27:56.266 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-07T07:27:56.296 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-07T07:27:56.309 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-07T07:27:56.687 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2024-03-07T07:27:56.701 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-librgw2_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:56.717 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librgw2. 2024-03-07T07:27:56.731 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../027-librgw2_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:56.745 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:56.767 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librgw2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:57.189 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2024-03-07T07:27:57.203 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:57.219 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rgw. 2024-03-07T07:27:57.233 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:57.258 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:57.277 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rgw (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:57.583 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-07T07:27:57.597 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-07T07:27:57.642 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-07T07:27:57.647 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-07T07:27:57.662 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-07T07:27:57.705 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-07T07:27:57.961 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2024-03-07T07:27:57.975 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:58.016 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libradosstriper1. 2024-03-07T07:27:58.019 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:58.031 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:58.083 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libradosstriper1 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:58.448 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2024-03-07T07:27:58.463 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:58.478 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-common. 2024-03-07T07:27:58.493 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:58.505 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:58.527 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-common (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2024-03-07T07:27:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-base. 2024-03-07T07:27:59.647 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:27:59.648 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:27:59.708 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-base (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:00.215 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-07T07:28:00.228 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-07T07:28:00.246 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-07T07:28:00.259 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-07T07:28:00.273 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-07T07:28:00.304 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-07T07:28:00.576 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cheroot. 2024-03-07T07:28:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-07T07:28:00.606 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cheroot. 2024-03-07T07:28:00.620 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-07T07:28:00.625 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-07T07:28:00.665 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-07T07:28:00.978 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-07T07:28:00.992 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-07T07:28:01.026 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-07T07:28:01.037 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-07T07:28:01.039 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-07T07:28:01.085 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-07T07:28:01.290 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-07T07:28:01.303 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-07T07:28:01.339 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-07T07:28:01.370 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-07T07:28:01.385 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-07T07:28:01.420 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-07T07:28:01.625 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-07T07:28:01.639 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-07T07:28:01.665 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-07T07:28:01.679 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-07T07:28:01.683 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-07T07:28:01.723 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-07T07:28:02.011 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempora. 2024-03-07T07:28:02.025 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-07T07:28:02.059 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempora. 2024-03-07T07:28:02.070 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-07T07:28:02.077 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-07T07:28:02.118 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-07T07:28:02.356 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-portend. 2024-03-07T07:28:02.370 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-07T07:28:02.406 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-07T07:28:02.429 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-portend. 2024-03-07T07:28:02.444 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-07T07:28:02.487 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-07T07:28:02.692 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-07T07:28:02.706 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-07T07:28:02.748 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-07T07:28:02.750 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-07T07:28:02.763 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-07T07:28:02.806 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-07T07:28:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-07T07:28:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-07T07:28:03.167 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-07T07:28:03.295 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-07T07:28:03.310 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-07T07:28:03.353 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-07T07:28:03.640 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-natsort. 2024-03-07T07:28:03.653 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-07T07:28:03.671 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-natsort. 2024-03-07T07:28:03.686 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-07T07:28:03.697 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-07T07:28:03.729 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-07T07:28:03.992 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2024-03-07T07:28:04.007 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-07T07:28:04.050 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-07T07:28:04.057 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-logutils. 2024-03-07T07:28:04.072 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-07T07:28:04.115 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-07T07:28:04.370 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-07T07:28:04.385 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-07T07:28:04.427 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-07T07:28:04.428 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-07T07:28:04.442 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-07T07:28:04.517 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-07T07:28:04.714 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2024-03-07T07:28:04.729 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-07T07:28:04.764 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-07T07:28:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-mako. 2024-03-07T07:28:04.811 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-07T07:28:04.846 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-07T07:28:05.067 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-07T07:28:05.082 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-07T07:28:05.117 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-07T07:28:05.132 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-07T07:28:05.147 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-07T07:28:05.182 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-07T07:28:05.428 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-07T07:28:05.444 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-07T07:28:05.486 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-07T07:28:05.502 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-07T07:28:05.517 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-07T07:28:05.560 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-07T07:28:05.822 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2024-03-07T07:28:05.837 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-07T07:28:05.863 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webob. 2024-03-07T07:28:05.878 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-07T07:28:05.880 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-07T07:28:05.921 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-07T07:28:06.225 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2024-03-07T07:28:06.240 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-07T07:28:06.286 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-07T07:28:06.299 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-waitress. 2024-03-07T07:28:06.315 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-07T07:28:06.360 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-07T07:28:06.620 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2024-03-07T07:28:06.635 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-07T07:28:06.643 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempita. 2024-03-07T07:28:06.658 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-07T07:28:06.669 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-07T07:28:06.693 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-07T07:28:06.922 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2024-03-07T07:28:06.937 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-07T07:28:06.972 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-07T07:28:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-paste. 2024-03-07T07:28:06.995 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-07T07:28:07.038 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-07T07:28:07.267 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-07T07:28:07.281 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-07T07:28:07.328 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-07T07:28:07.351 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-07T07:28:07.366 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-07T07:28:07.399 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-07T07:28:08.270 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-07T07:28:08.285 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-07T07:28:08.328 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-07T07:28:08.411 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-07T07:28:08.426 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-07T07:28:08.469 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-07T07:28:08.589 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2024-03-07T07:28:08.604 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-07T07:28:08.665 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-07T07:28:08.755 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webtest. 2024-03-07T07:28:08.770 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-07T07:28:08.813 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-07T07:28:08.950 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2024-03-07T07:28:08.965 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-07T07:28:09.008 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-07T07:28:09.133 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pecan. 2024-03-07T07:28:09.147 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-07T07:28:09.199 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-07T07:28:09.355 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-certifi. 2024-03-07T07:28:09.369 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-07T07:28:09.412 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-07T07:28:09.562 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-certifi. 2024-03-07T07:28:09.576 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-07T07:28:09.620 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-07T07:28:09.732 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-idna. 2024-03-07T07:28:09.746 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-07T07:28:09.807 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-07T07:28:09.898 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-idna. 2024-03-07T07:28:09.912 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-07T07:28:09.948 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-07T07:28:10.110 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-urllib3. 2024-03-07T07:28:10.125 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-07T07:28:10.168 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-07T07:28:10.268 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-urllib3. 2024-03-07T07:28:10.282 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-07T07:28:10.326 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-07T07:28:10.457 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests. 2024-03-07T07:28:10.471 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-07T07:28:10.506 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-07T07:28:10.646 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests. 2024-03-07T07:28:10.659 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-07T07:28:10.704 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-07T07:28:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-07T07:28:10.799 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-07T07:28:10.842 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-07T07:28:11.040 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-07T07:28:11.054 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-07T07:28:11.098 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-07T07:28:11.128 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-07T07:28:11.143 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:11.179 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-07T07:28:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:11.451 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:11.567 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-07T07:28:11.581 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:11.625 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:11.856 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-07T07:28:11.870 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:11.894 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-07T07:28:11.908 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-07T07:28:11.914 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:11.944 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-07T07:28:12.209 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-07T07:28:12.223 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-07T07:28:12.256 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2024-03-07T07:28:12.273 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-07T07:28:12.283 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-07T07:28:12.314 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-07T07:28:12.537 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-openssl. 2024-03-07T07:28:12.551 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-07T07:28:12.595 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-07T07:28:12.633 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2024-03-07T07:28:12.649 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:12.691 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:12.939 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr. 2024-03-07T07:28:12.953 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:12.997 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:13.061 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2024-03-07T07:28:13.077 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:13.138 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:13.392 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mon. 2024-03-07T07:28:13.406 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:13.467 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mon (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:13.849 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2024-03-07T07:28:13.864 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:13.906 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:13.954 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-osd. 2024-03-07T07:28:13.967 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:14.004 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-osd (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:14.660 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2024-03-07T07:28:14.674 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-ceph_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:14.718 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:14.740 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph. 2024-03-07T07:28:14.754 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../068-ceph_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:14.790 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:15.020 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2024-03-07T07:28:15.035 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:15.078 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:15.101 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-fuse. 2024-03-07T07:28:15.115 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:15.159 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-fuse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:15.465 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2024-03-07T07:28:15.480 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:15.521 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mds. 2024-03-07T07:28:15.523 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:15.535 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:15.570 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mds (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:15.876 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2024-03-07T07:28:15.892 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-cephadm_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:15.932 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephadm. 2024-03-07T07:28:15.934 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:15.946 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../071-cephadm_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:15.990 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephadm (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:16.195 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-07T07:28:16.211 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-07T07:28:16.254 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-07T07:28:16.343 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-07T07:28:16.357 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-07T07:28:16.401 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-07T07:28:16.557 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-07T07:28:16.571 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-07T07:28:16.631 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-07T07:28:16.720 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-07T07:28:16.734 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-07T07:28:16.778 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-07T07:28:17.620 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-babel. 2024-03-07T07:28:17.633 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-07T07:28:17.677 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-07T07:28:17.766 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-babel. 2024-03-07T07:28:17.780 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-07T07:28:17.825 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-07T07:28:18.031 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2024-03-07T07:28:18.045 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-07T07:28:18.089 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-07T07:28:18.186 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jinja2. 2024-03-07T07:28:18.199 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-07T07:28:18.244 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-07T07:28:18.409 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-07T07:28:18.423 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:18.467 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:18.797 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-07T07:28:18.803 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-07T07:28:18.811 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:18.817 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-07T07:28:18.847 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:18.886 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-07T07:28:19.159 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-07T07:28:19.172 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-07T07:28:19.189 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2024-03-07T07:28:19.204 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-07T07:28:19.208 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-07T07:28:19.248 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-07T07:28:19.486 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-routes. 2024-03-07T07:28:19.500 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-07T07:28:19.544 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-07T07:28:19.567 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-07T07:28:19.582 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:19.626 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:19.864 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-07T07:28:19.877 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:19.922 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:20.037 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-07T07:28:20.052 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-07T07:28:20.095 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-07T07:28:20.368 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-07T07:28:20.381 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-07T07:28:20.426 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-07T07:28:20.566 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2024-03-07T07:28:20.580 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-07T07:28:20.616 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-07T07:28:20.952 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-07T07:28:20.954 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-joblib. 2024-03-07T07:28:20.962 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-07T07:28:20.967 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-07T07:28:21.012 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-07T07:28:21.071 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-07T07:28:21.399 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2024-03-07T07:28:21.407 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-07T07:28:21.412 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-07T07:28:21.421 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-07T07:28:21.457 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-07T07:28:21.551 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-07T07:28:21.837 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn. 2024-03-07T07:28:21.850 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-07T07:28:21.895 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-07T07:28:22.099 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-07T07:28:22.109 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:22.149 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:22.596 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-07T07:28:22.609 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:22.654 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:23.079 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cachetools. 2024-03-07T07:28:23.089 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-07T07:28:23.129 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-07T07:28:23.455 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-07T07:28:23.469 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-07T07:28:23.522 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-07T07:28:23.590 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cachetools. 2024-03-07T07:28:23.604 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-07T07:28:23.645 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-07T07:28:24.051 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-07T07:28:24.062 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-07T07:28:24.085 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-07T07:28:24.100 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-07T07:28:24.100 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-07T07:28:24.143 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-07T07:28:24.412 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2024-03-07T07:28:24.424 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-07T07:28:24.461 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-07T07:28:24.479 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-07T07:28:24.494 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-07T07:28:24.538 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-07T07:28:24.816 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-google-auth. 2024-03-07T07:28:24.828 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-07T07:28:24.853 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rsa. 2024-03-07T07:28:24.864 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-07T07:28:24.865 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-07T07:28:24.924 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-07T07:28:25.169 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-07T07:28:25.181 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-07T07:28:25.227 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-07T07:28:25.238 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-google-auth. 2024-03-07T07:28:25.253 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-07T07:28:25.288 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-07T07:28:25.538 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2024-03-07T07:28:25.550 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-07T07:28:25.588 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-07T07:28:25.600 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-07T07:28:25.614 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-07T07:28:25.658 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-07T07:28:25.933 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-07T07:28:25.945 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-07T07:28:25.983 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-07T07:28:25.994 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-websocket. 2024-03-07T07:28:26.009 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-07T07:28:26.052 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-07T07:28:26.355 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-07T07:28:26.371 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-07T07:28:26.414 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-07T07:28:26.605 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-07T07:28:26.616 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:26.647 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:26.999 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-07T07:28:27.010 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-07T07:28:27.049 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-07T07:28:27.111 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-07T07:28:27.125 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:27.161 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:27.386 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-07T07:28:27.396 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-07T07:28:27.435 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-07T07:28:27.480 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-07T07:28:27.494 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-07T07:28:27.555 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-07T07:28:27.680 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2024-03-07T07:28:27.691 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-07T07:28:27.721 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-07T07:28:27.899 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-07T07:28:27.913 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-07T07:28:27.941 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2024-03-07T07:28:27.952 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-07T07:28:27.958 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-07T07:28:28.010 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-07T07:28:28.227 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package jq. 2024-03-07T07:28:28.240 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-07T07:28:28.277 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-07T07:28:28.294 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2024-03-07T07:28:28.304 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-07T07:28:28.344 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-07T07:28:28.530 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package socat. 2024-03-07T07:28:28.541 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-07T07:28:28.579 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-07T07:28:28.698 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2024-03-07T07:28:28.708 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:28.748 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:28.874 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package xmlstarlet. 2024-03-07T07:28:28.885 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-07T07:28:28.924 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-07T07:28:29.420 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-test. 2024-03-07T07:28:29.431 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:29.470 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-test (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:30.736 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-volume. 2024-03-07T07:28:30.748 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:30.785 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-volume (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:31.184 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-07T07:28:31.193 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:31.231 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-mirror (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:31.433 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-volume. 2024-03-07T07:28:31.446 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:31.482 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-volume (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:31.518 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-colorama. 2024-03-07T07:28:31.530 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-07T07:28:31.575 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-07T07:28:31.820 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-shell. 2024-03-07T07:28:31.831 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:31.869 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-shell (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:31.878 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-07T07:28:31.890 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:31.928 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-mirror (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:32.105 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-top. 2024-03-07T07:28:32.117 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:32.155 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-top (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:32.222 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-colorama. 2024-03-07T07:28:32.234 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-07T07:28:32.263 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-07T07:28:32.408 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-07T07:28:32.420 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:32.457 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:32.491 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-shell. 2024-03-07T07:28:32.505 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:32.549 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-shell (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:32.777 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-07T07:28:32.788 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-07T07:28:32.811 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-top. 2024-03-07T07:28:32.824 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1848-g8b896a9e-1jammy_all.deb ... 2024-03-07T07:28:32.827 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-07T07:28:32.852 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-top (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:33.096 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-07T07:28:33.109 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:33.146 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs-dev (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:33.156 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-07T07:28:33.168 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-07T07:28:33.198 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-07T07:28:33.465 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-07T07:28:33.481 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-07T07:28:33.523 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-07T07:28:33.560 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2024-03-07T07:28:33.571 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-07T07:28:33.610 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-07T07:28:33.887 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-07T07:28:33.901 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-07T07:28:33.944 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-07T07:28:34.248 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pkg-config. 2024-03-07T07:28:34.260 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-07T07:28:34.290 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package nvme-cli. 2024-03-07T07:28:34.298 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-07T07:28:34.304 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-07T07:28:34.340 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-07T07:28:34.559 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-07T07:28:34.570 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-07T07:28:34.609 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-07T07:28:34.745 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package pkg-config. 2024-03-07T07:28:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-07T07:28:34.803 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-07T07:28:35.037 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-07T07:28:35.049 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-07T07:28:35.056 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-07T07:28:35.070 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-07T07:28:35.087 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-07T07:28:35.114 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-07T07:28:35.398 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2024-03-07T07:28:35.410 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-07T07:28:35.448 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-07T07:28:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-07T07:28:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-07T07:28:35.650 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-07T07:28:35.710 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2024-03-07T07:28:35.723 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-07T07:28:35.768 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-07T07:28:35.962 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastescript. 2024-03-07T07:28:35.976 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-07T07:28:36.020 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-07T07:28:36.079 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-psutil. 2024-03-07T07:28:36.091 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-07T07:28:36.154 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-07T07:28:36.340 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pluggy. 2024-03-07T07:28:36.353 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-07T07:28:36.414 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-07T07:28:36.490 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2024-03-07T07:28:36.502 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-07T07:28:36.540 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-07T07:28:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-psutil. 2024-03-07T07:28:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-07T07:28:36.759 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-07T07:28:36.852 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pygments. 2024-03-07T07:28:36.863 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-07T07:28:36.902 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-07T07:28:37.129 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-py. 2024-03-07T07:28:37.143 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-07T07:28:37.178 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-07T07:28:37.355 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-07T07:28:37.367 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-07T07:28:37.405 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-07T07:28:37.498 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pygments. 2024-03-07T07:28:37.513 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-07T07:28:37.548 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-07T07:28:37.725 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-toml. 2024-03-07T07:28:37.737 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-07T07:28:37.775 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-07T07:28:37.985 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-07T07:28:37.999 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-07T07:28:38.036 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2024-03-07T07:28:38.044 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-07T07:28:38.048 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-07T07:28:38.077 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-07T07:28:38.388 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-toml. 2024-03-07T07:28:38.397 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-07T07:28:38.438 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-07T07:28:38.439 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2024-03-07T07:28:38.452 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-07T07:28:38.489 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-07T07:28:38.724 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pytest. 2024-03-07T07:28:38.744 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-07T07:28:38.774 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-07T07:28:38.792 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-07T07:28:38.804 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-07T07:28:38.841 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-07T07:28:39.419 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplejson. 2024-03-07T07:28:39.433 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-07T07:28:39.477 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-07T07:28:39.487 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2024-03-07T07:28:39.498 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../122-radosgw_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:39.570 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:39.729 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-07T07:28:39.740 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-07T07:28:39.779 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-07T07:28:40.165 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2024-03-07T07:28:40.177 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:40.215 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:40.506 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-07T07:28:40.508 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package radosgw. 2024-03-07T07:28:40.519 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../122-radosgw_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:40.558 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking radosgw (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:40.779 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-07T07:28:40.904 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-07T07:28:41.162 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-07T07:28:41.187 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package rbd-fuse. 2024-03-07T07:28:41.198 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1848-g8b896a9e-1jammy_amd64.deb ... 2024-03-07T07:28:41.228 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking rbd-fuse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:41.518 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-07T07:28:41.528 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-07T07:28:41.783 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-07T07:28:41.950 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-07T07:28:42.132 INFO:teuthology.orchestra.run.smithi161.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-07T07:28:42.175 INFO:teuthology.orchestra.run.smithi161.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-07T07:28:42.209 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-07T07:28:42.307 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:42.617 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-07T07:28:42.809 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2024-03-07T07:28:42.996 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-07T07:28:43.243 INFO:teuthology.orchestra.run.smithi084.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-07T07:28:43.281 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-07T07:28:43.286 INFO:teuthology.orchestra.run.smithi084.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-07T07:28:43.327 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephadm (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:43.524 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-07T07:28:43.633 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-07T07:28:43.892 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-07T07:28:43.920 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user cephadm....done 2024-03-07T07:28:44.083 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-07T07:28:44.160 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-07T07:28:44.286 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-07T07:28:44.368 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-07T07:28:44.619 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-07T07:28:44.655 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-07T07:28:44.720 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-07T07:28:44.962 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-07T07:28:45.023 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-07T07:28:45.231 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-07T07:28:45.291 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-07T07:28:45.381 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-07T07:28:45.559 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-07T07:28:45.691 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-07T07:28:45.843 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-07T07:28:46.060 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-07T07:28:46.128 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-07T07:28:46.311 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-07T07:28:46.496 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-07T07:28:46.571 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-07T07:28:46.764 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-07T07:28:46.855 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-07T07:28:47.015 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:47.148 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-07T07:28:47.274 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-07T07:28:47.400 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-07T07:28:47.408 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-07T07:28:47.551 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-07T07:28:47.784 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-07T07:28:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-07T07:28:47.945 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-07T07:28:48.027 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-argparse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:48.196 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-07T07:28:48.278 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-07T07:28:48.379 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-07T07:28:48.505 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-07T07:28:48.657 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-07T07:28:48.702 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-07T07:28:48.758 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-07T07:28:48.764 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-07T07:28:48.883 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-07T07:28:48.915 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-07T07:28:49.175 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-07T07:28:49.251 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-07T07:28:49.377 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-07T07:28:49.580 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-07T07:28:49.605 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-07T07:28:49.653 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-07T07:28:49.686 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-07T07:28:49.812 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-07T07:28:49.921 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-07T07:28:50.172 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-07T07:28:50.239 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up zip (3.0-12build2) ... 2024-03-07T07:28:50.314 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-07T07:28:50.340 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-07T07:28:50.590 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-07T07:28:50.875 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-07T07:28:51.009 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-07T07:28:51.184 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up zip (3.0-12build2) ... 2024-03-07T07:28:51.285 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-07T07:28:51.285 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-07T07:28:51.412 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-07T07:28:51.528 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-07T07:28:51.829 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-07T07:28:51.954 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-07T07:28:52.247 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-07T07:28:52.250 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-07T07:28:52.381 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-07T07:28:52.500 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-07T07:28:52.507 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-07T07:28:52.824 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-07T07:28:52.885 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-07T07:28:53.178 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-07T07:28:53.218 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-07T07:28:53.452 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-07T07:28:53.487 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-07T07:28:53.828 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-07T07:28:53.838 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-07T07:28:54.090 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-07T07:28:54.131 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-07T07:28:54.199 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:54.542 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-idna (3.3-1) ... 2024-03-07T07:28:54.706 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-07T07:28:54.885 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-07T07:28:55.057 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-07T07:28:55.334 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-07T07:28:55.434 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-common (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:28:55.735 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-idna (3.3-1) ... 2024-03-07T07:28:56.062 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-07T07:28:56.107 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-07T07:28:56.351 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:28:56.485 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-07T07:28:56.778 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-07T07:28:56.904 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-07T07:28:57.030 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-07T07:28:57.276 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-07T07:28:57.315 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-07T07:28:57.511 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:28:57.582 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-07T07:28:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-07T07:28:57.867 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:28:57.921 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-07T07:28:57.993 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-07T07:28:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-07T07:28:58.173 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-07T07:28:58.302 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-07T07:28:58.491 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-07T07:28:58.570 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-07T07:28:58.742 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-07T07:28:58.871 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-07T07:28:58.985 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:28:59.094 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-07T07:28:59.130 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-07T07:28:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-07T07:28:59.420 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-07T07:28:59.650 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-07T07:28:59.697 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-07T07:28:59.784 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-07T07:28:59.973 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-07T07:29:00.077 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-07T07:29:00.195 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-07T07:29:00.257 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-07T07:29:00.479 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-07T07:29:00.517 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-07T07:29:00.768 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-07T07:29:00.771 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-07T07:29:00.910 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-07T07:29:01.039 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-07T07:29:01.190 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-07T07:29:01.195 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-07T07:29:01.321 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-07T07:29:01.324 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-07T07:29:01.413 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-07T07:29:01.614 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-07T07:29:01.660 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-07T07:29:01.786 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-07T07:29:01.923 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-07T07:29:02.162 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-07T07:29:02.191 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-07T07:29:02.292 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-07T07:29:02.393 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-07T07:29:02.439 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-07T07:29:02.465 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-07T07:29:02.564 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-07T07:29:02.712 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-07T07:29:02.824 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:29:02.837 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-07T07:29:02.950 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-07T07:29:03.230 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-07T07:29:03.268 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-07T07:29:03.507 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-07T07:29:03.611 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-07T07:29:03.633 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-07T07:29:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-07T07:29:03.878 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-07T07:29:03.968 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-07T07:29:04.064 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-07T07:29:04.278 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-07T07:29:04.332 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-07T07:29:04.617 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-07T07:29:04.629 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-07T07:29:04.902 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-07T07:29:04.913 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-07T07:29:05.124 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-07T07:29:05.279 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-07T07:29:05.384 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-07T07:29:05.555 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-07T07:29:05.652 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-07T07:29:05.920 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-07T07:29:05.932 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-07T07:29:06.059 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:06.201 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:06.305 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-07T07:29:06.327 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-07T07:29:06.598 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-07T07:29:06.638 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:06.798 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:06.924 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-07T07:29:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-07T07:29:07.093 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librados2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:07.217 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:07.220 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:07.343 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:07.347 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-07T07:29:07.461 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:07.662 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-07T07:29:07.662 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-07T07:29:07.681 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:07.838 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libradosstriper1 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:07.950 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-07T07:29:08.227 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librbd1 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:08.279 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:08.352 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-modules-core (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:08.388 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:08.478 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-fuse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:08.514 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:08.640 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-top (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:08.686 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-07T07:29:08.687 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-07T07:29:08.766 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-07T07:29:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs-dev (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:09.447 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rados (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:09.623 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librgw2 (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:09.758 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-top (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:09.860 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-07T07:29:10.053 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:10.204 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:10.330 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:10.456 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:10.599 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-shell (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:11.104 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rbd (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up rbd-fuse (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:11.269 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2024-03-07T07:29:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rgw (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:11.526 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cephfs (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:11.644 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-shell (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:11.662 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2024-03-07T07:29:11.769 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-common (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:11.832 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2024-03-07T07:29:11.852 INFO:teuthology.orchestra.run.smithi161.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-07T07:29:11.996 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-07T07:29:12.297 INFO:teuthology.orchestra.run.smithi084.stdout:Adding group ceph....done 2024-03-07T07:29:12.372 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-07T07:29:12.632 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user ceph....done 2024-03-07T07:29:12.800 INFO:teuthology.orchestra.run.smithi084.stdout:Setting system user ceph properties....done 2024-03-07T07:29:12.821 INFO:teuthology.orchestra.run.smithi084.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-07T07:29:12.962 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-07T07:29:13.051 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-mirror (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:13.259 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-07T07:29:13.259 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-07T07:29:13.364 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-07T07:29:13.818 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:13.928 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:14.069 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-mirror (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:14.277 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-07T07:29:14.278 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-07T07:29:14.441 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-07T07:29:14.441 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-07T07:29:14.899 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-test (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:15.016 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:15.025 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up radosgw (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:15.561 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-07T07:29:15.561 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-07T07:29:15.651 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-07T07:29:16.207 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-base (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:16.291 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:16.513 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-07T07:29:16.513 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-07T07:29:16.548 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-07T07:29:17.134 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:17.192 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mds (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:17.339 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-07T07:29:17.339 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-07T07:29:17.398 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-07T07:29:17.398 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-07T07:29:17.969 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:17.985 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:18.197 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-07T07:29:18.197 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-07T07:29:18.297 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-07T07:29:18.297 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-07T07:29:18.845 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-osd (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:18.954 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:19.080 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:19.168 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-07T07:29:19.168 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-07T07:29:19.244 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:19.458 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-07T07:29:19.458 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-07T07:29:19.779 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:19.905 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:20.091 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:20.233 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:20.385 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:20.391 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mon (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:20.565 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-volume (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:20.591 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-07T07:29:20.591 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-07T07:29:20.914 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-07T07:29:21.022 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-07T07:29:21.174 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-07T07:29:21.226 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-cephadm (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:21.377 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:21.478 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-dashboard (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:21.620 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-volume (19.0.0-1848-g8b896a9e-1jammy) ... 2024-03-07T07:29:21.989 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-07T07:29:22.107 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-07T07:29:22.250 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-07T07:29:22.259 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-07T07:29:22.973 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-07T07:29:22.978 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-07T07:29:23.052 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-03-07T07:29:23.219 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-03-07T07:29:23.220 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-03-07T07:29:23.351 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-07T07:29:23.374 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-07T07:29:23.375 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-07T07:29:23.375 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-07T07:29:23.375 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-03-07T07:29:23.375 INFO:teuthology.orchestra.run.smithi161.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-07T07:29:23.376 INFO:teuthology.orchestra.run.smithi161.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-07T07:29:23.376 INFO:teuthology.orchestra.run.smithi161.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-07T07:29:23.376 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-07T07:29:23.376 INFO:teuthology.orchestra.run.smithi161.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-07T07:29:23.377 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-03-07T07:29:23.377 INFO:teuthology.orchestra.run.smithi161.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-07T07:29:23.377 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-07T07:29:23.377 INFO:teuthology.orchestra.run.smithi161.stdout: libengine-pkcs11-openssl 2024-03-07T07:29:23.426 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-03-07T07:29:23.426 INFO:teuthology.orchestra.run.smithi161.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-07T07:29:23.426 INFO:teuthology.orchestra.run.smithi161.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-07T07:29:23.427 INFO:teuthology.orchestra.run.smithi161.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-07T07:29:23.427 INFO:teuthology.orchestra.run.smithi161.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-07T07:29:23.427 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-07T07:29:23.427 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-07T07:29:23.427 INFO:teuthology.orchestra.run.smithi161.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-07T07:29:23.428 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2024-03-07T07:29:23.429 INFO:teuthology.orchestra.run.smithi161.stdout: libssl3 2024-03-07T07:29:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:1 upgraded, 39 newly installed, 0 to remove and 277 not upgraded. 2024-03-07T07:29:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 54.6 MB of archives. 2024-03-07T07:29:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-07T07:29:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-07T07:29:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-07T07:29:24.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-07T07:29:24.125 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-03-07T07:29:24.133 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-07T07:29:24.292 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2024-03-07T07:29:24.293 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2024-03-07T07:29:24.391 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-07T07:29:24.428 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-07T07:29:24.428 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-07T07:29:24.432 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-07T07:29:24.436 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-07T07:29:24.436 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-07T07:29:24.440 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-07T07:29:24.442 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-07T07:29:24.442 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-07T07:29:24.446 INFO:teuthology.orchestra.run.smithi084.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-07T07:29:24.446 INFO:teuthology.orchestra.run.smithi084.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-07T07:29:24.446 INFO:teuthology.orchestra.run.smithi084.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-07T07:29:24.446 INFO:teuthology.orchestra.run.smithi084.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-07T07:29:24.446 INFO:teuthology.orchestra.run.smithi084.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-07T07:29:24.446 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2024-03-07T07:29:24.447 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-07T07:29:24.447 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-07T07:29:24.447 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-07T07:29:24.447 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-07T07:29:24.447 INFO:teuthology.orchestra.run.smithi084.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-07T07:29:24.448 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-07T07:29:24.448 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2024-03-07T07:29:24.448 INFO:teuthology.orchestra.run.smithi084.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-07T07:29:24.448 INFO:teuthology.orchestra.run.smithi084.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-07T07:29:24.449 INFO:teuthology.orchestra.run.smithi084.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-07T07:29:24.449 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-07T07:29:24.449 INFO:teuthology.orchestra.run.smithi084.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-07T07:29:24.449 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2024-03-07T07:29:24.449 INFO:teuthology.orchestra.run.smithi084.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-07T07:29:24.450 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-07T07:29:24.450 INFO:teuthology.orchestra.run.smithi084.stdout: libengine-pkcs11-openssl 2024-03-07T07:29:24.499 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2024-03-07T07:29:24.499 INFO:teuthology.orchestra.run.smithi084.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-07T07:29:24.499 INFO:teuthology.orchestra.run.smithi084.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-07T07:29:24.500 INFO:teuthology.orchestra.run.smithi084.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-07T07:29:24.500 INFO:teuthology.orchestra.run.smithi084.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-07T07:29:24.500 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-07T07:29:24.500 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-07T07:29:24.500 INFO:teuthology.orchestra.run.smithi084.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-07T07:29:24.501 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2024-03-07T07:29:24.502 INFO:teuthology.orchestra.run.smithi084.stdout: libssl3 2024-03-07T07:29:24.564 INFO:teuthology.orchestra.run.smithi084.stdout:1 upgraded, 39 newly installed, 0 to remove and 277 not upgraded. 2024-03-07T07:29:24.565 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 54.6 MB of archives. 2024-03-07T07:29:24.565 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-07T07:29:24.565 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-07T07:29:24.607 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-07T07:29:24.693 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-07T07:29:24.761 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-07T07:29:24.772 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-07T07:29:24.773 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-07T07:29:24.775 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-07T07:29:24.777 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-07T07:29:24.777 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-07T07:29:24.778 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-07T07:29:24.779 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-07T07:29:24.779 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-07T07:29:24.784 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-07T07:29:24.801 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-07T07:29:24.945 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-07T07:29:25.106 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-07T07:29:25.108 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-07T07:29:25.109 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-07T07:29:25.112 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-07T07:29:25.113 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-07T07:29:25.117 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-07T07:29:25.119 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-07T07:29:25.127 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-07T07:29:25.127 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-07T07:29:25.158 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-07T07:29:25.172 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-07T07:29:25.186 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-07T07:29:25.217 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-07T07:29:25.223 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-07T07:29:25.223 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-07T07:29:25.224 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-07T07:29:25.224 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-07T07:29:25.284 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-07T07:29:25.286 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-07T07:29:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-07T07:29:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-07T07:29:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-07T07:29:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-07T07:29:25.490 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-07T07:29:25.490 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-07T07:29:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-07T07:29:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-07T07:29:25.878 INFO:teuthology.orchestra.run.smithi084.stdout:Preconfiguring packages ... 2024-03-07T07:29:25.975 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-07T07:29:25.999 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-07T07:29:25.999 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-07T07:29:26.002 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-07T07:29:26.002 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-07T07:29:26.007 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-07T07:29:26.008 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-07T07:29:26.040 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-07T07:29:26.041 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-07T07:29:26.059 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 54.6 MB in 1s (54.8 MB/s) 2024-03-07T07:29:26.235 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package flex. 2024-03-07T07:29:26.256 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-07T07:29:26.307 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140583 files and directories currently installed.) 2024-03-07T07:29:26.310 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-07T07:29:26.338 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-07T07:29:26.367 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-07T07:29:26.823 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-07T07:29:26.878 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-07T07:29:26.954 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-07T07:29:26.965 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-07T07:29:26.966 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-07T07:29:26.967 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-07T07:29:26.968 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-07T07:29:27.002 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-07T07:29:27.006 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-07T07:29:27.056 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-07T07:29:27.469 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-07T07:29:27.480 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-07T07:29:27.644 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-07T07:29:27.727 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-07T07:29:27.727 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-07T07:29:27.809 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-07T07:29:27.817 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-07T07:29:28.165 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package bison. 2024-03-07T07:29:28.233 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140656 files and directories currently installed.) 2024-03-07T07:29:28.237 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-07T07:29:28.275 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-07T07:29:28.285 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-07T07:29:28.287 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-07T07:29:28.675 INFO:teuthology.orchestra.run.smithi161.stdout:Preconfiguring packages ... 2024-03-07T07:29:28.676 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-07T07:29:28.690 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-07T07:29:28.726 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-07T07:29:28.807 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2024-03-07T07:29:28.959 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package flex. 2024-03-07T07:29:29.027 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140583 files and directories currently installed.) 2024-03-07T07:29:29.031 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-07T07:29:29.070 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package dump. 2024-03-07T07:29:29.074 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-07T07:29:29.084 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-07T07:29:29.128 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking dump (0.4b47-3) ... 2024-03-07T07:29:29.423 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package indent. 2024-03-07T07:29:29.437 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:29.481 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-07T07:29:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-07T07:29:29.742 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-07T07:29:29.756 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-07T07:29:29.792 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-07T07:29:29.813 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-07T07:29:30.104 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-07T07:29:30.119 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-07T07:29:30.162 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-07T07:29:30.202 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-07T07:29:30.431 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-07T07:29:30.446 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-07T07:29:30.537 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-07T07:29:30.800 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package bison. 2024-03-07T07:29:30.801 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-07T07:29:30.816 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-07T07:29:30.851 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-07T07:29:30.872 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140656 files and directories currently installed.) 2024-03-07T07:29:30.875 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-07T07:29:30.924 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-07T07:29:31.078 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-07T07:29:31.094 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-07T07:29:31.137 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-07T07:29:31.317 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-07T07:29:31.331 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-07T07:29:31.376 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-07T07:29:31.439 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjson-perl. 2024-03-07T07:29:31.455 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-07T07:29:31.497 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-07T07:29:31.670 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package dump. 2024-03-07T07:29:31.684 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-07T07:29:31.753 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking dump (0.4b47-3) ... 2024-03-07T07:29:31.825 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-07T07:29:31.841 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-07T07:29:31.884 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-07T07:29:32.040 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package indent. 2024-03-07T07:29:32.054 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:32.107 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-07T07:29:32.359 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-07T07:29:32.374 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-07T07:29:32.418 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-07T07:29:32.704 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-07T07:29:32.719 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-07T07:29:32.755 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-07T07:29:33.032 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-07T07:29:33.047 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-07T07:29:33.099 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-07T07:29:33.244 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-07T07:29:33.260 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-07T07:29:33.294 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-07T07:29:33.435 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-07T07:29:33.450 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-07T07:29:33.493 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-07T07:29:33.547 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-07T07:29:33.562 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-07T07:29:33.605 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-07T07:29:33.729 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-07T07:29:33.744 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-07T07:29:33.787 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-07T07:29:33.941 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-07T07:29:33.957 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-07T07:29:34.024 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-07T07:29:34.065 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjson-perl. 2024-03-07T07:29:34.081 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-07T07:29:34.123 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-07T07:29:34.377 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-07T07:29:34.393 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-07T07:29:34.435 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-07T07:29:34.435 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-07T07:29:34.451 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-07T07:29:34.493 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-07T07:29:34.721 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-07T07:29:34.736 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-07T07:29:34.771 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-07T07:29:35.165 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-07T07:29:35.181 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:35.223 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-07T07:29:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:35.643 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-07T07:29:35.837 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-07T07:29:35.853 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-07T07:29:35.955 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-07T07:29:35.970 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-07T07:29:35.985 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:36.020 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-07T07:29:36.216 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-07T07:29:36.222 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-07T07:29:36.232 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-07T07:29:36.237 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-07T07:29:36.272 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-07T07:29:36.274 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-07T07:29:36.627 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-07T07:29:36.643 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-07T07:29:36.685 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-07T07:29:36.817 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-07T07:29:36.832 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-07T07:29:36.876 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-07T07:29:36.996 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-07T07:29:37.011 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-07T07:29:37.054 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-07T07:29:37.186 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package modemmanager. 2024-03-07T07:29:37.202 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-07T07:29:37.236 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-07T07:29:37.374 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-07T07:29:37.389 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-07T07:29:37.440 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-07T07:29:37.810 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-07T07:29:37.825 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:37.868 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:37.875 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package network-manager. 2024-03-07T07:29:37.891 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-07T07:29:37.941 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-07T07:29:38.188 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-07T07:29:38.203 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:38.246 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-07T07:29:38.523 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-07T07:29:38.538 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:38.540 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ppp. 2024-03-07T07:29:38.556 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-07T07:29:38.573 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-07T07:29:38.801 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-07T07:29:38.816 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-07T07:29:38.859 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-07T07:29:38.942 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-07T07:29:39.319 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package pptp-linux. 2024-03-07T07:29:39.334 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-07T07:29:39.379 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-07T07:29:39.386 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-07T07:29:39.394 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-07T07:29:39.437 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-07T07:29:39.663 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-07T07:29:39.678 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-07T07:29:39.722 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-07T07:29:39.782 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package modemmanager. 2024-03-07T07:29:39.797 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-07T07:29:39.840 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-07T07:29:40.117 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-07T07:29:40.132 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-07T07:29:40.183 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client-common (238) ... 2024-03-07T07:29:40.463 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager. 2024-03-07T07:29:40.478 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-07T07:29:40.528 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-07T07:29:40.553 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-07T07:29:40.569 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:40.620 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:41.233 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-common. 2024-03-07T07:29:41.249 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-07T07:29:41.305 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ppp. 2024-03-07T07:29:41.320 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-07T07:29:41.326 INFO:teuthology.orchestra.run.smithi084.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-07T07:29:41.357 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-common (238) ... 2024-03-07T07:29:41.647 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-07T07:29:41.816 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-14. 2024-03-07T07:29:41.832 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:41.875 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:41.969 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pptp-linux. 2024-03-07T07:29:41.983 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-07T07:29:42.026 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-07T07:29:42.279 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-07T07:29:42.293 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-07T07:29:42.354 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-07T07:29:42.632 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-07T07:29:42.646 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-07T07:29:42.690 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-common (238) ... 2024-03-07T07:29:42.994 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-07T07:29:43.009 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:43.052 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:43.092 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql. 2024-03-07T07:29:43.107 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-07T07:29:43.150 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql (14+238) ... 2024-03-07T07:29:43.377 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client. 2024-03-07T07:29:43.392 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-07T07:29:43.435 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client (14+238) ... 2024-03-07T07:29:43.574 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-common. 2024-03-07T07:29:43.588 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-07T07:29:43.649 INFO:teuthology.orchestra.run.smithi161.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-07T07:29:43.672 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-common (238) ... 2024-03-07T07:29:43.696 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-07T07:29:43.710 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-07T07:29:43.755 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-07T07:29:44.023 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package tcl8.6. 2024-03-07T07:29:44.037 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-07T07:29:44.072 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-14. 2024-03-07T07:29:44.073 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-07T07:29:44.087 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:29:44.133 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:44.334 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package tcl. 2024-03-07T07:29:44.348 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-07T07:29:44.396 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-07T07:29:44.787 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package wpasupplicant. 2024-03-07T07:29:44.802 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-07T07:29:44.845 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-07T07:29:45.216 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-07T07:29:45.231 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-07T07:29:45.274 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-07T07:29:45.275 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql. 2024-03-07T07:29:45.291 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-07T07:29:45.334 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql (14+238) ... 2024-03-07T07:29:45.578 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client. 2024-03-07T07:29:45.592 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-07T07:29:45.610 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-07T07:29:45.626 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-07T07:29:45.636 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client (14+238) ... 2024-03-07T07:29:45.669 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-07T07:29:45.888 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-07T07:29:45.903 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-07T07:29:45.938 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-07T07:29:45.953 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client-common (238) ... 2024-03-07T07:29:46.209 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-07T07:29:46.342 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-07T07:29:46.451 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:46.552 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-07T07:29:46.616 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl8.6. 2024-03-07T07:29:46.631 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-07T07:29:46.669 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-07T07:29:46.674 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-07T07:29:46.796 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:46.979 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl. 2024-03-07T07:29:46.995 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-07T07:29:47.041 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-07T07:29:47.365 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package wpasupplicant. 2024-03-07T07:29:47.381 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-07T07:29:47.423 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-07T07:29:47.738 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-07T07:29:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-07T07:29:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-07T07:29:47.834 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-07T07:29:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-07T07:29:48.203 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-07T07:29:48.203 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-07T07:29:48.238 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-07T07:29:48.253 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-07T07:29:48.304 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-07T07:29:48.579 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-common (238) ... 2024-03-07T07:29:48.785 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-07T07:29:48.895 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-07T07:29:48.911 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-07T07:29:49.021 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-07T07:29:49.038 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:49.138 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-07T07:29:49.147 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-07T07:29:49.273 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-07T07:29:49.273 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-07T07:29:49.390 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:49.399 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-07T07:29:49.525 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-07T07:29:49.668 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-07T07:29:50.339 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-07T07:29:50.389 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-07T07:29:50.437 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-07T07:29:50.540 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up dump (0.4b47-3) ... 2024-03-07T07:29:50.635 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-07T07:29:50.700 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-07T07:29:50.799 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-07T07:29:50.800 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-07T07:29:50.809 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-07T07:29:50.918 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-07T07:29:51.036 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-07T07:29:51.154 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-07T07:29:51.243 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-07T07:29:51.305 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-07T07:29:51.448 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-07T07:29:51.515 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-07T07:29:51.632 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-07T07:29:51.641 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-07T07:29:51.742 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-07T07:29:51.758 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-07T07:29:51.859 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-07T07:29:51.876 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-07T07:29:51.994 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-07T07:29:52.120 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-07T07:29:52.246 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-07T07:29:52.452 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client (14+238) ... 2024-03-07T07:29:52.553 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-07T07:29:52.926 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-07T07:29:53.027 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up dump (0.4b47-3) ... 2024-03-07T07:29:53.120 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:29:53.121 INFO:teuthology.orchestra.run.smithi084.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-07T07:29:53.121 INFO:teuthology.orchestra.run.smithi084.stdout:which means they are currently configured by ifupdown: 2024-03-07T07:29:53.121 INFO:teuthology.orchestra.run.smithi084.stdout:- enp3s0f1 2024-03-07T07:29:53.121 INFO:teuthology.orchestra.run.smithi084.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-07T07:29:53.121 INFO:teuthology.orchestra.run.smithi084.stdout:remove their configuration from /etc/network/interfaces. 2024-03-07T07:29:53.121 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:29:53.130 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-07T07:29:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-07T07:29:53.253 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-07T07:29:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-07T07:29:53.447 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-07T07:29:53.573 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-07T07:29:53.640 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-07T07:29:53.715 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-07T07:29:53.830 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-07T07:29:53.900 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-07T07:29:54.026 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-07T07:29:54.063 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-07T07:29:54.178 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-07T07:29:54.304 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-07T07:29:54.429 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-07T07:29:54.598 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client (14+238) ... 2024-03-07T07:29:54.724 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-07T07:29:54.764 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-07T07:29:54.923 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-07T07:29:55.024 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-07T07:29:55.125 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-common (238) ... 2024-03-07T07:29:55.375 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:29:55.376 INFO:teuthology.orchestra.run.smithi161.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-07T07:29:55.376 INFO:teuthology.orchestra.run.smithi161.stdout:which means they are currently configured by ifupdown: 2024-03-07T07:29:55.376 INFO:teuthology.orchestra.run.smithi161.stdout:- enp3s0f1 2024-03-07T07:29:55.376 INFO:teuthology.orchestra.run.smithi161.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-07T07:29:55.376 INFO:teuthology.orchestra.run.smithi161.stdout:remove their configuration from /etc/network/interfaces. 2024-03-07T07:29:55.376 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:29:55.508 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-07T07:29:55.908 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-07T07:29:56.075 INFO:teuthology.orchestra.run.smithi084.stdout:Adding user postgres to group ssl-cert 2024-03-07T07:29:56.327 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-07T07:29:56.327 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:29:56.327 INFO:teuthology.orchestra.run.smithi084.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-07T07:29:56.587 INFO:teuthology.orchestra.run.smithi084.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-07T07:29:56.587 INFO:teuthology.orchestra.run.smithi084.stdout:Removing obsolete dictionary files: 2024-03-07T07:29:57.009 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-07T07:29:57.152 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-07T07:29:57.284 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-07T07:29:57.303 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-07T07:29:57.429 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-common (238) ... 2024-03-07T07:29:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:29:58.267 INFO:teuthology.orchestra.run.smithi084.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-07T07:29:58.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-07T07:29:58.344 INFO:teuthology.orchestra.run.smithi084.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-07T07:29:58.344 INFO:teuthology.orchestra.run.smithi084.stdout:This user must also own the server process. 2024-03-07T07:29:58.344 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:29:58.344 INFO:teuthology.orchestra.run.smithi084.stdout:The database cluster will be initialized with locale "en_US". 2024-03-07T07:29:58.344 INFO:teuthology.orchestra.run.smithi084.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-07T07:29:58.345 INFO:teuthology.orchestra.run.smithi084.stdout:The default text search configuration will be set to "english". 2024-03-07T07:29:58.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:29:58.345 INFO:teuthology.orchestra.run.smithi084.stdout:Data page checksums are disabled. 2024-03-07T07:29:58.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:29:58.345 INFO:teuthology.orchestra.run.smithi084.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-07T07:29:58.345 INFO:teuthology.orchestra.run.smithi084.stdout:creating subdirectories ... ok 2024-03-07T07:29:58.346 INFO:teuthology.orchestra.run.smithi084.stdout:selecting dynamic shared memory implementation ... posix 2024-03-07T07:29:58.368 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default max_connections ... 100 2024-03-07T07:29:58.372 INFO:teuthology.orchestra.run.smithi161.stdout:Adding user postgres to group ssl-cert 2024-03-07T07:29:58.402 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default shared_buffers ... 128MB 2024-03-07T07:29:58.416 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default time zone ... Etc/UTC 2024-03-07T07:29:58.417 INFO:teuthology.orchestra.run.smithi084.stdout:creating configuration files ... ok 2024-03-07T07:29:58.578 INFO:teuthology.orchestra.run.smithi084.stdout:running bootstrap script ... ok 2024-03-07T07:29:58.611 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:29:58.611 INFO:teuthology.orchestra.run.smithi161.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-07T07:29:58.889 INFO:teuthology.orchestra.run.smithi161.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-07T07:29:58.890 INFO:teuthology.orchestra.run.smithi161.stdout:Removing obsolete dictionary files: 2024-03-07T07:29:59.209 INFO:teuthology.orchestra.run.smithi084.stdout:performing post-bootstrap initialization ... ok 2024-03-07T07:29:59.595 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-07T07:29:59.750 INFO:teuthology.orchestra.run.smithi084.stdout:syncing data to disk ... ok 2024-03-07T07:30:00.179 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-07T07:30:00.277 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-07T07:30:00.514 INFO:teuthology.orchestra.run.smithi161.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-07T07:30:00.530 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-07T07:30:00.588 INFO:teuthology.orchestra.run.smithi161.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-07T07:30:00.588 INFO:teuthology.orchestra.run.smithi161.stdout:This user must also own the server process. 2024-03-07T07:30:00.589 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:The database cluster will be initialized with locale "en_US". 2024-03-07T07:30:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-07T07:30:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:The default text search configuration will be set to "english". 2024-03-07T07:30:00.589 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:Data page checksums are disabled. 2024-03-07T07:30:00.589 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-07T07:30:00.590 INFO:teuthology.orchestra.run.smithi161.stdout:creating subdirectories ... ok 2024-03-07T07:30:00.590 INFO:teuthology.orchestra.run.smithi161.stdout:selecting dynamic shared memory implementation ... posix 2024-03-07T07:30:00.613 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default max_connections ... 100 2024-03-07T07:30:00.646 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default shared_buffers ... 128MB 2024-03-07T07:30:00.659 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default time zone ... Etc/UTC 2024-03-07T07:30:00.660 INFO:teuthology.orchestra.run.smithi161.stdout:creating configuration files ... ok 2024-03-07T07:30:00.823 INFO:teuthology.orchestra.run.smithi161.stdout:running bootstrap script ... ok 2024-03-07T07:30:01.440 INFO:teuthology.orchestra.run.smithi161.stdout:performing post-bootstrap initialization ... ok 2024-03-07T07:30:02.010 INFO:teuthology.orchestra.run.smithi161.stdout:syncing data to disk ... ok 2024-03-07T07:30:02.530 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-07T07:30:03.643 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-07T07:30:03.769 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-07T07:30:03.895 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql (14+238) ... 2024-03-07T07:30:04.020 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-07T07:30:04.146 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-07T07:30:04.398 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-07T07:30:04.398 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-07T07:30:05.148 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-07T07:30:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-07T07:30:05.570 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-07T07:30:05.643 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-07T07:30:05.696 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-07T07:30:05.822 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql (14+238) ... 2024-03-07T07:30:05.948 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-07T07:30:06.074 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-07T07:30:06.334 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-07T07:30:06.334 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-07T07:30:07.012 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-07T07:30:07.076 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-07T07:30:07.112 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-07T07:30:07.386 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-07T07:30:07.554 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-07T07:30:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-07T07:30:07.639 DEBUG:teuthology.parallel:result is None 2024-03-07T07:30:08.982 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-07T07:30:09.073 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-07T07:30:09.595 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-07T07:30:09.602 DEBUG:teuthology.parallel:result is None 2024-03-07T07:30:09.603 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T07:30:09.749 DEBUG:teuthology.orchestra.run.smithi084:> dpkg-query -W -f '${Version}' ceph 2024-03-07T07:30:09.773 INFO:teuthology.orchestra.run.smithi084.stdout:19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:30:09.773 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:30:09.774 INFO:teuthology.task.install:The correct ceph version 19.0.0-1848-g8b896a9e-1jammy is installed. 2024-03-07T07:30:09.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T07:30:10.000 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2024-03-07T07:30:10.025 INFO:teuthology.orchestra.run.smithi161.stdout:19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:30:10.025 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1848-g8b896a9e-1jammy 2024-03-07T07:30:10.026 INFO:teuthology.task.install:The correct ceph version 19.0.0-1848-g8b896a9e-1jammy is installed. 2024-03-07T07:30:10.029 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-07T07:30:10.029 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:10.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-07T07:30:10.051 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:10.052 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-07T07:30:10.087 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-07T07:30:10.087 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:10.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-03-07T07:30:10.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-07T07:30:10.179 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:10.179 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-03-07T07:30:10.198 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-07T07:30:10.258 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-07T07:30:10.259 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:10.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-07T07:30:10.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-07T07:30:10.343 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:10.343 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-07T07:30:10.363 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-07T07:30:10.422 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-07T07:30:10.422 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:10.423 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-03-07T07:30:10.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-07T07:30:10.507 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:10.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-03-07T07:30:10.526 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-07T07:30:10.590 INFO:teuthology.run_tasks:Running task ceph... 2024-03-07T07:30:10.679 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-07T07:30:10.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2024-03-07T07:30:10.683 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2024-03-07T07:30:10.701 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-07T07:30:10.701 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-07T07:30:10.750 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-07T07:30:10.769 INFO:tasks.ceph:Creating extra log directories... 2024-03-07T07:30:10.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-07T07:30:10.818 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-07T07:30:10.844 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-07T07:30:10.844 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-07T07:30:10.845 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-07T07:30:10.845 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:10.845 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-07T07:30:10.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-07T07:30:10.984 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:10.984 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-07T07:30:10.992 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-07T07:30:11.087 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-07T07:30:11.088 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-07T07:30:11.088 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970', 'branch': 'wip-lusov-qdb', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/acls}', 'email': None, 'first_in_suite': False, 'job_id': '7583970', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-qdb'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-qdb', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9221, 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0', 'sleep_before_teardown': 0, 'subset': '111/10000', 'suite': 'fs', 'suite_branch': 'wip-lusov-qdb', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8b896a9e145796119f0451201dc4d53ddac97db0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDjGICKhvRDijBnv5tRIjBVpkGl23gDM76uebAyb2PPUrtYDh7ARwqDW5uAzFNt0GfiDMuH/EiiJ0jYIHfaw0oA=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCXGBTrTKe7QVMym/vyxAxzz9JqVjdNSTspfFbFMRZB7Z8V9CzuGMe5DpYnLlA1snmJzSbUjKR3HNzxY3JIAIA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-07_05:46:12', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-07T07:30:11.088 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-07T07:30:11.092 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-07T07:30:11.131 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2024-03-07T07:30:11.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-03-07T07:30:11.190 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:11.190 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-03-07T07:30:11.207 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-07T07:30:11.207 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-03-07T07:30:11.260 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-07T07:30:11.260 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T07:30:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-03-07T07:30:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:30:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-07 07:23:58.202623695 +0000 2024-03-07T07:30:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-07 07:23:57.946625980 +0000 2024-03-07T07:30:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-07 07:23:57.946625980 +0000 2024-03-07T07:30:11.261 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-07 07:23:57.946625980 +0000 2024-03-07T07:30:11.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-07T07:30:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-03-07T07:30:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-03-07T07:30:11.321 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000378748 s, 1.4 MB/s 2024-03-07T07:30:11.323 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-07T07:30:11.373 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-03-07T07:30:11.424 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-07T07:30:11.424 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T07:30:11.424 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-03-07T07:30:11.424 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:30:11.424 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-07 07:23:58.898617481 +0000 2024-03-07T07:30:11.424 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-07 07:23:58.454621445 +0000 2024-03-07T07:30:11.424 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-07 07:23:58.454621445 +0000 2024-03-07T07:30:11.424 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-07 07:23:58.454621445 +0000 2024-03-07T07:30:11.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-07T07:30:11.485 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-03-07T07:30:11.485 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-03-07T07:30:11.485 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000368926 s, 1.4 MB/s 2024-03-07T07:30:11.487 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-07T07:30:11.541 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-03-07T07:30:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-07T07:30:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T07:30:11.592 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-03-07T07:30:11.592 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:30:11.592 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-07 07:23:59.414612874 +0000 2024-03-07T07:30:11.592 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-07 07:23:59.162615124 +0000 2024-03-07T07:30:11.592 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-07 07:23:59.162615124 +0000 2024-03-07T07:30:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-07 07:23:59.162615124 +0000 2024-03-07T07:30:11.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-07T07:30:11.653 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-03-07T07:30:11.653 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-03-07T07:30:11.654 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000391509 s, 1.3 MB/s 2024-03-07T07:30:11.655 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-07T07:30:11.709 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-03-07T07:30:11.759 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-07T07:30:11.760 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T07:30:11.760 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 947 Links: 1 2024-03-07T07:30:11.760 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:30:11.760 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-07 07:23:59.950608084 +0000 2024-03-07T07:30:11.760 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-07 07:23:59.678610515 +0000 2024-03-07T07:30:11.760 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-07 07:23:59.678610515 +0000 2024-03-07T07:30:11.760 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-07 07:23:59.678610515 +0000 2024-03-07T07:30:11.760 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-07T07:30:11.821 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-03-07T07:30:11.821 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-03-07T07:30:11.822 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000389879 s, 1.3 MB/s 2024-03-07T07:30:11.824 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-07T07:30:11.877 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:11.878 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:11.878 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-03-07T07:30:11.887 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-07T07:30:11.887 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-03-07T07:30:11.937 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-07T07:30:11.937 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T07:30:11.937 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-03-07T07:30:11.937 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:30:11.937 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-03-07 07:23:57.966864959 +0000 2024-03-07T07:30:11.937 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-03-07 07:23:57.702867317 +0000 2024-03-07T07:30:11.937 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-03-07 07:23:57.702867317 +0000 2024-03-07T07:30:11.937 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-03-07 07:23:57.702867317 +0000 2024-03-07T07:30:11.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-07T07:30:12.002 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-03-07T07:30:12.002 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-03-07T07:30:12.002 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000674946 s, 759 kB/s 2024-03-07T07:30:12.005 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-07T07:30:12.058 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-03-07T07:30:12.108 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-07T07:30:12.109 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T07:30:12.109 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-03-07T07:30:12.109 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:30:12.109 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-03-07 07:23:58.474860422 +0000 2024-03-07T07:30:12.109 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-03-07 07:23:58.218862708 +0000 2024-03-07T07:30:12.109 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-03-07 07:23:58.218862708 +0000 2024-03-07T07:30:12.109 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-03-07 07:23:58.218862708 +0000 2024-03-07T07:30:12.109 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-07T07:30:12.170 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-03-07T07:30:12.170 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-03-07T07:30:12.170 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000415916 s, 1.2 MB/s 2024-03-07T07:30:12.172 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-07T07:30:12.227 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-03-07T07:30:12.277 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-07T07:30:12.277 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T07:30:12.277 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-03-07T07:30:12.277 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:30:12.277 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-03-07 07:23:58.966856026 +0000 2024-03-07T07:30:12.278 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-03-07 07:23:58.718858241 +0000 2024-03-07T07:30:12.278 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-03-07 07:23:58.718858241 +0000 2024-03-07T07:30:12.278 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-03-07 07:23:58.718858241 +0000 2024-03-07T07:30:12.278 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-07T07:30:12.338 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-03-07T07:30:12.339 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-03-07T07:30:12.339 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000380025 s, 1.3 MB/s 2024-03-07T07:30:12.340 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-07T07:30:12.394 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-03-07T07:30:12.444 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-07T07:30:12.445 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T07:30:12.445 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 948 Links: 1 2024-03-07T07:30:12.445 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:30:12.445 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-03-07 07:23:59.474851489 +0000 2024-03-07T07:30:12.445 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-03-07 07:23:59.218853776 +0000 2024-03-07T07:30:12.445 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-03-07 07:23:59.218853776 +0000 2024-03-07T07:30:12.445 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-03-07 07:23:59.218853776 +0000 2024-03-07T07:30:12.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-07T07:30:12.506 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-03-07T07:30:12.506 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-03-07T07:30:12.506 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000392564 s, 1.3 MB/s 2024-03-07T07:30:12.508 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-07T07:30:12.562 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:12.562 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-07T07:30:12.562 INFO:tasks.ceph:Generating config... 2024-03-07T07:30:12.564 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-07T07:30:12.564 INFO:tasks.ceph:[client] debug client = 20 2024-03-07T07:30:12.564 INFO:tasks.ceph:[client] debug ms = 1 2024-03-07T07:30:12.564 INFO:tasks.ceph:[client] pid file = 2024-03-07T07:30:12.564 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-07T07:30:12.564 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-07T07:30:12.564 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-07T07:30:12.564 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-07T07:30:12.564 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-07T07:30:12.565 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-07T07:30:12.566 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-07T07:30:12.567 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-07T07:30:12.567 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-07T07:30:12.567 INFO:tasks.ceph:Setting up mon.a... 2024-03-07T07:30:12.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-07T07:30:12.612 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2024-03-07T07:30:12.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-07T07:30:12.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-07T07:30:12.741 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.161'), ('mon.c', '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]')] 2024-03-07T07:30:12.742 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-07T07:30:12.743 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:12.743 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-07T07:30:12.791 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.161 --addv c '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:12.876 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:12.876 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 9dc7a008-fd12-4491-ba8d-83bae22f3106 2024-03-07T07:30:12.876 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = quincy 2024-03-07T07:30:12.876 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2024-03-07T07:30:12.876 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 9dc7a008-fd12-4491-ba8d-83bae22f3106 2024-03-07T07:30:12.876 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2024-03-07T07:30:12.878892+0000 2024-03-07T07:30:12.877 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-03-07T07:30:12.878892+0000 2024-03-07T07:30:12.877 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 17 (quincy) 2024-03-07T07:30:12.877 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2024-03-07T07:30:12.877 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-03-07T07:30:12.877 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2024-03-07T07:30:12.877 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] mon.c 2024-03-07T07:30:12.877 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-07T07:30:12.879 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-07T07:30:12.887 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9dc7a008-fd12-4491-ba8d-83bae22f3106... 2024-03-07T07:30:12.888 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-07T07:30:12.934 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-07T07:30:12.972 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-03-07T07:30:12.972 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2024-03-07T07:30:12.972 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-07T07:30:12.972 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2024-03-07T07:30:12.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-07T07:30:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 9dc7a008-fd12-4491-ba8d-83bae22f3106 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.975 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug trim objects = true 2024-03-07T07:30:12.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2024-03-07T07:30:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: bdev async discard = True 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: bdev enable discard = True 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore allocator = bitmap 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 1/20 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 1/20 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 4/10 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2024-03-07T07:30:12.978 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2024-03-07T07:30:12.979 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2024-03-07T07:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-07T07:30:12.981 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds balancer = 20 2024-03-07T07:30:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-03-07T07:30:12.983 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2024-03-07T07:30:12.983 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2024-03-07T07:30:12.983 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2024-03-07T07:30:12.983 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2024-03-07T07:30:12.983 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2024-03-07T07:30:12.983 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2024-03-07T07:30:12.983 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2024-03-07T07:30:12.983 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-03-07T07:30:12.984 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-03-07T07:30:12.985 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-03-07T07:30:12.986 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.84,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on skipped message = False 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 9dc7a008-fd12-4491-ba8d-83bae22f3106 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.987 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug trim objects = true 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-03-07T07:30:12.988 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2024-03-07T07:30:12.989 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-03-07T07:30:12.990 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-03-07T07:30:12.991 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-03-07T07:30:12.992 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = "" 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-03-07T07:30:12.993 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2024-03-07T07:30:12.994 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2024-03-07T07:30:12.995 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-03-07T07:30:12.995 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-03-07T07:30:12.995 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-03-07T07:30:12.996 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-07T07:30:12.996 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-07T07:30:13.096 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-07T07:30:13.097 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:13.097 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-07T07:30:13.105 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:13.105 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-07T07:30:13.155 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:30:13.155 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:13.155 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-07T07:30:13.155 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-07T07:30:13.226 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:13.226 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:13.275 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:30:13.275 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:13.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-07T07:30:13.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-07T07:30:13.310 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:13.310 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:13.360 INFO:tasks.ceph:Setting up mon nodes... 2024-03-07T07:30:13.360 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-07T07:30:13.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-07T07:30:13.413 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-07T07:30:13.418 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-07T07:30:13.477 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-07T07:30:13.501 INFO:tasks.ceph:Setting up mds nodes... 2024-03-07T07:30:13.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-07T07:30:13.554 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-07T07:30:13.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-07T07:30:13.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-07T07:30:13.672 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-07T07:30:13.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-07T07:30:13.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-07T07:30:13.755 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-07T07:30:13.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-07T07:30:13.781 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-07T07:30:13.878 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-07T07:30:13.882 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-07T07:30:13.902 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-07T07:30:13.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-07T07:30:13.943 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-07T07:30:13.960 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-07T07:30:14.043 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-07T07:30:14.059 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-07T07:30:14.102 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-07T07:30:14.118 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-07T07:30:14.201 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-07T07:30:14.217 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-07T07:30:14.217 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-07T07:30:14.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-07T07:30:14.236 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:14.236 INFO:tasks.ceph:role: osd.0 2024-03-07T07:30:14.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:30:14.236 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-07T07:30:14.308 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T07:30:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T07:30:14.756 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-03-07T07:30:14.759 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-03-07T07:30:14.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-07T07:30:14.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-07T07:30:14.884 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-03-07T07:30:14.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:30:14.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-07T07:30:14.951 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:14.951 INFO:tasks.ceph:role: osd.1 2024-03-07T07:30:14.951 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:30:14.952 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-07T07:30:15.022 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T07:30:15.022 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T07:30:15.022 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T07:30:15.022 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-07T07:30:15.022 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T07:30:15.023 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-03-07T07:30:15.023 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T07:30:15.023 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-07T07:30:15.023 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T07:30:15.023 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T07:30:15.488 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-03-07T07:30:15.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-03-07T07:30:15.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-07T07:30:15.630 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-07T07:30:15.647 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-03-07T07:30:15.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:30:15.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-07T07:30:15.711 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:15.712 INFO:tasks.ceph:role: osd.2 2024-03-07T07:30:15.712 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:30:15.712 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-07T07:30:15.787 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T07:30:15.788 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T07:30:16.265 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-03-07T07:30:16.268 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-03-07T07:30:16.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-07T07:30:16.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-07T07:30:16.441 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-03-07T07:30:16.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:30:16.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-07T07:30:16.503 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:16.503 INFO:tasks.ceph:role: osd.3 2024-03-07T07:30:16.503 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:30:16.504 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-07T07:30:16.575 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T07:30:16.575 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T07:30:16.575 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T07:30:16.575 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-07T07:30:16.575 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T07:30:16.575 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-03-07T07:30:16.575 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T07:30:16.576 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-07T07:30:16.576 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T07:30:16.576 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T07:30:16.998 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-03-07T07:30:17.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-03-07T07:30:17.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-07T07:30:17.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-07T07:30:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-03-07T07:30:17.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:30:17.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:17.256+0000 7f19812a27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-07T07:30:17.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:17.260+0000 7f19812a27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-07T07:30:17.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:17.260+0000 7f19812a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-07T07:30:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:17.260+0000 7f19812a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-07T07:30:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:17.260+0000 7f19812a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-07T07:30:17.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:17.264+0000 7f19812a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-07T07:30:20.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-07T07:30:20.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:20.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:20.344+0000 7f02ea4047c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-07T07:30:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:20.344+0000 7f02ea4047c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-07T07:30:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:20.344+0000 7f02ea4047c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-07T07:30:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:20.344+0000 7f02ea4047c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-07T07:30:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:20.344+0000 7f02ea4047c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-07T07:30:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:20.344+0000 7f02ea4047c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-07T07:30:23.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-07T07:30:23.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:23.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:23.444+0000 7f95129507c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-07T07:30:23.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:23.444+0000 7f95129507c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-07T07:30:23.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:23.444+0000 7f95129507c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-07T07:30:23.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:23.444+0000 7f95129507c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-07T07:30:23.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:23.444+0000 7f95129507c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-07T07:30:23.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:23.448+0000 7f95129507c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-07T07:30:26.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-07T07:30:26.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:26.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:26.552+0000 7f45b745b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-07T07:30:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:26.552+0000 7f45b745b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-07T07:30:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:26.552+0000 7f45b745b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-07T07:30:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:26.552+0000 7f45b745b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-07T07:30:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:26.552+0000 7f45b745b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-07T07:30:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:26.556+0000 7f45b745b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-07T07:30:29.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-07T07:30:29.553 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-07T07:30:29.576 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:29.576 INFO:tasks.ceph:role: osd.4 2024-03-07T07:30:29.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:30:29.576 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-07T07:30:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T07:30:29.648 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T07:30:29.649 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T07:30:29.649 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-07T07:30:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T07:30:29.649 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-03-07T07:30:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T07:30:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-07T07:30:29.649 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T07:30:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T07:30:30.103 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-03-07T07:30:30.106 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-03-07T07:30:30.106 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-07T07:30:30.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-07T07:30:30.225 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-03-07T07:30:30.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:30:30.226 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-07T07:30:30.287 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:30.287 INFO:tasks.ceph:role: osd.5 2024-03-07T07:30:30.287 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:30:30.287 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-07T07:30:30.356 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T07:30:30.356 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T07:30:30.357 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T07:30:30.357 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-07T07:30:30.357 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T07:30:30.357 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-03-07T07:30:30.357 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T07:30:30.357 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-07T07:30:30.357 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T07:30:30.357 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T07:30:30.842 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-03-07T07:30:30.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-03-07T07:30:30.845 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-07T07:30:31.002 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-07T07:30:31.020 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-03-07T07:30:31.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:30:31.021 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-07T07:30:31.083 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:31.084 INFO:tasks.ceph:role: osd.6 2024-03-07T07:30:31.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:30:31.084 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-07T07:30:31.155 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T07:30:31.155 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T07:30:31.155 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T07:30:31.155 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-07T07:30:31.155 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T07:30:31.155 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-03-07T07:30:31.155 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T07:30:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-07T07:30:31.156 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T07:30:31.156 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T07:30:31.629 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-03-07T07:30:31.631 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-03-07T07:30:31.632 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-07T07:30:31.782 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-07T07:30:31.799 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-03-07T07:30:31.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:30:31.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-07T07:30:31.865 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T07:30:31.865 INFO:tasks.ceph:role: osd.7 2024-03-07T07:30:31.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:30:31.865 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-07T07:30:31.940 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T07:30:32.133 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T07:30:32.133 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T07:30:32.133 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-07T07:30:32.133 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T07:30:32.133 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-03-07T07:30:32.133 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T07:30:32.133 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-07T07:30:32.133 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T07:30:32.134 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T07:30:32.395 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-03-07T07:30:32.398 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-03-07T07:30:32.398 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-07T07:30:32.488 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-07T07:30:32.505 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-03-07T07:30:32.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:30:32.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:32.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:32.639+0000 7efe877827c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-07T07:30:32.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:32.643+0000 7efe877827c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-07T07:30:32.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:32.643+0000 7efe877827c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-07T07:30:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:32.643+0000 7efe877827c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-07T07:30:32.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:32.643+0000 7efe877827c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-07T07:30:32.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:32.647+0000 7efe877827c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-07T07:30:35.619 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-07T07:30:35.640 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:35.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:35.735+0000 7ff77ef3c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-07T07:30:35.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:35.735+0000 7ff77ef3c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-07T07:30:35.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:35.735+0000 7ff77ef3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-07T07:30:35.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:35.735+0000 7ff77ef3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-07T07:30:35.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:35.735+0000 7ff77ef3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-07T07:30:35.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:35.739+0000 7ff77ef3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-07T07:30:38.710 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-07T07:30:38.732 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:38.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:38.831+0000 7f90a553c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-07T07:30:38.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:38.831+0000 7f90a553c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-07T07:30:38.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:38.831+0000 7f90a553c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-07T07:30:38.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:38.831+0000 7f90a553c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-07T07:30:38.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:38.831+0000 7f90a553c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-07T07:30:38.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:38.835+0000 7f90a553c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-07T07:30:41.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:30:41.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:30:41.822 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-07T07:30:41.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:41.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:41.935+0000 7f9671c2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-07T07:30:41.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:41.935+0000 7f9671c2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-07T07:30:41.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:41.935+0000 7f9671c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-07T07:30:41.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:41.935+0000 7f9671c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-07T07:30:41.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:41.935+0000 7f9671c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-07T07:30:41.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:41.939+0000 7f9671c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-07T07:30:44.914 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-07T07:30:44.934 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-07T07:30:44.934 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:44.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-07T07:30:44.957 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:44.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-07T07:30:45.019 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:45.020 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-07T07:30:45.083 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:45.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-07T07:30:45.147 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:45.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-07T07:30:45.211 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:45.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-07T07:30:45.275 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:45.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-07T07:30:45.339 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.339 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-07T07:30:45.361 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-07T07:30:45.424 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.424 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-07T07:30:45.491 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-07T07:30:45.556 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.556 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-07T07:30:45.619 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.620 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-07T07:30:45.687 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.687 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-07T07:30:45.751 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:45.751 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-07T07:30:45.761 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:45.761 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-07T07:30:45.811 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.812 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-07T07:30:45.820 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:45.821 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-07T07:30:45.871 INFO:tasks.ceph:Adding keys to all mons... 2024-03-07T07:30:45.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-07T07:30:45.875 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-07T07:30:45.919 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2024-03-07T07:30:45.919 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbell2VPNGBAA+AetKp6m6DrLumQdIwjK/w== 2024-03-07T07:30:45.919 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbell6To0IRAAChisIQQE5JT+rNEcdE3/ig== 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbellkuxCKBAAWixrH+Za1dcFNe37Fqrq0g== 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAJbellacaIDxAAYDl3wXcovkd5lcu9RxsVPQ== 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAMbellJFOtFBAA36VhuWzCb1E86F1PTGhrkQ== 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAPbellreHGGhAANQqk/azqNoIYstSgVWzA4Q== 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQASbellr3swIRAAUzKYTs38ZFLlSx+CKKcyKQ== 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbellgM6pHBAAEahL88xcFba3qhDLk2AELg== 2024-03-07T07:30:45.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbelln6lELRAALMUJSsEN+yK9EoJy7VahFw== 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbellHeORNBAA2JBt8e8ubFbHqlZxREqjZw== 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAYbellbaBEJhAAKVM13Oe9d7zkyqdxh+yVGQ== 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAbbellwFMELBAASpZ5dJUU7hf2WjknWGUa+Q== 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAebellsG6vMRAAhJk8YjL24PDJ7j6T0WwssQ== 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAhbelliXDwNxAAtU1tGZFKb+9ZpzKgBfqL+Q== 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-03-07T07:30:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbellW6BnOBAAntECnVfbCrv87gpYUuAGtw== 2024-03-07T07:30:45.922 INFO:teuthology.orchestra.run.smithi084.stdout:[client.2] 2024-03-07T07:30:45.922 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAGbell6f3BAhAAil9x99pkySEoqZlAV2gJEQ== 2024-03-07T07:30:45.922 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2024-03-07T07:30:45.922 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAGbellWYJNBhAAI8LLeTLMhlRk4766XNjY9g== 2024-03-07T07:30:45.922 INFO:teuthology.orchestra.run.smithi084.stdout:[client.3] 2024-03-07T07:30:45.922 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAGbelleF85DBAAJ/7i3qCpRmcl8I0levTDzA== 2024-03-07T07:30:45.933 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2024-03-07T07:30:45.933 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAFbell2VPNGBAA+AetKp6m6DrLumQdIwjK/w== 2024-03-07T07:30:45.933 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-03-07T07:30:45.933 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAFbell6To0IRAAChisIQQE5JT+rNEcdE3/ig== 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAFbellkuxCKBAAWixrH+Za1dcFNe37Fqrq0g== 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAJbellacaIDxAAYDl3wXcovkd5lcu9RxsVPQ== 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAMbellJFOtFBAA36VhuWzCb1E86F1PTGhrkQ== 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAPbellreHGGhAANQqk/azqNoIYstSgVWzA4Q== 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQASbellr3swIRAAUzKYTs38ZFLlSx+CKKcyKQ== 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAFbellgM6pHBAAEahL88xcFba3qhDLk2AELg== 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAFbelln6lELRAALMUJSsEN+yK9EoJy7VahFw== 2024-03-07T07:30:45.934 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAFbellHeORNBAA2JBt8e8ubFbHqlZxREqjZw== 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAYbellbaBEJhAAKVM13Oe9d7zkyqdxh+yVGQ== 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAbbellwFMELBAASpZ5dJUU7hf2WjknWGUa+Q== 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAebellsG6vMRAAhJk8YjL24PDJ7j6T0WwssQ== 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAhbelliXDwNxAAtU1tGZFKb+9ZpzKgBfqL+Q== 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAFbellW6BnOBAAntECnVfbCrv87gpYUuAGtw== 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout:[client.2] 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAGbell6f3BAhAAil9x99pkySEoqZlAV2gJEQ== 2024-03-07T07:30:45.935 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2024-03-07T07:30:45.936 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAGbellWYJNBhAAI8LLeTLMhlRk4766XNjY9g== 2024-03-07T07:30:45.936 INFO:teuthology.orchestra.run.smithi161.stdout:[client.3] 2024-03-07T07:30:45.936 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAGbelleF85DBAAJ/7i3qCpRmcl8I0levTDzA== 2024-03-07T07:30:45.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-07T07:30:45.970 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-07T07:30:46.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T07:30:46.040 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T07:30:46.097 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T07:30:46.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T07:30:46.157 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.215 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.269 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.324 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.327 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.380 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-07T07:30:46.383 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-07T07:30:46.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T07:30:46.439 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T07:30:46.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T07:30:46.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T07:30:46.553 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.557 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.613 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.666 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T07:30:46.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T07:30:46.782 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T07:30:46.838 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T07:30:46.841 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T07:30:46.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T07:30:46.902 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T07:30:46.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T07:30:46.962 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T07:30:47.019 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-07T07:30:47.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-07T07:30:47.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-07T07:30:47.143 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-07T07:30:47.162 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-07T07:30:47.181 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-07T07:30:47.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-07T07:30:47.308 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-07T07:30:47.370 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-07T07:30:47.478 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-07T07:30:47.498 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:47.501 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-07T07:30:47.550 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-07T07:30:47.551 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-07T07:30:47.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-07T07:30:47.554 INFO:tasks.ceph.mon.a:Started 2024-03-07T07:30:47.554 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-07T07:30:47.554 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-07T07:30:47.594 INFO:tasks.ceph.mon.b:Started 2024-03-07T07:30:47.594 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-07T07:30:47.594 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-07T07:30:47.598 INFO:tasks.ceph.mon.c:Started 2024-03-07T07:30:47.598 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-07T07:30:47.598 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-07T07:30:47.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-07T07:30:47.602 INFO:tasks.ceph.mgr.y:Started 2024-03-07T07:30:47.602 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-07T07:30:47.602 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-07T07:30:47.605 INFO:tasks.ceph.mgr.x:Started 2024-03-07T07:30:47.605 INFO:tasks.ceph:Setting crush tunables to default 2024-03-07T07:30:47.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2024-03-07T07:30:47.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bf2e00640 1 Processor -- start 2024-03-07T07:30:47.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bf2e00640 1 -- start start 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bf2e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 0x7f6bec072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bf2e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 0x7f6bec06e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bf2e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec0ad0e0 con 0x7f6bec06e750 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bf2e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0ad3e0 con 0x7f6bec143a60 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bf2e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec072a50 con 0x7f6bec143f60 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bebe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 0x7f6bec072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bebe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 0x7f6bec072510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47954/0 (socket says 172.21.15.84:47954) 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bebe00640 1 -- 172.21.15.84:0/2041915717 learned_addr learned my addr 172.21.15.84:0/2041915717 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:30:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6be3400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 0x7f6bec06e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bebe00640 1 -- 172.21.15.84:0/2041915717 >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 msgr2=0x7f6bec072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-07T07:30:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bebe00640 1 -- 172.21.15.84:0/2041915717 >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 msgr2=0x7f6bec072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-07T07:30:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bebe00640 1 --2- 172.21.15.84:0/2041915717 >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 0x7f6bec072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-07T07:30:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6bebe00640 1 --2- 172.21.15.84:0/2041915717 >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 0x7f6bec072510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-07T07:30:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6be3400640 1 -- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 msgr2=0x7f6bec06e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-07T07:30:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6be3400640 1 -- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 msgr2=0x7f6bec06e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-07T07:30:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6be3400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 0x7f6bec06e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-07T07:30:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.744+0000 7f6be3400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 0x7f6bec06e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-07T07:30:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.888+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663209319 0 0) 0x7f6bec0ad0e0 con 0x7f6bec06e750 2024-03-07T07:30:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.888+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd0003530 con 0x7f6bec06e750 2024-03-07T07:30:47.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.892+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3308461881 0 0) 0x7f6bd0003530 con 0x7f6bec06e750 2024-03-07T07:30:47.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 msgr2=0x7f6bec06e210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-07T07:30:47.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 0x7f6bec06e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 msgr2=0x7f6bec072510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-07T07:30:47.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 --2- 172.21.15.84:0/2041915717 >> v2:172.21.15.84:3300/0 conn(0x7f6bec143a60 0x7f6bec072510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec072d10 con 0x7f6bec06e750 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f6be4001a00 con 0x7f6bec06e750 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 >> v1:172.21.15.161:6789/0 conn(0x7f6bec06e750 legacy=0x7f6bec0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 0x7f6bd00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bd0004040 0x7f6bd0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0004d50 0x7f6bd00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0ad3e0 con 0x7f6bd0004040 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec072a50 con 0x7f6bd0004d50 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd000bb30 con 0x7f6bec143f60 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6be3400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bd0004040 0x7f6bd0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6bebe00640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 0x7f6bd00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6bf0e00640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0004d50 0x7f6bd00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6be3400640 1 -- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 msgr2=0x7f6bd00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6be3400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bec143f60 0x7f6bd00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6be3400640 1 -- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0004d50 msgr2=0x7f6bd00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:47.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6be3400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd0004d50 0x7f6bd00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.896+0000 7f6be3400640 1 -- 172.21.15.84:0/2041915717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0003530 con 0x7f6bd0004040 2024-03-07T07:30:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6be3400640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bd0004040 0x7f6bd0004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c820 tx=0x7f6bd401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3590a5b0823794 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400f040 con 0x7f6bd0004040 2024-03-07T07:30:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd40a9620 con 0x7f6bd0004040 2024-03-07T07:30:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6beb400640 1 -- 172.21.15.84:0/2041915717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40a9a10 con 0x7f6bd0004040 2024-03-07T07:30:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6bf2e00640 1 -- 172.21.15.84:0/2041915717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bd0004040 msgr2=0x7f6bd0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6bf2e00640 1 --2- 172.21.15.84:0/2041915717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bd0004040 0x7f6bd0004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c820 tx=0x7f6bd401c510 comp rx=0 tx=0).stop 2024-03-07T07:30:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6bf0e00640 1 -- 172.21.15.84:0/2041915717 reap_dead start 2024-03-07T07:30:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6bf2e00640 1 -- 172.21.15.84:0/2041915717 shutdown_connections 2024-03-07T07:30:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6bf2e00640 1 -- 172.21.15.84:0/2041915717 >> 172.21.15.84:0/2041915717 conn(0x7f6bec0b18c0 msgr2=0x7f6bec0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6bf2e00640 1 -- 172.21.15.84:0/2041915717 shutdown_connections 2024-03-07T07:30:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.900+0000 7f6bf2e00640 1 -- 172.21.15.84:0/2041915717 wait complete. 2024-03-07T07:30:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 Processor -- start 2024-03-07T07:30:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 -- start start 2024-03-07T07:30:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd0004040 0x7f6bec0b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec1f49a0 0x7f6bec1f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bec13ff50 0x7f6bec1403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0ae880 con 0x7f6bec1f49a0 2024-03-07T07:30:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0732d0 con 0x7f6bec13ff50 2024-03-07T07:30:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0aea00 con 0x7f6bd0004040 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bebe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd0004040 0x7f6bec0b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec1f49a0 0x7f6bec1f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bebe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd0004040 0x7f6bec0b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:35246/0 (socket says 172.21.15.84:35246) 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bebe00640 1 -- 172.21.15.84:0/1514524347 learned_addr learned my addr 172.21.15.84:0/1514524347 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf0e00640 1 --2- 172.21.15.84:0/1514524347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bec13ff50 0x7f6bec1403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be3400640 1 -- 172.21.15.84:0/1514524347 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd0004040 msgr2=0x7f6bec0b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be3400640 1 --2- 172.21.15.84:0/1514524347 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd0004040 0x7f6bec0b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be3400640 1 -- 172.21.15.84:0/1514524347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bec13ff50 msgr2=0x7f6bec1403d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be3400640 1 --2- 172.21.15.84:0/1514524347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bec13ff50 0x7f6bec1403d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be3400640 1 -- 172.21.15.84:0/1514524347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec140910 con 0x7f6bec1f49a0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be3400640 1 --2- 172.21.15.84:0/1514524347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec1f49a0 0x7f6bec1f4e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40aa000 tx=0x7f6bd40192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be8c00640 1 -- 172.21.15.84:0/1514524347 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40c1070 con 0x7f6bec1f49a0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be8c00640 1 -- 172.21.15.84:0/1514524347 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd40a9e20 con 0x7f6bec1f49a0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec1f5510 con 0x7f6bec1f49a0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be8c00640 1 -- 172.21.15.84:0/1514524347 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40bc630 con 0x7f6bec1f49a0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec0c4bd0 con 0x7f6bec1f49a0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be8c00640 1 -- 172.21.15.84:0/1514524347 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6bd40c4070 con 0x7f6bec1f49a0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6be8c00640 1 -- 172.21.15.84:0/1514524347 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6bd40c67d0 con 0x7f6bec1f49a0 2024-03-07T07:30:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.904+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec062d40 con 0x7f6bec1f49a0 2024-03-07T07:30:47.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.932+0000 7f6be8c00640 1 -- 172.21.15.84:0/1514524347 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6bd40cb070 con 0x7f6bec1f49a0 2024-03-07T07:30:47.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.992+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6bec0682a0 con 0x7f6bec1f49a0 2024-03-07T07:30:47.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6be8c00640 1 -- 172.21.15.84:0/1514524347 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6bd40ad020 con 0x7f6bec1f49a0 2024-03-07T07:30:47.996 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-03-07T07:30:47.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec1f49a0 msgr2=0x7f6bec1f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:47.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 --2- 172.21.15.84:0/1514524347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec1f49a0 0x7f6bec1f4e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40aa000 tx=0x7f6bd40192b0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 shutdown_connections 2024-03-07T07:30:47.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 --2- 172.21.15.84:0/1514524347 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bec13ff50 0x7f6bec1403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 --2- 172.21.15.84:0/1514524347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec1f49a0 0x7f6bec1f4e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 --2- 172.21.15.84:0/1514524347 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd0004040 0x7f6bec0b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:47.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 >> 172.21.15.84:0/1514524347 conn(0x7f6bec0b18c0 msgr2=0x7f6bec1e2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:47.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 shutdown_connections 2024-03-07T07:30:47.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:47.996+0000 7f6bf2e00640 1 -- 172.21.15.84:0/1514524347 wait complete. 2024-03-07T07:30:48.018 INFO:tasks.ceph:check_enable_crimson: False 2024-03-07T07:30:48.018 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-07T07:30:48.018 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:48.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-07T07:30:48.037 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:48.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-07T07:30:48.102 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:48.102 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-07T07:30:48.137 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:48.136+0000 7f32d5e2f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-07T07:30:48.138 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:48.139+0000 7f49f8ad3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-07T07:30:48.155 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:30:48.155 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-07T07:30:48.218 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:48.218 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-07T07:30:48.237 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:48.238 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-07T07:30:48.298 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:48.299 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-07T07:30:48.358 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:30:48.358 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-07T07:30:48.418 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new a241edfa-aa77-4f17-8c03-abda9be7e112 0 2024-03-07T07:30:48.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc01d200640 1 Processor -- start 2024-03-07T07:30:48.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc01d200640 1 -- start start 2024-03-07T07:30:48.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc01d200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc01815be20 0x7fc0180cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc01d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0180cfd80 0x7fc0180d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc01d200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0180ccbe0 con 0x7fc01815fb00 2024-03-07T07:30:48.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc01d200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0180ce030 con 0x7fc01815be20 2024-03-07T07:30:48.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc01d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180d06d0 con 0x7fc0180cfd80 2024-03-07T07:30:48.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc015e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc01815be20 0x7fc0180cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc016800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0180cfd80 0x7fc0180d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc015400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc01815fb00 0x7fc01809a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:53960/0 (socket says 172.21.15.161:53960) 2024-03-07T07:30:48.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.599+0000 7fc015400640 1 -- 172.21.15.161:0/3433023302 learned_addr learned my addr 172.21.15.161:0/3433023302 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-03-07T07:30:48.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc016800640 1 -- 172.21.15.161:0/3433023302 >> v2:172.21.15.161:3300/0 conn(0x7fc01815be20 msgr2=0x7fc0180cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:48.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc016800640 1 --2- 172.21.15.161:0/3433023302 >> v2:172.21.15.161:3300/0 conn(0x7fc01815be20 0x7fc0180cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc014a00640 1 -- 172.21.15.161:0/3433023302 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747186141 0 0) 0x7fc004001120 con 0x7fc01815fb00 2024-03-07T07:30:48.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc016800640 1 -- 172.21.15.161:0/3433023302 >> v1:172.21.15.161:6789/0 conn(0x7fc01815fb00 legacy=0x7fc01809a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc016800640 1 -- 172.21.15.161:0/3433023302 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01809b2e0 con 0x7fc0180cfd80 2024-03-07T07:30:48.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc016800640 1 --2- 172.21.15.161:0/3433023302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0180cfd80 0x7fc0180d0190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc010009d90 tx=0x7fc01001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb3454c46487f5f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:48.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc014a00640 1 -- 172.21.15.161:0/3433023302 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100b4070 con 0x7fc0180cfd80 2024-03-07T07:30:48.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc014a00640 1 -- 172.21.15.161:0/3433023302 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0100af600 con 0x7fc0180cfd80 2024-03-07T07:30:48.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.603+0000 7fc014a00640 1 -- 172.21.15.161:0/3433023302 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100af9d0 con 0x7fc0180cfd80 2024-03-07T07:30:48.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- 172.21.15.161:0/3433023302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0180cfd80 msgr2=0x7fc0180d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 --2- 172.21.15.161:0/3433023302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0180cfd80 0x7fc0180d0190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc010009d90 tx=0x7fc01001f150 comp rx=0 tx=0).stop 2024-03-07T07:30:48.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- 172.21.15.161:0/3433023302 shutdown_connections 2024-03-07T07:30:48.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 --2- 172.21.15.161:0/3433023302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0180cfd80 0x7fc0180d0190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 --2- 172.21.15.161:0/3433023302 >> v2:172.21.15.161:3300/0 conn(0x7fc01815be20 0x7fc0180cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- 172.21.15.161:0/3433023302 >> 172.21.15.161:0/3433023302 conn(0x7fc0180d1fa0 msgr2=0x7fc0180d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:48.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- 172.21.15.161:0/3433023302 shutdown_connections 2024-03-07T07:30:48.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- 172.21.15.161:0/3433023302 wait complete. 2024-03-07T07:30:48.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 Processor -- start 2024-03-07T07:30:48.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- start start 2024-03-07T07:30:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0180cfd80 0x7fc01815cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc01815be20 0x7fc0181422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc01815fb00 0x7fc018142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180ce280 con 0x7fc01815be20 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01809b8a0 con 0x7fc0180cfd80 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc01d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01815c200 con 0x7fc01815fb00 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0180cfd80 0x7fc01815cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0180cfd80 0x7fc01815cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58594/0 (socket says 172.21.15.161:58594) 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015e00640 1 -- 172.21.15.161:0/4078304063 learned_addr learned my addr 172.21.15.161:0/4078304063 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc016800640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc01815fb00 0x7fc018142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015400640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc01815be20 0x7fc0181422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015e00640 1 -- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc01815fb00 msgr2=0x7fc018142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015e00640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc01815fb00 0x7fc018142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015e00640 1 -- 172.21.15.161:0/4078304063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc01815be20 msgr2=0x7fc0181422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015e00640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc01815be20 0x7fc0181422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015e00640 1 -- 172.21.15.161:0/4078304063 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0180c9510 con 0x7fc0180cfd80 2024-03-07T07:30:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc016800640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc01815fb00 0x7fc018142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.607+0000 7fc015400640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc01815be20 0x7fc0181422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc015e00640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0180cfd80 0x7fc01815cea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc00800e870 tx=0x7fc00800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc00e000640 1 -- 172.21.15.161:0/4078304063 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008017070 con 0x7fc0180cfd80 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc00e000640 1 -- 172.21.15.161:0/4078304063 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00800c940 con 0x7fc0180cfd80 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc00e000640 1 -- 172.21.15.161:0/4078304063 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800ccf0 con 0x7fc0180cfd80 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01815d6c0 con 0x7fc0180cfd80 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01815dc80 con 0x7fc0180cfd80 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc00e000640 1 -- 172.21.15.161:0/4078304063 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc00801a070 con 0x7fc0180cfd80 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc00e000640 1 -- 172.21.15.161:0/4078304063 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc00801c7d0 con 0x7fc0180cfd80 2024-03-07T07:30:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.611+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc018062d40 con 0x7fc0180cfd80 2024-03-07T07:30:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.615+0000 7fc00e000640 1 -- 172.21.15.161:0/4078304063 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc008013470 con 0x7fc0180cfd80 2024-03-07T07:30:48.635 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:48.636+0000 7f32d5e2f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-07T07:30:48.654 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:48.655+0000 7f49f8ad3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-07T07:30:48.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.691+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a241edfa-aa77-4f17-8c03-abda9be7e112", "id": 0} v 0) v1 -- 0x7fc0180cf650 con 0x7fc0180cfd80 2024-03-07T07:30:48.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.695+0000 7fc00e000640 1 -- 172.21.15.161:0/4078304063 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a241edfa-aa77-4f17-8c03-abda9be7e112", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc00801c9d0 con 0x7fc0180cfd80 2024-03-07T07:30:48.696 INFO:teuthology.orchestra.run.smithi161.stdout:0 2024-03-07T07:30:48.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0180cfd80 msgr2=0x7fc01815cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0180cfd80 0x7fc01815cea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc00800e870 tx=0x7fc00800ec70 comp rx=0 tx=0).stop 2024-03-07T07:30:48.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 shutdown_connections 2024-03-07T07:30:48.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc01815fb00 0x7fc018142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc01815be20 0x7fc0181422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 --2- 172.21.15.161:0/4078304063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0180cfd80 0x7fc01815cea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 >> 172.21.15.161:0/4078304063 conn(0x7fc0180d1fa0 msgr2=0x7fc01806bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:48.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 shutdown_connections 2024-03-07T07:30:48.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.699+0000 7fc01d200640 1 -- 172.21.15.161:0/4078304063 wait complete. 2024-03-07T07:30:48.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new f4e8b5ab-439a-477e-b7a5-0f77dae4de3b 1 2024-03-07T07:30:48.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.851+0000 7f8f95000640 1 Processor -- start 2024-03-07T07:30:48.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f95000640 1 -- start start 2024-03-07T07:30:48.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f95000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8f90071810 0x7f8f90071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f95000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f901629b0 con 0x7f8f900d10b0 2024-03-07T07:30:48.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f95000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f90072130 con 0x7f8f9006b720 2024-03-07T07:30:48.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f95000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9015e460 con 0x7f8f90071810 2024-03-07T07:30:48.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f8de00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8f90071810 0x7f8f90071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f8d400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8f9006b720 0x7f8f90161b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:53974/0 (socket says 172.21.15.161:53974) 2024-03-07T07:30:48.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f8d400640 1 -- 172.21.15.161:0/3248031712 learned_addr learned my addr 172.21.15.161:0/3248031712 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-03-07T07:30:48.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f8de00640 1 -- 172.21.15.161:0/3248031712 >> v1:172.21.15.161:6789/0 conn(0x7f8f9006b720 legacy=0x7f8f90161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f8de00640 1 -- 172.21.15.161:0/3248031712 >> v1:172.21.15.84:6789/0 conn(0x7f8f900d10b0 legacy=0x7f8f901622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:48.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f8de00640 1 -- 172.21.15.161:0/3248031712 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9009ada0 con 0x7f8f90071810 2024-03-07T07:30:48.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.855+0000 7f8f8ca00640 1 -- 172.21.15.161:0/3248031712 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785935105 0 0) 0x7f8f90072130 con 0x7f8f9006b720 2024-03-07T07:30:48.855 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:48.852+0000 7f32d5e2f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-07T07:30:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f8de00640 1 --2- 172.21.15.161:0/3248031712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f90071810 0x7f8f90071bf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8f800097c0 tx=0x7f8f8001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa8b2e0684ce2fb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f8ca00640 1 -- 172.21.15.161:0/3248031712 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800b0070 con 0x7f8f90071810 2024-03-07T07:30:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f8ca00640 1 -- 172.21.15.161:0/3248031712 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f800ab600 con 0x7f8f90071810 2024-03-07T07:30:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f8ca00640 1 -- 172.21.15.161:0/3248031712 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800ab9d0 con 0x7f8f90071810 2024-03-07T07:30:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 -- 172.21.15.161:0/3248031712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f90071810 msgr2=0x7f8f90071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 --2- 172.21.15.161:0/3248031712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f90071810 0x7f8f90071bf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8f800097c0 tx=0x7f8f8001c3d0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 -- 172.21.15.161:0/3248031712 shutdown_connections 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 --2- 172.21.15.161:0/3248031712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f90071810 0x7f8f90071bf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 -- 172.21.15.161:0/3248031712 >> 172.21.15.161:0/3248031712 conn(0x7f8f900d1fa0 msgr2=0x7f8f900d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 -- 172.21.15.161:0/3248031712 shutdown_connections 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 -- 172.21.15.161:0/3248031712 wait complete. 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 Processor -- start 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.859+0000 7f8f95000640 1 -- start start 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f9006b720 0x7f8f90149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f90071810 0x7f8f9015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f900d10b0 0x7f8f900cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:48.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9009a9e0 con 0x7f8f900d10b0 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9009b920 con 0x7f8f9006b720 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9009ab60 con 0x7f8f90071810 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f9006b720 0x7f8f90149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f9006b720 0x7f8f90149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58614/0 (socket says 172.21.15.161:58614) 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 -- 172.21.15.161:0/2578274867 learned_addr learned my addr 172.21.15.161:0/2578274867 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8d400640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f90071810 0x7f8f9015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8e800640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f900d10b0 0x7f8f900cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 -- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f90071810 msgr2=0x7f8f9015a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f90071810 0x7f8f9015a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 -- 172.21.15.161:0/2578274867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f900d10b0 msgr2=0x7f8f900cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f900d10b0 0x7f8f900cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 -- 172.21.15.161:0/2578274867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90149950 con 0x7f8f9006b720 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8e800640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f900d10b0 0x7f8f900cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8d400640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f90071810 0x7f8f9015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f8de00640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f9006b720 0x7f8f90149410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8f800097c0 tx=0x7f8f8001ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f86000640 1 -- 172.21.15.161:0/2578274867 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800b0040 con 0x7f8f9006b720 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f86000640 1 -- 172.21.15.161:0/2578274867 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80004030 con 0x7f8f9006b720 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9015ac20 con 0x7f8f9006b720 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f86000640 1 -- 172.21.15.161:0/2578274867 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80004400 con 0x7f8f9006b720 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9015b1e0 con 0x7f8f9006b720 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f86000640 1 -- 172.21.15.161:0/2578274867 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8f800039b0 con 0x7f8f9006b720 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f86000640 1 -- 172.21.15.161:0/2578274867 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f8f800b6970 con 0x7f8f9006b720 2024-03-07T07:30:48.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.863+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f90062d40 con 0x7f8f9006b720 2024-03-07T07:30:48.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.867+0000 7f8f86000640 1 -- 172.21.15.161:0/2578274867 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8f80016050 con 0x7f8f9006b720 2024-03-07T07:30:48.885 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:48.887+0000 7f49f8ad3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-07T07:30:48.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.935+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4e8b5ab-439a-477e-b7a5-0f77dae4de3b", "id": 1} v 0) v1 -- 0x7f8f900b7930 con 0x7f8f9006b720 2024-03-07T07:30:48.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.939+0000 7f8f86000640 1 -- 172.21.15.161:0/2578274867 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4e8b5ab-439a-477e-b7a5-0f77dae4de3b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8f80003e30 con 0x7f8f9006b720 2024-03-07T07:30:48.940 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f9006b720 msgr2=0x7f8f90149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f9006b720 0x7f8f90149410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8f800097c0 tx=0x7f8f8001ac10 comp rx=0 tx=0).stop 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 shutdown_connections 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f900d10b0 0x7f8f900cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f90071810 0x7f8f9015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 --2- 172.21.15.161:0/2578274867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f9006b720 0x7f8f90149410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 >> 172.21.15.161:0/2578274867 conn(0x7f8f900d1fa0 msgr2=0x7f8f900b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 shutdown_connections 2024-03-07T07:30:48.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:48.943+0000 7f8f95000640 1 -- 172.21.15.161:0/2578274867 wait complete. 2024-03-07T07:30:48.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new c790c1da-489e-476a-a998-7e83bc4ee96f 2 2024-03-07T07:30:49.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f5350800640 1 Processor -- start 2024-03-07T07:30:49.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f5350800640 1 -- start start 2024-03-07T07:30:49.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f5350800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f53480cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f5350800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53480cfd80 0x7f53480d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f5350800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53480ccbe0 con 0x7f534815fb00 2024-03-07T07:30:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f5350800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53480d0730 con 0x7f53480cfd80 2024-03-07T07:30:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f5350800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53480ce030 con 0x7f534815be20 2024-03-07T07:30:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534de00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f53480cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534e800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53480cfd80 0x7f53480d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534de00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f53480cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:49722/0 (socket says 172.21.15.161:49722) 2024-03-07T07:30:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534de00640 1 -- 172.21.15.161:0/3041608397 learned_addr learned my addr 172.21.15.161:0/3041608397 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:49.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534de00640 1 -- 172.21.15.161:0/3041608397 >> v2:172.21.15.161:3300/0 conn(0x7f53480cfd80 msgr2=0x7f53480d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:49.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534de00640 1 --2- 172.21.15.161:0/3041608397 >> v2:172.21.15.161:3300/0 conn(0x7f53480cfd80 0x7f53480d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534de00640 1 -- 172.21.15.161:0/3041608397 >> v1:172.21.15.84:6789/0 conn(0x7f534815fb00 legacy=0x7f534809a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534de00640 1 -- 172.21.15.161:0/3041608397 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534809b2e0 con 0x7f534815be20 2024-03-07T07:30:49.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.095+0000 7f534e800640 1 --2- 172.21.15.161:0/3041608397 >> v2:172.21.15.161:3300/0 conn(0x7f53480cfd80 0x7f53480d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f534de00640 1 --2- 172.21.15.161:0/3041608397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f53480cc6a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f533c009870 tx=0x7f533c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56fe0d04a61ab247 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f534ca00640 1 -- 172.21.15.161:0/3041608397 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0b5070 con 0x7f534815be20 2024-03-07T07:30:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f534ca00640 1 -- 172.21.15.161:0/3041608397 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0a8a50 con 0x7f534815be20 2024-03-07T07:30:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f534ca00640 1 -- 172.21.15.161:0/3041608397 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0a8e20 con 0x7f534815be20 2024-03-07T07:30:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f5350800640 1 -- 172.21.15.161:0/3041608397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 msgr2=0x7f53480cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f5350800640 1 --2- 172.21.15.161:0/3041608397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f53480cc6a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f533c009870 tx=0x7f533c01ed50 comp rx=0 tx=0).stop 2024-03-07T07:30:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f5350800640 1 -- 172.21.15.161:0/3041608397 shutdown_connections 2024-03-07T07:30:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f5350800640 1 --2- 172.21.15.161:0/3041608397 >> v2:172.21.15.161:3300/0 conn(0x7f53480cfd80 0x7f53480d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f5350800640 1 --2- 172.21.15.161:0/3041608397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f53480cc6a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f5350800640 1 -- 172.21.15.161:0/3041608397 >> 172.21.15.161:0/3041608397 conn(0x7f53480d1fa0 msgr2=0x7f53480d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f5350800640 1 -- 172.21.15.161:0/3041608397 shutdown_connections 2024-03-07T07:30:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.099+0000 7f5350800640 1 -- 172.21.15.161:0/3041608397 wait complete. 2024-03-07T07:30:49.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 Processor -- start 2024-03-07T07:30:49.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 -- start start 2024-03-07T07:30:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53480cfd80 0x7f534815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f5348158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534815fb00 0x7f5348158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480ce280 con 0x7f53480cfd80 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534809b8a0 con 0x7f534815fb00 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534815c200 con 0x7f534815be20 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f5348158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534e800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534815fb00 0x7f5348158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f5348158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:49736/0 (socket says 172.21.15.161:49736) 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53480cfd80 0x7f534815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 -- 172.21.15.161:0/1683374312 learned_addr learned my addr 172.21.15.161:0/1683374312 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 -- 172.21.15.161:0/1683374312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534815fb00 msgr2=0x7f5348158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 --2- 172.21.15.161:0/1683374312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534815fb00 0x7f5348158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 -- 172.21.15.161:0/1683374312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53480cfd80 msgr2=0x7f534815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 --2- 172.21.15.161:0/1683374312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53480cfd80 0x7f534815ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 -- 172.21.15.161:0/1683374312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534815e520 con 0x7f534815be20 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f534d400640 1 --2- 172.21.15.161:0/1683374312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f5348158100 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f533800c430 tx=0x7f533800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5342000640 1 -- 172.21.15.161:0/1683374312 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380052d0 con 0x7f534815be20 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5342000640 1 -- 172.21.15.161:0/1683374312 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338005470 con 0x7f534815be20 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5342000640 1 -- 172.21.15.161:0/1683374312 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338007260 con 0x7f534815be20 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534815e800 con 0x7f534815be20 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534815edc0 con 0x7f534815be20 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5342000640 1 -- 172.21.15.161:0/1683374312 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5338007400 con 0x7f534815be20 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5342000640 1 -- 172.21.15.161:0/1683374312 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5338003de0 con 0x7f534815be20 2024-03-07T07:30:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.103+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5348062d40 con 0x7f534815be20 2024-03-07T07:30:49.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.107+0000 7f5342000640 1 -- 172.21.15.161:0/1683374312 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f53480ccbe0 con 0x7f534815be20 2024-03-07T07:30:49.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.171+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c790c1da-489e-476a-a998-7e83bc4ee96f", "id": 2} v 0) v1 -- 0x7f53480cf650 con 0x7f534815be20 2024-03-07T07:30:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5342000640 1 -- 172.21.15.161:0/1683374312 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c790c1da-489e-476a-a998-7e83bc4ee96f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f53380039c0 con 0x7f534815be20 2024-03-07T07:30:49.178 INFO:teuthology.orchestra.run.smithi161.stdout:2 2024-03-07T07:30:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 msgr2=0x7f5348158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 --2- 172.21.15.161:0/1683374312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f5348158100 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f533800c430 tx=0x7f533800c830 comp rx=0 tx=0).stop 2024-03-07T07:30:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 shutdown_connections 2024-03-07T07:30:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 --2- 172.21.15.161:0/1683374312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f534815fb00 0x7f5348158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 --2- 172.21.15.161:0/1683374312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f534815be20 0x7f5348158100 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 --2- 172.21.15.161:0/1683374312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53480cfd80 0x7f534815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 >> 172.21.15.161:0/1683374312 conn(0x7f53480d1fa0 msgr2=0x7f53480aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 shutdown_connections 2024-03-07T07:30:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.179+0000 7f5350800640 1 -- 172.21.15.161:0/1683374312 wait complete. 2024-03-07T07:30:49.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 46c04825-19bd-4290-87f0-16fc3aeb6ceb 3 2024-03-07T07:30:49.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f75600640 1 Processor -- start 2024-03-07T07:30:49.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f75600640 1 -- start start 2024-03-07T07:30:49.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f75600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f7006bbf0 0x7f6f700d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f75600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7015e460 con 0x7f6f70071810 2024-03-07T07:30:49.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f75600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7009ada0 con 0x7f6f7006b720 2024-03-07T07:30:49.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f75600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7009b080 con 0x7f6f7006bbf0 2024-03-07T07:30:49.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f67e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6f7006b720 0x7f6f700d00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:53990/0 (socket says 172.21.15.161:53990) 2024-03-07T07:30:49.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f6f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f7006bbf0 0x7f6f700d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f67e00640 1 -- 172.21.15.161:0/3155280734 learned_addr learned my addr 172.21.15.161:0/3155280734 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-03-07T07:30:49.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f6f400640 1 -- 172.21.15.161:0/3155280734 >> v1:172.21.15.161:6789/0 conn(0x7f6f7006b720 legacy=0x7f6f700d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f6f400640 1 -- 172.21.15.161:0/3155280734 >> v1:172.21.15.84:6789/0 conn(0x7f6f70071810 legacy=0x7f6f70071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:49.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f6e000640 1 -- 172.21.15.161:0/3155280734 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066234523 0 0) 0x7f6f7009ada0 con 0x7f6f7006b720 2024-03-07T07:30:49.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.335+0000 7f6f6f400640 1 -- 172.21.15.161:0/3155280734 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7009b360 con 0x7f6f7006bbf0 2024-03-07T07:30:49.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f6f400640 1 --2- 172.21.15.161:0/3155280734 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f7006bbf0 0x7f6f700d07b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009dc0 tx=0x7f6f6801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ceb5ba3cbedc8b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:49.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f6e000640 1 -- 172.21.15.161:0/3155280734 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f680b2070 con 0x7f6f7006bbf0 2024-03-07T07:30:49.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f6e000640 1 -- 172.21.15.161:0/3155280734 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f680a5900 con 0x7f6f7006bbf0 2024-03-07T07:30:49.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f6e000640 1 -- 172.21.15.161:0/3155280734 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f680a5cd0 con 0x7f6f7006bbf0 2024-03-07T07:30:49.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f75600640 1 -- 172.21.15.161:0/3155280734 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f7006bbf0 msgr2=0x7f6f700d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f75600640 1 --2- 172.21.15.161:0/3155280734 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f7006bbf0 0x7f6f700d07b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009dc0 tx=0x7f6f6801c950 comp rx=0 tx=0).stop 2024-03-07T07:30:49.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f75600640 1 -- 172.21.15.161:0/3155280734 shutdown_connections 2024-03-07T07:30:49.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f75600640 1 --2- 172.21.15.161:0/3155280734 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f7006bbf0 0x7f6f700d07b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f75600640 1 -- 172.21.15.161:0/3155280734 >> 172.21.15.161:0/3155280734 conn(0x7f6f700d1fa0 msgr2=0x7f6f700d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:49.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f75600640 1 -- 172.21.15.161:0/3155280734 shutdown_connections 2024-03-07T07:30:49.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f75600640 1 -- 172.21.15.161:0/3155280734 wait complete. 2024-03-07T07:30:49.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.339+0000 7f6f75600640 1 Processor -- start 2024-03-07T07:30:49.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 -- start start 2024-03-07T07:30:49.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7006b720 0x7f6f700cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7006bbf0 0x7f6f7015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f70071810 0x7f6f7015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7016c0a0 con 0x7f6f7006b720 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7016bf20 con 0x7f6f7006bbf0 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7016c220 con 0x7f6f70071810 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f6f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f70071810 0x7f6f7015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f67e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7006bbf0 0x7f6f7015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f6f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f70071810 0x7f6f7015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:49762/0 (socket says 172.21.15.161:49762) 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f6f400640 1 -- 172.21.15.161:0/2830796605 learned_addr learned my addr 172.21.15.161:0/2830796605 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f6ea00640 1 --2- 172.21.15.161:0/2830796605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7006b720 0x7f6f700cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f67e00640 1 -- 172.21.15.161:0/2830796605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f70071810 msgr2=0x7f6f7015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f67e00640 1 --2- 172.21.15.161:0/2830796605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f70071810 0x7f6f7015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f67e00640 1 -- 172.21.15.161:0/2830796605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7006b720 msgr2=0x7f6f700cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f67e00640 1 --2- 172.21.15.161:0/2830796605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7006b720 0x7f6f700cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f67e00640 1 -- 172.21.15.161:0/2830796605 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70157c60 con 0x7f6f7006bbf0 2024-03-07T07:30:49.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f67e00640 1 --2- 172.21.15.161:0/2830796605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7006bbf0 0x7f6f7015a520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800c3e0 tx=0x7f6f5800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:49.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f66a00640 1 -- 172.21.15.161:0/2830796605 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580074e0 con 0x7f6f7006bbf0 2024-03-07T07:30:49.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f66a00640 1 -- 172.21.15.161:0/2830796605 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f580047f0 con 0x7f6f7006bbf0 2024-03-07T07:30:49.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f66a00640 1 -- 172.21.15.161:0/2830796605 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58004be0 con 0x7f6f7006bbf0 2024-03-07T07:30:49.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f70157f40 con 0x7f6f7006bbf0 2024-03-07T07:30:49.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f700cd600 con 0x7f6f7006bbf0 2024-03-07T07:30:49.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f66a00640 1 -- 172.21.15.161:0/2830796605 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6f58011070 con 0x7f6f7006bbf0 2024-03-07T07:30:49.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f66a00640 1 -- 172.21.15.161:0/2830796605 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6f58004d80 con 0x7f6f7006bbf0 2024-03-07T07:30:49.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.343+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f70062d40 con 0x7f6f7006bbf0 2024-03-07T07:30:49.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.347+0000 7f6f66a00640 1 -- 172.21.15.161:0/2830796605 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6f5801d3f0 con 0x7f6f7006bbf0 2024-03-07T07:30:49.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.411+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46c04825-19bd-4290-87f0-16fc3aeb6ceb", "id": 3} v 0) v1 -- 0x7f6f70169cf0 con 0x7f6f7006bbf0 2024-03-07T07:30:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f66a00640 1 -- 172.21.15.161:0/2830796605 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46c04825-19bd-4290-87f0-16fc3aeb6ceb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6f5801d760 con 0x7f6f7006bbf0 2024-03-07T07:30:49.418 INFO:teuthology.orchestra.run.smithi161.stdout:3 2024-03-07T07:30:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7006bbf0 msgr2=0x7f6f7015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 --2- 172.21.15.161:0/2830796605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7006bbf0 0x7f6f7015a520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800c3e0 tx=0x7f6f5800c8a0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 shutdown_connections 2024-03-07T07:30:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 --2- 172.21.15.161:0/2830796605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f70071810 0x7f6f7015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 --2- 172.21.15.161:0/2830796605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7006bbf0 0x7f6f7015a520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 --2- 172.21.15.161:0/2830796605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7006b720 0x7f6f700cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 >> 172.21.15.161:0/2830796605 conn(0x7f6f700d1fa0 msgr2=0x7f6f70071bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 shutdown_connections 2024-03-07T07:30:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.419+0000 7f6f75600640 1 -- 172.21.15.161:0/2830796605 wait complete. 2024-03-07T07:30:49.438 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new fd96ef66-f151-4941-8c34-4aa04d767ce6 4 2024-03-07T07:30:49.476 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:49.476+0000 7f32d5e2f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-07T07:30:49.521 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:49.523+0000 7f49f8ad3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-07T07:30:49.537 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:49.536+0000 7f32d5e2f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-07T07:30:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb435600640 1 Processor -- start 2024-03-07T07:30:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb435600640 1 -- start start 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb435600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb430072980 0x7fb4300ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb435600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb43015b410 0x7fb430071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb435600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4300af4e0 con 0x7fb430072d60 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb435600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4300aec40 con 0x7fb430072980 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb435600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4300aef20 con 0x7fb43015b410 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42f400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb43015b410 0x7fb430071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42f400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb43015b410 0x7fb430071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58650/0 (socket says 172.21.15.161:58650) 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42f400640 1 -- 172.21.15.161:0/975256068 learned_addr learned my addr 172.21.15.161:0/975256068 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42ea00640 1 --2- 172.21.15.161:0/975256068 >> v2:172.21.15.84:3300/0 conn(0x7fb430072980 0x7fb4300ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42f400640 1 -- 172.21.15.161:0/975256068 >> v2:172.21.15.84:3300/0 conn(0x7fb430072980 msgr2=0x7fb4300ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42f400640 1 --2- 172.21.15.161:0/975256068 >> v2:172.21.15.84:3300/0 conn(0x7fb430072980 0x7fb4300ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42f400640 1 -- 172.21.15.161:0/975256068 >> v1:172.21.15.84:6789/0 conn(0x7fb430072d60 legacy=0x7fb4300b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42f400640 1 -- 172.21.15.161:0/975256068 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4300af200 con 0x7fb43015b410 2024-03-07T07:30:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.575+0000 7fb42ea00640 1 --2- 172.21.15.161:0/975256068 >> v2:172.21.15.84:3300/0 conn(0x7fb430072980 0x7fb4300ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:30:49.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb42f400640 1 --2- 172.21.15.161:0/975256068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 0x7fb430071c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb4301584d0 tx=0x7fb42801c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3c8c461949b515 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:49.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb42d600640 1 -- 172.21.15.161:0/975256068 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4280a5620 con 0x7fb43015b410 2024-03-07T07:30:49.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb42d600640 1 -- 172.21.15.161:0/975256068 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4280a57c0 con 0x7fb43015b410 2024-03-07T07:30:49.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb42d600640 1 -- 172.21.15.161:0/975256068 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4280a5b90 con 0x7fb43015b410 2024-03-07T07:30:49.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 -- 172.21.15.161:0/975256068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 msgr2=0x7fb430071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 --2- 172.21.15.161:0/975256068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 0x7fb430071c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb4301584d0 tx=0x7fb42801c960 comp rx=0 tx=0).stop 2024-03-07T07:30:49.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 -- 172.21.15.161:0/975256068 shutdown_connections 2024-03-07T07:30:49.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 --2- 172.21.15.161:0/975256068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 0x7fb430071c20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 --2- 172.21.15.161:0/975256068 >> v2:172.21.15.84:3300/0 conn(0x7fb430072980 0x7fb4300ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 -- 172.21.15.161:0/975256068 >> 172.21.15.161:0/975256068 conn(0x7fb4300b18c0 msgr2=0x7fb4300b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:49.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 -- 172.21.15.161:0/975256068 shutdown_connections 2024-03-07T07:30:49.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 -- 172.21.15.161:0/975256068 wait complete. 2024-03-07T07:30:49.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.579+0000 7fb435600640 1 Processor -- start 2024-03-07T07:30:49.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 -- start start 2024-03-07T07:30:49.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb430072980 0x7fb43009ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb430072d60 0x7fb43013cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 0x7fb43009ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430151420 con 0x7fb430072980 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301515a0 con 0x7fb43015b410 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb430151720 con 0x7fb430072d60 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb430072d60 0x7fb43013cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb430072980 0x7fb43009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42f400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 0x7fb43009ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb430072d60 0x7fb43013cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:49776/0 (socket says 172.21.15.161:49776) 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 -- 172.21.15.161:0/2040473043 learned_addr learned my addr 172.21.15.161:0/2040473043 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb430072980 0x7fb43009ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.161:37640/0 (socket says 172.21.15.161:37640) 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 -- 172.21.15.161:0/2040473043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 msgr2=0x7fb43009ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 --2- 172.21.15.161:0/2040473043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 0x7fb43009ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 -- 172.21.15.161:0/2040473043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb430072980 msgr2=0x7fb43009ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 --2- 172.21.15.161:0/2040473043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb430072980 0x7fb43009ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 -- 172.21.15.161:0/2040473043 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43015ee30 con 0x7fb430072d60 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42f400640 1 --2- 172.21.15.161:0/2040473043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 0x7fb43009ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb42e000640 1 --2- 172.21.15.161:0/2040473043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb430072d60 0x7fb43013cd70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c3a0 tx=0x7fb41c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb426a00640 1 -- 172.21.15.161:0/2040473043 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0052d0 con 0x7fb430072d60 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb426a00640 1 -- 172.21.15.161:0/2040473043 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c005470 con 0x7fb430072d60 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb426a00640 1 -- 172.21.15.161:0/2040473043 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c007260 con 0x7fb430072d60 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43009d3d0 con 0x7fb430072d60 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43009d980 con 0x7fb430072d60 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb426a00640 1 -- 172.21.15.161:0/2040473043 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb41c007400 con 0x7fb430072d60 2024-03-07T07:30:49.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb426a00640 1 -- 172.21.15.161:0/2040473043 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb41c0067e0 con 0x7fb430072d60 2024-03-07T07:30:49.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.583+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb430062d40 con 0x7fb430072d60 2024-03-07T07:30:49.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.587+0000 7fb426a00640 1 -- 172.21.15.161:0/2040473043 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb41c006ac0 con 0x7fb430072d60 2024-03-07T07:30:49.587 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:49.587+0000 7f49f8ad3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-07T07:30:49.598 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:49.596+0000 7f32d5e2f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-07T07:30:49.648 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:49.651+0000 7f49f8ad3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-07T07:30:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.651+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fd96ef66-f151-4941-8c34-4aa04d767ce6", "id": 4} v 0) v1 -- 0x7fb4300b2020 con 0x7fb430072d60 2024-03-07T07:30:49.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb426a00640 1 -- 172.21.15.161:0/2040473043 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd96ef66-f151-4941-8c34-4aa04d767ce6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb41c006ca0 con 0x7fb430072d60 2024-03-07T07:30:49.656 INFO:teuthology.orchestra.run.smithi161.stdout:4 2024-03-07T07:30:49.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb430072d60 msgr2=0x7fb43013cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 --2- 172.21.15.161:0/2040473043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb430072d60 0x7fb43013cd70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c3a0 tx=0x7fb41c00c860 comp rx=0 tx=0).stop 2024-03-07T07:30:49.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 shutdown_connections 2024-03-07T07:30:49.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 --2- 172.21.15.161:0/2040473043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb43015b410 0x7fb43009ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 --2- 172.21.15.161:0/2040473043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb430072d60 0x7fb43013cd70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 --2- 172.21.15.161:0/2040473043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb430072980 0x7fb43009ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 >> 172.21.15.161:0/2040473043 conn(0x7fb4300b18c0 msgr2=0x7fb4300743c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 shutdown_connections 2024-03-07T07:30:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.659+0000 7fb435600640 1 -- 172.21.15.161:0/2040473043 wait complete. 2024-03-07T07:30:49.675 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 31a884c4-729a-4b25-9eb7-060cadb239d5 5 2024-03-07T07:30:49.686 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:49.684+0000 7f32d5e2f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-07T07:30:49.742 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:49.743+0000 7f49f8ad3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-07T07:30:49.746 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:49.744+0000 7f32d5e2f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-07T07:30:49.803 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:49.803+0000 7f49f8ad3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-07T07:30:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.811+0000 7fed33800640 1 Processor -- start 2024-03-07T07:30:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.811+0000 7fed33800640 1 -- start start 2024-03-07T07:30:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.811+0000 7fed33800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fed2c1458e0 0x7fed2c0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed33800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c0b3120 0x7fed2c070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed33800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c15fbd0 con 0x7fed2c145400 2024-03-07T07:30:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed33800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c15feb0 con 0x7fed2c1458e0 2024-03-07T07:30:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed33800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c160190 con 0x7fed2c0b3120 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed30e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fed2c145400 0x7fed2c0d06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:53996/0 (socket says 172.21.15.161:53996) 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed30e00640 1 -- 172.21.15.161:0/562717844 learned_addr learned my addr 172.21.15.161:0/562717844 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed31800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c0b3120 0x7fed2c070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed2be00640 1 --2- 172.21.15.161:0/562717844 >> v2:172.21.15.84:3300/0 conn(0x7fed2c1458e0 0x7fed2c0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed31800640 1 -- 172.21.15.161:0/562717844 >> v2:172.21.15.84:3300/0 conn(0x7fed2c1458e0 msgr2=0x7fed2c0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed31800640 1 --2- 172.21.15.161:0/562717844 >> v2:172.21.15.84:3300/0 conn(0x7fed2c1458e0 0x7fed2c0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed31800640 1 -- 172.21.15.161:0/562717844 >> v1:172.21.15.161:6789/0 conn(0x7fed2c145400 legacy=0x7fed2c0d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed31800640 1 -- 172.21.15.161:0/562717844 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c160470 con 0x7fed2c0b3120 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed2b400640 1 -- 172.21.15.161:0/562717844 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983620402 0 0) 0x7fed2c15fbd0 con 0x7fed2c145400 2024-03-07T07:30:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed2be00640 1 --2- 172.21.15.161:0/562717844 >> v2:172.21.15.84:3300/0 conn(0x7fed2c1458e0 0x7fed2c0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:30:49.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed31800640 1 --2- 172.21.15.161:0/562717844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c0b3120 0x7fed2c070ea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed24009d90 tx=0x7fed2401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faeb76b705d5950 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:49.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed2b400640 1 -- 172.21.15.161:0/562717844 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240b2070 con 0x7fed2c0b3120 2024-03-07T07:30:49.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed2b400640 1 -- 172.21.15.161:0/562717844 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed240a5830 con 0x7fed2c0b3120 2024-03-07T07:30:49.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.815+0000 7fed2b400640 1 -- 172.21.15.161:0/562717844 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240a5c00 con 0x7fed2c0b3120 2024-03-07T07:30:49.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- 172.21.15.161:0/562717844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c0b3120 msgr2=0x7fed2c070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 --2- 172.21.15.161:0/562717844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c0b3120 0x7fed2c070ea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed24009d90 tx=0x7fed2401c970 comp rx=0 tx=0).stop 2024-03-07T07:30:49.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- 172.21.15.161:0/562717844 shutdown_connections 2024-03-07T07:30:49.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 --2- 172.21.15.161:0/562717844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c0b3120 0x7fed2c070ea0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 --2- 172.21.15.161:0/562717844 >> v2:172.21.15.84:3300/0 conn(0x7fed2c1458e0 0x7fed2c0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- 172.21.15.161:0/562717844 >> 172.21.15.161:0/562717844 conn(0x7fed2c072ae0 msgr2=0x7fed2c072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:49.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- 172.21.15.161:0/562717844 shutdown_connections 2024-03-07T07:30:49.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- 172.21.15.161:0/562717844 wait complete. 2024-03-07T07:30:49.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 Processor -- start 2024-03-07T07:30:49.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- start start 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0b3120 0x7fed2c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c145400 0x7fed2c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed2c1458e0 0x7fed2c15e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c071f80 con 0x7fed2c0b3120 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c071e00 con 0x7fed2c1458e0 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed33800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c072100 con 0x7fed2c145400 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed2be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c145400 0x7fed2c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed31800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed2c1458e0 0x7fed2c15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed2be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c145400 0x7fed2c0aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:49794/0 (socket says 172.21.15.161:49794) 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed2be00640 1 -- 172.21.15.161:0/91241934 learned_addr learned my addr 172.21.15.161:0/91241934 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.819+0000 7fed30e00640 1 --2- 172.21.15.161:0/91241934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0b3120 0x7fed2c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed2be00640 1 -- 172.21.15.161:0/91241934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed2c1458e0 msgr2=0x7fed2c15e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed2be00640 1 --2- 172.21.15.161:0/91241934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed2c1458e0 0x7fed2c15e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed2be00640 1 -- 172.21.15.161:0/91241934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0b3120 msgr2=0x7fed2c140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed2be00640 1 --2- 172.21.15.161:0/91241934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0b3120 0x7fed2c140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed2be00640 1 -- 172.21.15.161:0/91241934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c0af3d0 con 0x7fed2c145400 2024-03-07T07:30:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed2be00640 1 --2- 172.21.15.161:0/91241934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c145400 0x7fed2c0aee90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fed1800d830 tx=0x7fed1800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed28c00640 1 -- 172.21.15.161:0/91241934 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18018020 con 0x7fed2c145400 2024-03-07T07:30:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed28c00640 1 -- 172.21.15.161:0/91241934 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed180096c0 con 0x7fed2c145400 2024-03-07T07:30:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed28c00640 1 -- 172.21.15.161:0/91241934 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18009ab0 con 0x7fed2c145400 2024-03-07T07:30:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c0ab4d0 con 0x7fed2c145400 2024-03-07T07:30:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c140430 con 0x7fed2c145400 2024-03-07T07:30:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed28c00640 1 -- 172.21.15.161:0/91241934 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fed1801b020 con 0x7fed2c145400 2024-03-07T07:30:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed28c00640 1 -- 172.21.15.161:0/91241934 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fed18014d20 con 0x7fed2c145400 2024-03-07T07:30:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c062d40 con 0x7fed2c145400 2024-03-07T07:30:49.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.823+0000 7fed28c00640 1 -- 172.21.15.161:0/91241934 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fed18022020 con 0x7fed2c145400 2024-03-07T07:30:49.835 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:49.832+0000 7f32d5e2f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-07T07:30:49.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.895+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "31a884c4-729a-4b25-9eb7-060cadb239d5", "id": 5} v 0) v1 -- 0x7fed2c0b1bb0 con 0x7fed2c145400 2024-03-07T07:30:49.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.895+0000 7fed28c00640 1 -- 172.21.15.161:0/91241934 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31a884c4-729a-4b25-9eb7-060cadb239d5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fed180147a0 con 0x7fed2c145400 2024-03-07T07:30:49.895 INFO:teuthology.orchestra.run.smithi161.stdout:5 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c145400 msgr2=0x7fed2c0aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 --2- 172.21.15.161:0/91241934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c145400 0x7fed2c0aee90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fed1800d830 tx=0x7fed1800dcf0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 shutdown_connections 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 --2- 172.21.15.161:0/91241934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed2c1458e0 0x7fed2c15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 --2- 172.21.15.161:0/91241934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed2c145400 0x7fed2c0aee90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 --2- 172.21.15.161:0/91241934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0b3120 0x7fed2c140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 >> 172.21.15.161:0/91241934 conn(0x7fed2c072ae0 msgr2=0x7fed2c15cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 shutdown_connections 2024-03-07T07:30:49.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:49.899+0000 7fed33800640 1 -- 172.21.15.161:0/91241934 wait complete. 2024-03-07T07:30:49.898 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:49.899+0000 7f49f8ad3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-07T07:30:49.898 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:49.896+0000 7f32d5e2f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-07T07:30:49.915 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 325129ea-266f-425a-8e3e-eb791cabf7e6 6 2024-03-07T07:30:49.964 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:49.963+0000 7f49f8ad3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-07T07:30:50.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f09c00640 1 Processor -- start 2024-03-07T07:30:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f09c00640 1 -- start start 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f09c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0406b720 0x7f7f040d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f09c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7f0406bbf0 0x7f7f040d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f09c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0415e460 con 0x7f7f04071810 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f09c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0409ada0 con 0x7f7f0406bbf0 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f09c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0409b080 con 0x7f7f0406b720 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f02a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7f04071810 0x7f7f04071bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54004/0 (socket says 172.21.15.161:54004) 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0406b720 0x7f7f040d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f02a00640 1 -- 172.21.15.161:0/1060699109 learned_addr learned my addr 172.21.15.161:0/1060699109 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-03-07T07:30:50.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f03400640 1 --2- 172.21.15.161:0/1060699109 >> v2:172.21.15.161:3300/0 conn(0x7f7f0406bbf0 0x7f7f040d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f03400640 1 -- 172.21.15.161:0/1060699109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0406b720 msgr2=0x7f7f040d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:50.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f03400640 1 --2- 172.21.15.161:0/1060699109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0406b720 0x7f7f040d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f03400640 1 -- 172.21.15.161:0/1060699109 >> v1:172.21.15.161:6789/0 conn(0x7f7f04071810 legacy=0x7f7f04071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f03400640 1 -- 172.21.15.161:0/1060699109 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0409b360 con 0x7f7f0406bbf0 2024-03-07T07:30:50.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7f02000640 1 -- 172.21.15.161:0/1060699109 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596607803 0 0) 0x7f7f0415e460 con 0x7f7f04071810 2024-03-07T07:30:50.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.051+0000 7f7efbe00640 1 --2- 172.21.15.161:0/1060699109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0406b720 0x7f7f040d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f03400640 1 --2- 172.21.15.161:0/1060699109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f040d05e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d90 tx=0x7f7efc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4671ff2e32899c27 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f02000640 1 -- 172.21.15.161:0/1060699109 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0b2070 con 0x7f7f0406bbf0 2024-03-07T07:30:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f02000640 1 -- 172.21.15.161:0/1060699109 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc0a5920 con 0x7f7f0406bbf0 2024-03-07T07:30:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f02000640 1 -- 172.21.15.161:0/1060699109 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0a5cf0 con 0x7f7f0406bbf0 2024-03-07T07:30:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 -- 172.21.15.161:0/1060699109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 msgr2=0x7f7f040d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 --2- 172.21.15.161:0/1060699109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f040d05e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d90 tx=0x7f7efc01c970 comp rx=0 tx=0).stop 2024-03-07T07:30:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 -- 172.21.15.161:0/1060699109 shutdown_connections 2024-03-07T07:30:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 --2- 172.21.15.161:0/1060699109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f040d05e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 --2- 172.21.15.161:0/1060699109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0406b720 0x7f7f040d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 -- 172.21.15.161:0/1060699109 >> 172.21.15.161:0/1060699109 conn(0x7f7f040d1fa0 msgr2=0x7f7f040d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 -- 172.21.15.161:0/1060699109 shutdown_connections 2024-03-07T07:30:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 -- 172.21.15.161:0/1060699109 wait complete. 2024-03-07T07:30:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 Processor -- start 2024-03-07T07:30:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.059+0000 7f7f09c00640 1 -- start start 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0406b720 0x7f7f04156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f04160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f04071810 0x7f7f040cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0416b090 con 0x7f7f0406b720 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0416af10 con 0x7f7f0406bbf0 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0416b210 con 0x7f7f04071810 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f04160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f03400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f04071810 0x7f7f040cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f04160f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58678/0 (socket says 172.21.15.161:58678) 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 -- 172.21.15.161:0/3931776139 learned_addr learned my addr 172.21.15.161:0/3931776139 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f02a00640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0406b720 0x7f7f04156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 -- 172.21.15.161:0/3931776139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f04071810 msgr2=0x7f7f040cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f04071810 0x7f7f040cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 -- 172.21.15.161:0/3931776139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0406b720 msgr2=0x7f7f04156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0406b720 0x7f7f04156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 -- 172.21.15.161:0/3931776139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0415f010 con 0x7f7f0406bbf0 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f03400640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f04071810 0x7f7f040cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efbe00640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f04160f60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00e9b0 tx=0x7f7eec00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efaa00640 1 -- 172.21.15.161:0/3931776139 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec017070 con 0x7f7f0406bbf0 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efaa00640 1 -- 172.21.15.161:0/3931776139 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00c9a0 con 0x7f7f0406bbf0 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efaa00640 1 -- 172.21.15.161:0/3931776139 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00cd90 con 0x7f7f0406bbf0 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0415f2d0 con 0x7f7f0406bbf0 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f040caad0 con 0x7f7f0406bbf0 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efaa00640 1 -- 172.21.15.161:0/3931776139 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7eec01a070 con 0x7f7f0406bbf0 2024-03-07T07:30:50.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7efaa00640 1 -- 172.21.15.161:0/3931776139 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7eec009380 con 0x7f7f0406bbf0 2024-03-07T07:30:50.064 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:50.060+0000 7f32d5e2f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-07T07:30:50.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.063+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04062d40 con 0x7f7f0406bbf0 2024-03-07T07:30:50.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.067+0000 7f7efaa00640 1 -- 172.21.15.161:0/3931776139 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7eec003ad0 con 0x7f7f0406bbf0 2024-03-07T07:30:50.135 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:50.132+0000 7f32d5e2f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-07T07:30:50.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.135+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "325129ea-266f-425a-8e3e-eb791cabf7e6", "id": 6} v 0) v1 -- 0x7f7f040cf650 con 0x7f7f0406bbf0 2024-03-07T07:30:50.136 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:50.139+0000 7f49f8ad3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-07T07:30:50.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.139+0000 7f7efaa00640 1 -- 172.21.15.161:0/3931776139 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "325129ea-266f-425a-8e3e-eb791cabf7e6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7eec0059a0 con 0x7f7f0406bbf0 2024-03-07T07:30:50.139 INFO:teuthology.orchestra.run.smithi161.stdout:6 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 msgr2=0x7f7f04160f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f04160f60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00e9b0 tx=0x7f7eec00ee70 comp rx=0 tx=0).stop 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 shutdown_connections 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f04071810 0x7f7f040cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0406bbf0 0x7f7f04160f60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 --2- 172.21.15.161:0/3931776139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0406b720 0x7f7f04156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 >> 172.21.15.161:0/3931776139 conn(0x7f7f040d1fa0 msgr2=0x7f7f0415d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 shutdown_connections 2024-03-07T07:30:50.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.143+0000 7f7f09c00640 1 -- 172.21.15.161:0/3931776139 wait complete. 2024-03-07T07:30:50.159 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 87871f7e-b148-473f-b1d6-f1a7a5075e88 7 2024-03-07T07:30:50.213 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:50.215+0000 7f49f8ad3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-07T07:30:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47c1200640 1 Processor -- start 2024-03-07T07:30:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47c1200640 1 -- start start 2024-03-07T07:30:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47c1200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc1458e0 0x7f47bc0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47c1200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f47bc0b3120 0x7f47bc070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47c1200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc15fbd0 con 0x7f47bc145400 2024-03-07T07:30:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47c1200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc15feb0 con 0x7f47bc0b3120 2024-03-07T07:30:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47c1200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc160190 con 0x7f47bc1458e0 2024-03-07T07:30:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47b9400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc1458e0 0x7f47bc0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47ba800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f47bc0b3120 0x7f47bc070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47b9400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc1458e0 0x7f47bc0b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:49818/0 (socket says 172.21.15.161:49818) 2024-03-07T07:30:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47b9400640 1 -- 172.21.15.161:0/2225991415 learned_addr learned my addr 172.21.15.161:0/2225991415 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47ba800640 1 -- 172.21.15.161:0/2225991415 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc1458e0 msgr2=0x7f47bc0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47ba800640 1 --2- 172.21.15.161:0/2225991415 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc1458e0 0x7f47bc0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47ba800640 1 -- 172.21.15.161:0/2225991415 >> v1:172.21.15.161:6789/0 conn(0x7f47bc145400 legacy=0x7f47bc0d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47ba800640 1 -- 172.21.15.161:0/2225991415 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc160470 con 0x7f47bc0b3120 2024-03-07T07:30:50.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47b8a00640 1 -- 172.21.15.161:0/2225991415 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265442806 0 0) 0x7f47bc15fbd0 con 0x7f47bc145400 2024-03-07T07:30:50.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.299+0000 7f47b9400640 1 --2- 172.21.15.161:0/2225991415 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc1458e0 0x7f47bc0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:50.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47ba800640 1 --2- 172.21.15.161:0/2225991415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc0b3120 0x7f47bc070ea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d90 tx=0x7f47b401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=445a578dfcec45d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:50.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47b8a00640 1 -- 172.21.15.161:0/2225991415 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40b2070 con 0x7f47bc0b3120 2024-03-07T07:30:50.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47b8a00640 1 -- 172.21.15.161:0/2225991415 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b40a5830 con 0x7f47bc0b3120 2024-03-07T07:30:50.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47b8a00640 1 -- 172.21.15.161:0/2225991415 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40a5c00 con 0x7f47bc0b3120 2024-03-07T07:30:50.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47c1200640 1 -- 172.21.15.161:0/2225991415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc0b3120 msgr2=0x7f47bc070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47c1200640 1 --2- 172.21.15.161:0/2225991415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc0b3120 0x7f47bc070ea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d90 tx=0x7f47b401c970 comp rx=0 tx=0).stop 2024-03-07T07:30:50.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47c1200640 1 -- 172.21.15.161:0/2225991415 shutdown_connections 2024-03-07T07:30:50.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47c1200640 1 --2- 172.21.15.161:0/2225991415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc0b3120 0x7f47bc070ea0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47c1200640 1 --2- 172.21.15.161:0/2225991415 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc1458e0 0x7f47bc0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47c1200640 1 -- 172.21.15.161:0/2225991415 >> 172.21.15.161:0/2225991415 conn(0x7f47bc072ae0 msgr2=0x7f47bc072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:50.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47c1200640 1 -- 172.21.15.161:0/2225991415 shutdown_connections 2024-03-07T07:30:50.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.303+0000 7f47c1200640 1 -- 172.21.15.161:0/2225991415 wait complete. 2024-03-07T07:30:50.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 Processor -- start 2024-03-07T07:30:50.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 -- start start 2024-03-07T07:30:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47bc0b3120 0x7f47bc141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc145400 0x7f47bc13f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc1458e0 0x7f47bc13f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc071fc0 con 0x7f47bc0b3120 2024-03-07T07:30:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc071e40 con 0x7f47bc1458e0 2024-03-07T07:30:50.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc072140 con 0x7f47bc145400 2024-03-07T07:30:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc1458e0 0x7f47bc13f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47b9400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc145400 0x7f47bc13f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc1458e0 0x7f47bc13f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58688/0 (socket says 172.21.15.161:58688) 2024-03-07T07:30:50.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 -- 172.21.15.161:0/2244583561 learned_addr learned my addr 172.21.15.161:0/2244583561 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-03-07T07:30:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 -- 172.21.15.161:0/2244583561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc145400 msgr2=0x7f47bc13f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 --2- 172.21.15.161:0/2244583561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc145400 0x7f47bc13f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 -- 172.21.15.161:0/2244583561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47bc0b3120 msgr2=0x7f47bc141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 --2- 172.21.15.161:0/2244583561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47bc0b3120 0x7f47bc141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 -- 172.21.15.161:0/2244583561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0d06a0 con 0x7f47bc1458e0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47b9400640 1 --2- 172.21.15.161:0/2244583561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc145400 0x7f47bc13f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47ba800640 1 --2- 172.21.15.161:0/2244583561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc1458e0 0x7f47bc13f970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47b40b0040 tx=0x7f47b4019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47b2000640 1 -- 172.21.15.161:0/2244583561 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40b2040 con 0x7f47bc1458e0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47b2000640 1 -- 172.21.15.161:0/2244583561 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b40bf070 con 0x7f47bc1458e0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47b2000640 1 -- 172.21.15.161:0/2244583561 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4009450 con 0x7f47bc1458e0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc161b10 con 0x7f47bc1458e0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.307+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc1620d0 con 0x7f47bc1458e0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.311+0000 7f47b2000640 1 -- 172.21.15.161:0/2244583561 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f47b40add10 con 0x7f47bc1458e0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.311+0000 7f47b2000640 1 -- 172.21.15.161:0/2244583561 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f47b40b8d80 con 0x7f47bc1458e0 2024-03-07T07:30:50.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.311+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc062d40 con 0x7f47bc1458e0 2024-03-07T07:30:50.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.311+0000 7f47b2000640 1 -- 172.21.15.161:0/2244583561 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f47b4016560 con 0x7f47bc1458e0 2024-03-07T07:30:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.379+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "87871f7e-b148-473f-b1d6-f1a7a5075e88", "id": 7} v 0) v1 -- 0x7f47bc070ad0 con 0x7f47bc1458e0 2024-03-07T07:30:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47b2000640 1 -- 172.21.15.161:0/2244583561 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "87871f7e-b148-473f-b1d6-f1a7a5075e88", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47b40b8470 con 0x7f47bc1458e0 2024-03-07T07:30:50.384 INFO:teuthology.orchestra.run.smithi161.stdout:7 2024-03-07T07:30:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc1458e0 msgr2=0x7f47bc13f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 --2- 172.21.15.161:0/2244583561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc1458e0 0x7f47bc13f970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47b40b0040 tx=0x7f47b4019710 comp rx=0 tx=0).stop 2024-03-07T07:30:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 shutdown_connections 2024-03-07T07:30:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 --2- 172.21.15.161:0/2244583561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47bc1458e0 0x7f47bc13f970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 --2- 172.21.15.161:0/2244583561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47bc145400 0x7f47bc13f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 --2- 172.21.15.161:0/2244583561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47bc0b3120 0x7f47bc141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 >> 172.21.15.161:0/2244583561 conn(0x7f47bc072ae0 msgr2=0x7f47bc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:50.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 shutdown_connections 2024-03-07T07:30:50.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-03-07T07:30:50.387+0000 7f47c1200640 1 -- 172.21.15.161:0/2244583561 wait complete. 2024-03-07T07:30:50.403 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-07T07:30:50.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-07T07:30:50.406 INFO:tasks.ceph.osd.0:Started 2024-03-07T07:30:50.407 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-07T07:30:50.407 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-07T07:30:50.411 INFO:tasks.ceph.osd.1:Started 2024-03-07T07:30:50.411 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-07T07:30:50.411 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-07T07:30:50.415 INFO:tasks.ceph.osd.2:Started 2024-03-07T07:30:50.415 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-07T07:30:50.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-07T07:30:50.419 INFO:tasks.ceph.osd.3:Started 2024-03-07T07:30:50.419 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-07T07:30:50.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-07T07:30:50.423 INFO:tasks.ceph.osd.4:Started 2024-03-07T07:30:50.424 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-07T07:30:50.424 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-07T07:30:50.427 INFO:tasks.ceph.osd.5:Started 2024-03-07T07:30:50.427 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-07T07:30:50.427 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-07T07:30:50.430 INFO:tasks.ceph.osd.6:Started 2024-03-07T07:30:50.430 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-07T07:30:50.431 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-07T07:30:50.437 INFO:tasks.ceph.osd.7:Started 2024-03-07T07:30:50.437 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:30:50.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.632+0000 7f2ad4800640 1 Processor -- start 2024-03-07T07:30:50.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.632+0000 7f2ad4800640 1 -- start start 2024-03-07T07:30:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.632+0000 7f2ad4800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15bca0 0x7f2acc0b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.632+0000 7f2ad4800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc0d1c50 con 0x7f2acc160140 2024-03-07T07:30:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.632+0000 7f2ad4800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc0d1970 con 0x7f2acc15c080 2024-03-07T07:30:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.632+0000 7f2ad4800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0b6010 con 0x7f2acc15bca0 2024-03-07T07:30:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad2800640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2acc160140 0x7f2acc0cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51316/0 (socket says 172.21.15.84:51316) 2024-03-07T07:30:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad2800640 1 -- 172.21.15.84:0/2789671848 learned_addr learned my addr 172.21.15.84:0/2789671848 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:30:50.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad1e00640 1 --2- 172.21.15.84:0/2789671848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15bca0 0x7f2acc0b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad0a00640 1 -- 172.21.15.84:0/2789671848 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273018702 0 0) 0x7f2acc0d1c50 con 0x7f2acc160140 2024-03-07T07:30:50.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad0a00640 1 -- 172.21.15.84:0/2789671848 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab4003530 con 0x7f2acc160140 2024-03-07T07:30:50.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad0a00640 1 -- 172.21.15.84:0/2789671848 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813047758 0 0) 0x7f2acc0d1970 con 0x7f2acc15c080 2024-03-07T07:30:50.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad0a00640 1 -- 172.21.15.84:0/2789671848 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2acc0d1c50 con 0x7f2acc15c080 2024-03-07T07:30:50.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad1e00640 1 -- 172.21.15.84:0/2789671848 >> v1:172.21.15.161:6789/0 conn(0x7f2acc15c080 legacy=0x7f2acc15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad1e00640 1 -- 172.21.15.84:0/2789671848 >> v1:172.21.15.84:6789/0 conn(0x7f2acc160140 legacy=0x7f2acc0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad1e00640 1 -- 172.21.15.84:0/2789671848 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc0b62f0 con 0x7f2acc15bca0 2024-03-07T07:30:50.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad1e00640 1 --2- 172.21.15.84:0/2789671848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15bca0 0x7f2acc0b7bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00097f0 tx=0x7f2ac001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8fb1491b41e1743 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:50.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad0a00640 1 -- 172.21.15.84:0/2789671848 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00b2070 con 0x7f2acc15bca0 2024-03-07T07:30:50.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad0a00640 1 -- 172.21.15.84:0/2789671848 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac00a9070 con 0x7f2acc15bca0 2024-03-07T07:30:50.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.636+0000 7f2ad0a00640 1 -- 172.21.15.84:0/2789671848 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00ad880 con 0x7f2acc15bca0 2024-03-07T07:30:50.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- 172.21.15.84:0/2789671848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15bca0 msgr2=0x7f2acc0b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 --2- 172.21.15.84:0/2789671848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15bca0 0x7f2acc0b7bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00097f0 tx=0x7f2ac001c450 comp rx=0 tx=0).stop 2024-03-07T07:30:50.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- 172.21.15.84:0/2789671848 shutdown_connections 2024-03-07T07:30:50.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 --2- 172.21.15.84:0/2789671848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15bca0 0x7f2acc0b7bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- 172.21.15.84:0/2789671848 >> 172.21.15.84:0/2789671848 conn(0x7f2acc0704b0 msgr2=0x7f2acc0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:50.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- 172.21.15.84:0/2789671848 shutdown_connections 2024-03-07T07:30:50.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- 172.21.15.84:0/2789671848 wait complete. 2024-03-07T07:30:50.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 Processor -- start 2024-03-07T07:30:50.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- start start 2024-03-07T07:30:50.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc15bca0 0x7f2acc1537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15c080 0x7f2acc14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2acc160140 0x7f2acc0cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:50.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0cfc60 con 0x7f2acc15bca0 2024-03-07T07:30:50.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0cfae0 con 0x7f2acc160140 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad4800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0cfde0 con 0x7f2acc15c080 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc15bca0 0x7f2acc1537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc15bca0 0x7f2acc1537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47996/0 (socket says 172.21.15.84:47996) 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1e00640 1 -- 172.21.15.84:0/557567928 learned_addr learned my addr 172.21.15.84:0/557567928 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1400640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15c080 0x7f2acc14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad2800640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2acc160140 0x7f2acc0cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1e00640 1 -- 172.21.15.84:0/557567928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15c080 msgr2=0x7f2acc14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1e00640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15c080 0x7f2acc14ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1e00640 1 -- 172.21.15.84:0/557567928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2acc160140 msgr2=0x7f2acc0cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1e00640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2acc160140 0x7f2acc0cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.640+0000 7f2ad1e00640 1 -- 172.21.15.84:0/557567928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc1564b0 con 0x7f2acc15bca0 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ad1e00640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc15bca0 0x7f2acc1537e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0019060 tx=0x7f2ac001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:50.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ac6000640 1 -- 172.21.15.84:0/557567928 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00b2050 con 0x7f2acc15bca0 2024-03-07T07:30:50.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ac6000640 1 -- 172.21.15.84:0/557567928 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac00be070 con 0x7f2acc15bca0 2024-03-07T07:30:50.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ac6000640 1 -- 172.21.15.84:0/557567928 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00b9690 con 0x7f2acc15bca0 2024-03-07T07:30:50.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc0cc1a0 con 0x7f2acc15bca0 2024-03-07T07:30:50.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc153d20 con 0x7f2acc15bca0 2024-03-07T07:30:50.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ac6000640 1 -- 172.21.15.84:0/557567928 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2ac00ab070 con 0x7f2acc15bca0 2024-03-07T07:30:50.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ac6000640 1 -- 172.21.15.84:0/557567928 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2ac00b7400 con 0x7f2acc15bca0 2024-03-07T07:30:50.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.644+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc067d30 con 0x7f2acc15bca0 2024-03-07T07:30:50.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.648+0000 7f2ac6000640 1 -- 172.21.15.84:0/557567928 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2ac00160d0 con 0x7f2acc15bca0 2024-03-07T07:30:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2acc062d40 con 0x7f2acc15bca0 2024-03-07T07:30:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ac6000640 1 -- 172.21.15.84:0/557567928 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f2ac00b9830 con 0x7f2acc15bca0 2024-03-07T07:30:50.706 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:30:50.706 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:30:50.382968+0000","last_up_change":"0.000000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:30:50.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc15bca0 msgr2=0x7f2acc1537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc15bca0 0x7f2acc1537e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0019060 tx=0x7f2ac001ac90 comp rx=0 tx=0).stop 2024-03-07T07:30:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 shutdown_connections 2024-03-07T07:30:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2acc160140 0x7f2acc0cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2acc15c080 0x7f2acc14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 --2- 172.21.15.84:0/557567928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc15bca0 0x7f2acc1537e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 >> 172.21.15.84:0/557567928 conn(0x7f2acc0704b0 msgr2=0x7f2acc150160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 shutdown_connections 2024-03-07T07:30:50.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:30:50.704+0000 7f2ad4800640 1 -- 172.21.15.84:0/557567928 wait complete. 2024-03-07T07:30:50.725 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-07T07:30:50.725 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-07T07:30:50.782 INFO:tasks.ceph.mgr.y.smithi084.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-07T07:30:50.782 INFO:tasks.ceph.mgr.y.smithi084.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-07T07:30:50.782 INFO:tasks.ceph.mgr.y.smithi084.stderr: from numpy import show_config as show_numpy_config 2024-03-07T07:30:50.836 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:50.836+0000 7f32d5e2f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-07T07:30:50.839 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-07T07:30:50.840 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-07T07:30:50.840 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2024-03-07T07:30:50.911 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:50.911+0000 7f49f8ad3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-07T07:30:50.985 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:50.984+0000 7f32d5e2f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-07T07:30:51.058 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:51.059+0000 7f49f8ad3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-07T07:30:51.073 INFO:tasks.ceph.osd.4.smithi161.stderr:2024-03-07T07:30:51.075+0000 7f58f17197c0 -1 Falling back to public interface 2024-03-07T07:30:51.073 INFO:tasks.ceph.osd.6.smithi161.stderr:2024-03-07T07:30:51.075+0000 7f2845dcf7c0 -1 Falling back to public interface 2024-03-07T07:30:51.089 INFO:tasks.ceph.osd.7.smithi161.stderr:2024-03-07T07:30:51.091+0000 7f8f0f22b7c0 -1 Falling back to public interface 2024-03-07T07:30:51.105 INFO:tasks.ceph.osd.5.smithi161.stderr:2024-03-07T07:30:51.107+0000 7fdc41dd37c0 -1 Falling back to public interface 2024-03-07T07:30:51.108 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-03-07T07:30:51.108+0000 7f96b135a7c0 -1 Falling back to public interface 2024-03-07T07:30:51.109 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-03-07T07:30:51.108+0000 7f795cf967c0 -1 Falling back to public interface 2024-03-07T07:30:51.128 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-03-07T07:30:51.128+0000 7fa6ab02b7c0 -1 Falling back to public interface 2024-03-07T07:30:51.145 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-03-07T07:30:51.144+0000 7fd2983887c0 -1 Falling back to public interface 2024-03-07T07:30:51.174 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:51.172+0000 7f32d5e2f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-07T07:30:51.239 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:51.239+0000 7f49f8ad3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-07T07:30:51.247 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:51.244+0000 7f32d5e2f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-07T07:30:51.311 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:51.311+0000 7f49f8ad3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-07T07:30:51.398 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:51.396+0000 7f32d5e2f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-07T07:30:51.461 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:51.463+0000 7f49f8ad3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-07T07:30:51.531 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-07T07:30:51.656 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe72bc00640 1 Processor -- start 2024-03-07T07:30:51.656 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe72bc00640 1 -- start start 2024-03-07T07:30:51.657 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe72bc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7240b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:51.657 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe72bc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe72406b030 0x7fe72406b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:51.657 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe72bc00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72415f9e0 con 0x7fe72406b9d0 2024-03-07T07:30:51.657 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe72bc00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72406be60 con 0x7fe72406b030 2024-03-07T07:30:51.657 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe72bc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240ccc00 con 0x7fe72415f600 2024-03-07T07:30:51.658 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe729c00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe72406b9d0 0x7fe7240727e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56760/0 (socket says 172.21.15.84:56760) 2024-03-07T07:30:51.658 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe729c00640 1 -- 172.21.15.84:0/2789460017 learned_addr learned my addr 172.21.15.84:0/2789460017 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:30:51.658 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe723e00640 1 --2- 172.21.15.84:0/2789460017 >> v2:172.21.15.161:3300/0 conn(0x7fe72406b030 0x7fe72406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:51.658 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe729200640 1 --2- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7240b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:51.659 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe723400640 1 -- 172.21.15.84:0/2789460017 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395913217 0 0) 0x7fe72415f9e0 con 0x7fe72406b9d0 2024-03-07T07:30:51.659 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe723400640 1 -- 172.21.15.84:0/2789460017 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe70c003530 con 0x7fe72406b9d0 2024-03-07T07:30:51.659 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe723e00640 1 -- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 msgr2=0x7fe7240b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:51.659 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe723e00640 1 --2- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7240b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:51.659 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe723e00640 1 -- 172.21.15.84:0/2789460017 >> v1:172.21.15.84:6789/0 conn(0x7fe72406b9d0 legacy=0x7fe7240727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:51.659 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe723e00640 1 -- 172.21.15.84:0/2789460017 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240ccee0 con 0x7fe72406b030 2024-03-07T07:30:51.659 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.656+0000 7fe729200640 1 --2- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7240b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:30:51.661 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe723e00640 1 --2- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b030 0x7fe72406b490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7100097c0 tx=0x7fe71001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d94cd3d2209d61bc server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:51.661 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe723400640 1 -- 172.21.15.84:0/2789460017 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7100b5070 con 0x7fe72406b030 2024-03-07T07:30:51.661 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe723400640 1 -- 172.21.15.84:0/2789460017 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7100a8990 con 0x7fe72406b030 2024-03-07T07:30:51.661 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe723400640 1 -- 172.21.15.84:0/2789460017 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7100a8d60 con 0x7fe72406b030 2024-03-07T07:30:51.662 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe72bc00640 1 -- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b030 msgr2=0x7fe72406b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:51.662 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe72bc00640 1 --2- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b030 0x7fe72406b490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7100097c0 tx=0x7fe71001ec90 comp rx=0 tx=0).stop 2024-03-07T07:30:51.662 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe72bc00640 1 -- 172.21.15.84:0/2789460017 shutdown_connections 2024-03-07T07:30:51.662 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe72bc00640 1 --2- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b030 0x7fe72406b490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:51.663 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe72bc00640 1 --2- 172.21.15.84:0/2789460017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7240b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:51.663 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe72bc00640 1 -- 172.21.15.84:0/2789460017 >> 172.21.15.84:0/2789460017 conn(0x7fe7240b1df0 msgr2=0x7fe7240b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:51.663 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe72bc00640 1 -- 172.21.15.84:0/2789460017 shutdown_connections 2024-03-07T07:30:51.663 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.660+0000 7fe72bc00640 1 -- 172.21.15.84:0/2789460017 wait complete. 2024-03-07T07:30:51.664 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 Processor -- start 2024-03-07T07:30:51.664 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 -- start start 2024-03-07T07:30:51.666 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe72406b030 0x7fe72415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b9d0 0x7fe7241f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7241f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240cd780 con 0x7fe72406b030 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240cd4a0 con 0x7fe72406b9d0 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b5a30 con 0x7fe72415f600 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe72406b030 0x7fe72415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe72406b030 0x7fe72415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34926/0 (socket says 172.21.15.84:34926) 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 -- 172.21.15.84:0/728844444 learned_addr learned my addr 172.21.15.84:0/728844444 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729c00640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7241f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe723e00640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b9d0 0x7fe7241f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 -- 172.21.15.84:0/728844444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 msgr2=0x7fe7241f7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7241f7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 -- 172.21.15.84:0/728844444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b9d0 msgr2=0x7fe7241f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:51.667 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b9d0 0x7fe7241f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 -- 172.21.15.84:0/728844444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240ca4c0 con 0x7fe72406b030 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe729200640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe72406b030 0x7fe72415e520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe71800e9b0 tx=0x7fe71800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe720c00640 1 -- 172.21.15.84:0/728844444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718017070 con 0x7fe72406b030 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe720c00640 1 -- 172.21.15.84:0/728844444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71800c9a0 con 0x7fe72406b030 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7240cde90 con 0x7fe72406b030 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe720c00640 1 -- 172.21.15.84:0/728844444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800cd70 con 0x7fe72406b030 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7240ce450 con 0x7fe72406b030 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe720c00640 1 -- 172.21.15.84:0/728844444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe71801a070 con 0x7fe72406b030 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe720c00640 1 -- 172.21.15.84:0/728844444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe718009420 con 0x7fe72406b030 2024-03-07T07:30:51.668 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.664+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72404f3d0 con 0x7fe72406b030 2024-03-07T07:30:51.669 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.668+0000 7fe720c00640 1 -- 172.21.15.84:0/728844444 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe718013470 con 0x7fe72406b030 2024-03-07T07:30:51.726 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.724+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe72415cf70 con 0x7fe72406b030 2024-03-07T07:30:51.726 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.724+0000 7fe720c00640 1 -- 172.21.15.84:0/728844444 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fe718013650 con 0x7fe72406b030 2024-03-07T07:30:51.727 INFO:teuthology.misc.health.smithi084.stdout: 2024-03-07T07:30:51.727 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:30:50.382968+0000","last_up_change":"0.000000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:30:51.728 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.724+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe72406b030 msgr2=0x7fe72415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:51.728 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.724+0000 7fe72bc00640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe72406b030 0x7fe72415e520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe71800e9b0 tx=0x7fe71800ee70 comp rx=0 tx=0).stop 2024-03-07T07:30:51.728 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.728+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 shutdown_connections 2024-03-07T07:30:51.728 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.728+0000 7fe72bc00640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72415f600 0x7fe7241f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:51.728 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.728+0000 7fe72bc00640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72406b9d0 0x7fe7241f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:51.728 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.728+0000 7fe72bc00640 1 --2- 172.21.15.84:0/728844444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe72406b030 0x7fe72415e520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:51.728 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.728+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 >> 172.21.15.84:0/728844444 conn(0x7fe7240b1df0 msgr2=0x7fe7240b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:51.728 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.728+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 shutdown_connections 2024-03-07T07:30:51.729 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:51.728+0000 7fe72bc00640 1 -- 172.21.15.84:0/728844444 wait complete. 2024-03-07T07:30:51.744 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-07T07:30:52.090 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:52.088+0000 7f32d5e2f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-07T07:30:52.152 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:52.155+0000 7f49f8ad3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-07T07:30:52.176 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:52.176+0000 7f32d5e2f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-07T07:30:52.238 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:52.239+0000 7f49f8ad3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-07T07:30:52.378 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:52.376+0000 7f32d5e2f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-07T07:30:52.440 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:52.443+0000 7f49f8ad3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-07T07:30:52.463 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:52.460+0000 7f32d5e2f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-07T07:30:52.524 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:52.527+0000 7f49f8ad3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-07T07:30:52.790 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:52.788+0000 7f32d5e2f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-07T07:30:52.853 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:52.855+0000 7f49f8ad3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-07T07:30:52.860 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:52.860+0000 7f32d5e2f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-07T07:30:52.933 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-03-07T07:30:52.935+0000 7f49f8ad3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-07T07:30:53.880 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:53.880+0000 7f327b000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-07T07:30:53.880 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:30:53.880+0000 7f327b000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-07T07:30:54.838 INFO:tasks.ceph.osd.6.smithi161.stderr:2024-03-07T07:30:54.839+0000 7f2845dcf7c0 -1 osd.6 0 log_to_monitors true 2024-03-07T07:30:54.891 INFO:tasks.ceph.osd.4.smithi161.stderr:2024-03-07T07:30:54.891+0000 7f58f17197c0 -1 osd.4 0 log_to_monitors true 2024-03-07T07:30:54.934 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-03-07T07:30:54.932+0000 7f795cf967c0 -1 osd.0 0 log_to_monitors true 2024-03-07T07:30:54.977 INFO:tasks.ceph.osd.7.smithi161.stderr:2024-03-07T07:30:54.979+0000 7f8f0f22b7c0 -1 osd.7 0 log_to_monitors true 2024-03-07T07:30:54.997 INFO:tasks.ceph.osd.5.smithi161.stderr:2024-03-07T07:30:54.999+0000 7fdc41dd37c0 -1 osd.5 0 log_to_monitors true 2024-03-07T07:30:55.041 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-03-07T07:30:55.040+0000 7f96b135a7c0 -1 osd.1 0 log_to_monitors true 2024-03-07T07:30:55.074 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-03-07T07:30:55.072+0000 7fd2983887c0 -1 osd.2 0 log_to_monitors true 2024-03-07T07:30:55.113 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-03-07T07:30:55.112+0000 7fa6ab02b7c0 -1 osd.3 0 log_to_monitors true 2024-03-07T07:30:57.401 INFO:tasks.ceph.osd.6.smithi161.stderr:2024-03-07T07:30:57.403+0000 7f2840200640 -1 osd.6 0 waiting for initial osdmap 2024-03-07T07:30:57.437 INFO:tasks.ceph.osd.4.smithi161.stderr:2024-03-07T07:30:57.439+0000 7f58eda00640 -1 osd.4 0 waiting for initial osdmap 2024-03-07T07:30:57.453 INFO:tasks.ceph.osd.6.smithi161.stderr:2024-03-07T07:30:57.455+0000 7f2836c00640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T07:30:57.524 INFO:tasks.ceph.osd.4.smithi161.stderr:2024-03-07T07:30:57.527+0000 7f58e2600640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T07:30:58.372 INFO:tasks.ceph.osd.5.smithi161.stderr:2024-03-07T07:30:58.370+0000 7fdc3c200640 -1 osd.5 0 waiting for initial osdmap 2024-03-07T07:30:58.386 INFO:tasks.ceph.osd.7.smithi161.stderr:2024-03-07T07:30:58.386+0000 7f8f0aa00640 -1 osd.7 0 waiting for initial osdmap 2024-03-07T07:30:58.401 INFO:tasks.ceph.osd.5.smithi161.stderr:2024-03-07T07:30:58.402+0000 7fdc32c00640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T07:30:58.413 INFO:tasks.ceph.osd.7.smithi161.stderr:2024-03-07T07:30:58.414+0000 7f8eff600640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T07:30:58.551 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-07T07:30:58.757 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4999400640 1 Processor -- start 2024-03-07T07:30:58.758 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4999400640 1 -- start start 2024-03-07T07:30:58.759 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4999400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f499413ee70 0x7f49940d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:58.759 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4999400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4994160450 0x7f4994144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:58.759 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4999400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940cc250 con 0x7f4994145510 2024-03-07T07:30:58.759 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4999400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49941609c0 con 0x7f4994160450 2024-03-07T07:30:58.760 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4999400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4994145940 con 0x7f499413ee70 2024-03-07T07:30:58.760 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4991e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4994160450 0x7f4994144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:58.760 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4991e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4994160450 0x7f4994144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35034/0 (socket says 172.21.15.84:35034) 2024-03-07T07:30:58.760 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.755+0000 7f4991e00640 1 -- 172.21.15.84:0/675129571 learned_addr learned my addr 172.21.15.84:0/675129571 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:30:58.760 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.759+0000 7f4992800640 1 --2- 172.21.15.84:0/675129571 >> v2:172.21.15.161:3300/0 conn(0x7f499413ee70 0x7f49940d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:58.760 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.759+0000 7f4991e00640 1 -- 172.21.15.84:0/675129571 >> v2:172.21.15.161:3300/0 conn(0x7f499413ee70 msgr2=0x7f49940d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:30:58.761 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.759+0000 7f4991e00640 1 --2- 172.21.15.84:0/675129571 >> v2:172.21.15.161:3300/0 conn(0x7f499413ee70 0x7f49940d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:58.761 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.759+0000 7f4991e00640 1 -- 172.21.15.84:0/675129571 >> v1:172.21.15.84:6789/0 conn(0x7f4994145510 legacy=0x7f49941417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:58.761 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.759+0000 7f4991e00640 1 -- 172.21.15.84:0/675129571 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940ca2f0 con 0x7f4994160450 2024-03-07T07:30:58.765 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.763+0000 7f4991e00640 1 --2- 172.21.15.84:0/675129571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4994160450 0x7f4994144fd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f49940cc550 tx=0x7f498001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2d7144d21a700b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:58.766 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.763+0000 7f4991400640 1 -- 172.21.15.84:0/675129571 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800ab660 con 0x7f4994160450 2024-03-07T07:30:58.767 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.763+0000 7f4991400640 1 -- 172.21.15.84:0/675129571 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800b0070 con 0x7f4994160450 2024-03-07T07:30:58.767 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.763+0000 7f4991400640 1 -- 172.21.15.84:0/675129571 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800aba20 con 0x7f4994160450 2024-03-07T07:30:58.767 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.763+0000 7f4999400640 1 -- 172.21.15.84:0/675129571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4994160450 msgr2=0x7f4994144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:58.767 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.763+0000 7f4999400640 1 --2- 172.21.15.84:0/675129571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4994160450 0x7f4994144fd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f49940cc550 tx=0x7f498001c460 comp rx=0 tx=0).stop 2024-03-07T07:30:58.768 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.763+0000 7f4999400640 1 -- 172.21.15.84:0/675129571 shutdown_connections 2024-03-07T07:30:58.768 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 --2- 172.21.15.84:0/675129571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4994160450 0x7f4994144fd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:58.768 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 --2- 172.21.15.84:0/675129571 >> v2:172.21.15.161:3300/0 conn(0x7f499413ee70 0x7f49940d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:58.768 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 -- 172.21.15.84:0/675129571 >> 172.21.15.84:0/675129571 conn(0x7f49940cfb70 msgr2=0x7f49940cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:58.768 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 -- 172.21.15.84:0/675129571 shutdown_connections 2024-03-07T07:30:58.768 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 -- 172.21.15.84:0/675129571 wait complete. 2024-03-07T07:30:58.770 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 Processor -- start 2024-03-07T07:30:58.770 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 -- start start 2024-03-07T07:30:58.771 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f499413ee70 0x7f499415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:58.771 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4994145510 0x7f49940cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:58.771 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4994160450 0x7f49940cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:58.771 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499413f3d0 con 0x7f499413ee70 2024-03-07T07:30:58.771 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499413f250 con 0x7f4994160450 2024-03-07T07:30:58.771 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4999400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49940c4a10 con 0x7f4994145510 2024-03-07T07:30:58.771 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4992800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f499413ee70 0x7f499415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:58.772 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4993200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4994160450 0x7f49940cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:58.772 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4991e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4994145510 0x7f49940cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:58.772 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4991e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4994145510 0x7f49940cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:38424/0 (socket says 172.21.15.84:38424) 2024-03-07T07:30:58.772 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4991e00640 1 -- 172.21.15.84:0/3189480579 learned_addr learned my addr 172.21.15.84:0/3189480579 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.767+0000 7f4992800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f499413ee70 0x7f499415f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35036/0 (socket says 172.21.15.84:35036) 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4993200640 1 -- 172.21.15.84:0/3189480579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4994145510 msgr2=0x7f49940cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4993200640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4994145510 0x7f49940cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4993200640 1 -- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f499413ee70 msgr2=0x7f499415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4993200640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f499413ee70 0x7f499415f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4993200640 1 -- 172.21.15.84:0/3189480579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994140f50 con 0x7f4994160450 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4992800640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f499413ee70 0x7f499415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4993200640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4994160450 0x7f49940cdc60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c760 tx=0x7f498c00cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f498aa00640 1 -- 172.21.15.84:0/3189480579 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c016020 con 0x7f4994160450 2024-03-07T07:30:58.773 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f498aa00640 1 -- 172.21.15.84:0/3189480579 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c006d60 con 0x7f4994160450 2024-03-07T07:30:58.774 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f498aa00640 1 -- 172.21.15.84:0/3189480579 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c003bc0 con 0x7f4994160450 2024-03-07T07:30:58.774 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4994141230 con 0x7f4994160450 2024-03-07T07:30:58.774 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4994159bc0 con 0x7f4994160450 2024-03-07T07:30:58.774 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.771+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499404f3d0 con 0x7f4994160450 2024-03-07T07:30:58.776 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.775+0000 7f498aa00640 1 -- 172.21.15.84:0/3189480579 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 86669+0+0 (secure 0 0 0) 0x7f498c00a850 con 0x7f4994160450 2024-03-07T07:30:58.777 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.775+0000 7f498aa00640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4974066ed0 0x7f4974069390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:30:58.778 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.775+0000 7f498aa00640 1 -- 172.21.15.84:0/3189480579 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f498c084f10 con 0x7f4994160450 2024-03-07T07:30:58.778 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.775+0000 7f4992800640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4974066ed0 0x7f4974069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:30:58.779 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.775+0000 7f4992800640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4974066ed0 0x7f4974069390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f49940af540 tx=0x7f4984008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:30:58.793 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:58.791+0000 7f498aa00640 1 -- 172.21.15.84:0/3189480579 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f498c020020 con 0x7f4994160450 2024-03-07T07:30:59.094 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.091+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4994141400 con 0x7f4994160450 2024-03-07T07:30:59.095 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.091+0000 7f498aa00640 1 -- 172.21.15.84:0/3189480579 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9001 (secure 0 0 0) 0x7f49940cc250 con 0x7f4994160450 2024-03-07T07:30:59.095 INFO:teuthology.misc.health.smithi084.stdout: 2024-03-07T07:30:59.095 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":14,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:30:58.452291+0000","last_up_change":"2024-03-07T07:30:58.452291+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:30:59.098 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4974066ed0 msgr2=0x7f4974069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:59.098 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4974066ed0 0x7f4974069390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f49940af540 tx=0x7f4984008040 comp rx=0 tx=0).stop 2024-03-07T07:30:59.098 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4994160450 msgr2=0x7f49940cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:30:59.098 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4994160450 0x7f49940cdc60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c760 tx=0x7f498c00cc20 comp rx=0 tx=0).stop 2024-03-07T07:30:59.099 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 shutdown_connections 2024-03-07T07:30:59.099 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4974066ed0 0x7f4974069390 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:59.099 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4994160450 0x7f49940cdc60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:59.099 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4994145510 0x7f49940cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:59.099 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 --2- 172.21.15.84:0/3189480579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f499413ee70 0x7f499415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:30:59.099 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 >> 172.21.15.84:0/3189480579 conn(0x7f49940cfb70 msgr2=0x7f49940b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:30:59.099 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 shutdown_connections 2024-03-07T07:30:59.099 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:30:59.095+0000 7f4999400640 1 -- 172.21.15.84:0/3189480579 wait complete. 2024-03-07T07:30:59.130 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-03-07T07:30:59.290 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-03-07T07:30:59.287+0000 7fa6a4c00640 -1 osd.3 0 waiting for initial osdmap 2024-03-07T07:30:59.294 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-03-07T07:30:59.291+0000 7fd292800640 -1 osd.2 0 waiting for initial osdmap 2024-03-07T07:30:59.307 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-03-07T07:30:59.303+0000 7f7959200640 -1 osd.0 0 waiting for initial osdmap 2024-03-07T07:30:59.317 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-03-07T07:30:59.315+0000 7f96ab800640 -1 osd.1 0 waiting for initial osdmap 2024-03-07T07:30:59.321 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-03-07T07:30:59.319+0000 7fd289200640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T07:30:59.322 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-03-07T07:30:59.319+0000 7fa69b600640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T07:30:59.332 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-03-07T07:30:59.331+0000 7f794de00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T07:30:59.340 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-03-07T07:30:59.339+0000 7f96a2200640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T07:31:05.937 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:06.070 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.067+0000 7f0b6ba00640 1 Processor -- start 2024-03-07T07:31:06.071 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.067+0000 7f0b6ba00640 1 -- start start 2024-03-07T07:31:06.072 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.067+0000 7f0b6ba00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0b640cd950 0x7f0b640cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.072 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b6ba00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b640cf1d0 con 0x7f0b640c4d80 2024-03-07T07:31:06.072 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b6ba00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b640ce270 con 0x7f0b6406e6e0 2024-03-07T07:31:06.072 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b6ba00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640cb5b0 con 0x7f0b640cd950 2024-03-07T07:31:06.072 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69a00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0b640c4d80 0x7f0b640c5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35496/0 (socket says 172.21.15.84:35496) 2024-03-07T07:31:06.072 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69a00640 1 -- 172.21.15.84:0/3609778389 learned_addr learned my addr 172.21.15.84:0/3609778389 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:06.072 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69000640 1 --2- 172.21.15.84:0/3609778389 >> v2:172.21.15.161:3300/0 conn(0x7f0b640cd950 0x7f0b640cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.074 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406743196 0 0) 0x7f0b640cf1d0 con 0x7f0b640c4d80 2024-03-07T07:31:06.074 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b48003530 con 0x7f0b640c4d80 2024-03-07T07:31:06.074 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056311600 0 0) 0x7f0b640ce270 con 0x7f0b6406e6e0 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b640cf1d0 con 0x7f0b6406e6e0 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2874328621 0 0) 0x7f0b48003530 con 0x7f0b640c4d80 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 >> v2:172.21.15.161:3300/0 conn(0x7f0b640cd950 msgr2=0x7f0b640cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 --2- 172.21.15.84:0/3609778389 >> v2:172.21.15.161:3300/0 conn(0x7f0b640cd950 0x7f0b640cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 >> v1:172.21.15.161:6789/0 conn(0x7f0b6406e6e0 legacy=0x7f0b640cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640cb890 con 0x7f0b640c4d80 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f0b5c001a00 con 0x7f0b640c4d80 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 >> v1:172.21.15.84:6789/0 conn(0x7f0b640c4d80 legacy=0x7f0b640c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b48003ba0 0x7f0b48003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b48004810 0x7f0b48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48005220 0x7f0b4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640cb5b0 con 0x7f0b48003ba0 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4800c150 con 0x7f0b48005220 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4800c350 con 0x7f0b48004810 2024-03-07T07:31:06.075 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69000640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b48003ba0 0x7f0b48003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69a00640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48005220 0x7f0b4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63e00640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b48004810 0x7f0b48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69000640 1 -- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b48004810 msgr2=0x7f0b48004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69000640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b48004810 0x7f0b48004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69000640 1 -- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48005220 msgr2=0x7f0b4800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69000640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48005220 0x7f0b4800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69000640 1 -- 172.21.15.84:0/3609778389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b48003530 con 0x7f0b48003ba0 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b69a00640 1 -- 172.21.15.84:0/3609778389 reap_dead start 2024-03-07T07:31:06.076 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.071+0000 7f0b63e00640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b48004810 0x7f0b48004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:06.077 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b69000640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b48003ba0 0x7f0b48003fa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009ae0 tx=0x7f0b5401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d5560ac6b4914e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.077 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540b2070 con 0x7f0b48003ba0 2024-03-07T07:31:06.077 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b540a5550 con 0x7f0b48003ba0 2024-03-07T07:31:06.077 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b63400640 1 -- 172.21.15.84:0/3609778389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540096b0 con 0x7f0b48003ba0 2024-03-07T07:31:06.078 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3609778389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b48003ba0 msgr2=0x7f0b48003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.078 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b48003ba0 0x7f0b48003fa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009ae0 tx=0x7f0b5401ca70 comp rx=0 tx=0).stop 2024-03-07T07:31:06.078 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3609778389 shutdown_connections 2024-03-07T07:31:06.078 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 --2- 172.21.15.84:0/3609778389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b48003ba0 0x7f0b48003fa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.078 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3609778389 >> 172.21.15.84:0/3609778389 conn(0x7f0b640cfb70 msgr2=0x7f0b640cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:06.078 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3609778389 shutdown_connections 2024-03-07T07:31:06.078 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3609778389 wait complete. 2024-03-07T07:31:06.079 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 Processor -- start 2024-03-07T07:31:06.079 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.075+0000 7f0b6ba00640 1 -- start start 2024-03-07T07:31:06.081 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48003ba0 0x7f0b6415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b6416a410 0x7f0b641675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b641fadb0 0x7f0b641fb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6415eb20 con 0x7f0b641fadb0 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6415e9a0 con 0x7f0b48003ba0 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6415eca0 con 0x7f0b6416a410 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b641fadb0 0x7f0b641fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b641fadb0 0x7f0b641fb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56844/0 (socket says 172.21.15.84:56844) 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 -- 172.21.15.84:0/3400170638 learned_addr learned my addr 172.21.15.84:0/3400170638 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69000640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48003ba0 0x7f0b6415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b63e00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b6416a410 0x7f0b641675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 -- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b6416a410 msgr2=0x7f0b641675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.082 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b6416a410 0x7f0b641675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 -- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48003ba0 msgr2=0x7f0b6415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48003ba0 0x7f0b6415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 -- 172.21.15.84:0/3400170638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64152f60 con 0x7f0b641fadb0 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b63e00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b6416a410 0x7f0b641675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b69a00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b641fadb0 0x7f0b641fb260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b640ca0f0 tx=0x7f0b5c007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b60c00640 1 -- 172.21.15.84:0/3400170638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c019070 con 0x7f0b641fadb0 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b60c00640 1 -- 172.21.15.84:0/3400170638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c00e980 con 0x7f0b641fadb0 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b60c00640 1 -- 172.21.15.84:0/3400170638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00ed90 con 0x7f0b641fadb0 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b641529a0 con 0x7f0b641fadb0 2024-03-07T07:31:06.083 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b640c7cd0 con 0x7f0b641fadb0 2024-03-07T07:31:06.084 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6404f3d0 con 0x7f0b641fadb0 2024-03-07T07:31:06.084 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.079+0000 7f0b60c00640 1 -- 172.21.15.84:0/3400170638 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f0b5c01c070 con 0x7f0b641fadb0 2024-03-07T07:31:06.084 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.083+0000 7f0b60c00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0b44066f90 0x7f0b44069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.084 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.083+0000 7f0b60c00640 1 -- 172.21.15.84:0/3400170638 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0b5c084780 con 0x7f0b641fadb0 2024-03-07T07:31:06.084 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.083+0000 7f0b69000640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0b44066f90 0x7f0b44069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.085 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.083+0000 7f0b69000640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0b44066f90 0x7f0b44069450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b540af000 tx=0x7f0b540046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.088 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.087+0000 7f0b60c00640 1 -- 172.21.15.84:0/3400170638 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f0b5c0553f0 con 0x7f0b641fadb0 2024-03-07T07:31:06.246 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.243+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b640c6800 con 0x7f0b641fadb0 2024-03-07T07:31:06.247 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.243+0000 7f0b60c00640 1 -- 172.21.15.84:0/3400170638 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12848 (secure 0 0 0) 0x7f0b5c059490 con 0x7f0b641fadb0 2024-03-07T07:31:06.247 INFO:teuthology.misc.health.smithi084.stdout: 2024-03-07T07:31:06.247 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":17,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:01.463222+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:06.249 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0b44066f90 msgr2=0x7f0b44069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.249 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0b44066f90 0x7f0b44069450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b540af000 tx=0x7f0b540046d0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.249 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b641fadb0 msgr2=0x7f0b641fb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.249 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b641fadb0 0x7f0b641fb260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b640ca0f0 tx=0x7f0b5c007af0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.249 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 shutdown_connections 2024-03-07T07:31:06.249 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0b44066f90 0x7f0b44069450 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.250 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b641fadb0 0x7f0b641fb260 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.250 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b6416a410 0x7f0b641675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.250 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 --2- 172.21.15.84:0/3400170638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b48003ba0 0x7f0b6415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.250 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 >> 172.21.15.84:0/3400170638 conn(0x7f0b640cfb70 msgr2=0x7f0b640c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:06.250 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 shutdown_connections 2024-03-07T07:31:06.250 INFO:teuthology.misc.health.smithi084.stderr:2024-03-07T07:31:06.247+0000 7f0b6ba00640 1 -- 172.21.15.84:0/3400170638 wait complete. 2024-03-07T07:31:06.266 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-07T07:31:06.266 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-07T07:31:06.266 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-07T07:31:06.266 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-07T07:31:06.269 INFO:tasks.ceph.mds.a:Started 2024-03-07T07:31:06.269 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-07T07:31:06.269 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-07T07:31:06.272 INFO:tasks.ceph.mds.c:Started 2024-03-07T07:31:06.272 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-07T07:31:06.273 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-07T07:31:06.276 INFO:tasks.ceph.mds.b:Started 2024-03-07T07:31:06.276 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-07T07:31:06.276 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-07T07:31:06.279 INFO:tasks.ceph.mds.d:Started 2024-03-07T07:31:06.280 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-07T07:31:06.280 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:06.370 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2024-03-07T07:31:06.372 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2024-03-07T07:31:06.384 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2024-03-07T07:31:06.384 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2024-03-07T07:31:06.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f649be00640 1 Processor -- start 2024-03-07T07:31:06.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f649be00640 1 -- start start 2024-03-07T07:31:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f649be00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64940b08d0 0x7f64940cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f649be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6494071600 0x7f64940cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f649be00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64940724f0 con 0x7f6494147d10 2024-03-07T07:31:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f649be00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64941480f0 con 0x7f64940b08d0 2024-03-07T07:31:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f649be00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64940b0f80 con 0x7f6494071600 2024-03-07T07:31:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6498a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64940b08d0 0x7f64940cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6499400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6494147d10 0x7f64940b01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35512/0 (socket says 172.21.15.84:35512) 2024-03-07T07:31:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6499400640 1 -- 172.21.15.84:0/1430071483 learned_addr learned my addr 172.21.15.84:0/1430071483 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6499e00640 1 --2- 172.21.15.84:0/1430071483 >> v2:172.21.15.161:3300/0 conn(0x7f6494071600 0x7f64940cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6498a00640 1 -- 172.21.15.84:0/1430071483 >> v2:172.21.15.161:3300/0 conn(0x7f6494071600 msgr2=0x7f64940cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6498a00640 1 --2- 172.21.15.84:0/1430071483 >> v2:172.21.15.161:3300/0 conn(0x7f6494071600 0x7f64940cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6498a00640 1 -- 172.21.15.84:0/1430071483 >> v1:172.21.15.84:6789/0 conn(0x7f6494147d10 legacy=0x7f64940b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6498a00640 1 -- 172.21.15.84:0/1430071483 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940732f0 con 0x7f64940b08d0 2024-03-07T07:31:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.423+0000 7f6493e00640 1 -- 172.21.15.84:0/1430071483 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837249330 0 0) 0x7f6488001120 con 0x7f6494147d10 2024-03-07T07:31:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f6498a00640 1 --2- 172.21.15.84:0/1430071483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f64940cf7b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f649406f5e0 tx=0x7f648001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41944421d3e992 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f6493e00640 1 -- 172.21.15.84:0/1430071483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800ab650 con 0x7f64940b08d0 2024-03-07T07:31:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f6493e00640 1 -- 172.21.15.84:0/1430071483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64800b0070 con 0x7f64940b08d0 2024-03-07T07:31:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f6493e00640 1 -- 172.21.15.84:0/1430071483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800aba10 con 0x7f64940b08d0 2024-03-07T07:31:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f649be00640 1 -- 172.21.15.84:0/1430071483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 msgr2=0x7f64940cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f649be00640 1 --2- 172.21.15.84:0/1430071483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f64940cf7b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f649406f5e0 tx=0x7f648001c450 comp rx=0 tx=0).stop 2024-03-07T07:31:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f649be00640 1 -- 172.21.15.84:0/1430071483 shutdown_connections 2024-03-07T07:31:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f649be00640 1 --2- 172.21.15.84:0/1430071483 >> v2:172.21.15.161:3300/0 conn(0x7f6494071600 0x7f64940cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f649be00640 1 --2- 172.21.15.84:0/1430071483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f64940cf7b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f649be00640 1 -- 172.21.15.84:0/1430071483 >> 172.21.15.84:0/1430071483 conn(0x7f64940b1ed0 msgr2=0x7f64940b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f649be00640 1 -- 172.21.15.84:0/1430071483 shutdown_connections 2024-03-07T07:31:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.427+0000 7f649be00640 1 -- 172.21.15.84:0/1430071483 wait complete. 2024-03-07T07:31:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 Processor -- start 2024-03-07T07:31:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 -- start start 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6494071600 0x7f649413ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f649413d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6494147d10 0x7f649415b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649416af60 con 0x7f64940b08d0 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6494073010 con 0x7f6494147d10 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649416b0e0 con 0x7f6494071600 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f649413d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f649413d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56882/0 (socket says 172.21.15.84:56882) 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 -- 172.21.15.84:0/1972546755 learned_addr learned my addr 172.21.15.84:0/1972546755 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6499400640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6494071600 0x7f649413ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6499e00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6494147d10 0x7f649415b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 -- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6494071600 msgr2=0x7f649413ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6494071600 0x7f649413ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 -- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6494147d10 msgr2=0x7f649415b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6494147d10 0x7f649415b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 -- 172.21.15.84:0/1972546755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494144130 con 0x7f64940b08d0 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6499e00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6494147d10 0x7f649415b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6498a00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f649413d700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64800ad040 tx=0x7f648001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6491600640 1 -- 172.21.15.84:0/1972546755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800bf610 con 0x7f64940b08d0 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6491600640 1 -- 172.21.15.84:0/1972546755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64800bf7d0 con 0x7f64940b08d0 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f6491600640 1 -- 172.21.15.84:0/1972546755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800bfbc0 con 0x7f64940b08d0 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6494143b70 con 0x7f64940b08d0 2024-03-07T07:31:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6494144590 con 0x7f64940b08d0 2024-03-07T07:31:06.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.431+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6494062d40 con 0x7f64940b08d0 2024-03-07T07:31:06.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.435+0000 7f6491600640 1 -- 172.21.15.84:0/1972546755 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f64800bd020 con 0x7f64940b08d0 2024-03-07T07:31:06.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.435+0000 7f6491600640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6474066f90 0x7f6474069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.435+0000 7f6491600640 1 -- 172.21.15.84:0/1972546755 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f648011f6a0 con 0x7f64940b08d0 2024-03-07T07:31:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.435+0000 7f6499400640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6474066f90 0x7f6474069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.435+0000 7f6499400640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6474066f90 0x7f6474069450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6488000f70 tx=0x7f6488007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.439+0000 7f6491600640 1 -- 172.21.15.84:0/1972546755 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6480016070 con 0x7f64940b08d0 2024-03-07T07:31:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.595+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64940b0340 con 0x7f64940b08d0 2024-03-07T07:31:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f6491600640 1 -- 172.21.15.84:0/1972546755 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12848 (secure 0 0 0) 0x7f64800f0420 con 0x7f64940b08d0 2024-03-07T07:31:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:06.601 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:01.463222+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6474066f90 msgr2=0x7f6474069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6474066f90 0x7f6474069450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6488000f70 tx=0x7f6488007df0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 msgr2=0x7f649413d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f649413d700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64800ad040 tx=0x7f648001ac90 comp rx=0 tx=0).stop 2024-03-07T07:31:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 shutdown_connections 2024-03-07T07:31:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6474066f90 0x7f6474069450 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6494147d10 0x7f649415b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64940b08d0 0x7f649413d700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 --2- 172.21.15.84:0/1972546755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6494071600 0x7f649413ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 >> 172.21.15.84:0/1972546755 conn(0x7f64940b1ed0 msgr2=0x7f649406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 shutdown_connections 2024-03-07T07:31:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.599+0000 7f649be00640 1 -- 172.21.15.84:0/1972546755 wait complete. 2024-03-07T07:31:06.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:06.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.755+0000 7f8ce0e00640 1 Processor -- start 2024-03-07T07:31:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8ce0e00640 1 -- start start 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8ce0e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8cdc147830 0x7f8cdc162620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc0b5aa0 0x7f8cdc0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8ce0e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8cdc0b5f00 0x7f8cdc0aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8ce0e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc162b60 con 0x7f8cdc0b5f00 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8ce0e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc0b4a00 con 0x7f8cdc147830 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8ce0e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0b4ce0 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cda800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8cdc0b5f00 0x7f8cdc0aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cda800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8cdc0b5f00 0x7f8cdc0aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56888/0 (socket says 172.21.15.84:56888) 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cda800640 1 -- 172.21.15.84:0/1417855590 learned_addr learned my addr 172.21.15.84:0/1417855590 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cd9e00640 1 --2- 172.21.15.84:0/1417855590 >> v2:172.21.15.161:3300/0 conn(0x7f8cdc147830 0x7f8cdc162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cd3e00640 1 --2- 172.21.15.84:0/1417855590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc0b5aa0 0x7f8cdc0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cda800640 1 -- 172.21.15.84:0/1417855590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc0b5aa0 msgr2=0x7f8cdc0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cda800640 1 --2- 172.21.15.84:0/1417855590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc0b5aa0 0x7f8cdc0ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cda800640 1 -- 172.21.15.84:0/1417855590 >> v2:172.21.15.161:3300/0 conn(0x7f8cdc147830 msgr2=0x7f8cdc162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cda800640 1 --2- 172.21.15.84:0/1417855590 >> v2:172.21.15.161:3300/0 conn(0x7f8cdc147830 0x7f8cdc162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.759+0000 7f8cda800640 1 -- 172.21.15.84:0/1417855590 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0b4fc0 con 0x7f8cdc0b5f00 2024-03-07T07:31:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8cda800640 1 --2- 172.21.15.84:0/1417855590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5f00 0x7f8cdc0aeb50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc09ee40 tx=0x7f8cd401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3078a413bf09254 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8cd9400640 1 -- 172.21.15.84:0/1417855590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40a5760 con 0x7f8cdc0b5f00 2024-03-07T07:31:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8cd9400640 1 -- 172.21.15.84:0/1417855590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd40a5900 con 0x7f8cdc0b5f00 2024-03-07T07:31:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8cd9400640 1 -- 172.21.15.84:0/1417855590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40a5cd0 con 0x7f8cdc0b5f00 2024-03-07T07:31:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 -- 172.21.15.84:0/1417855590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5f00 msgr2=0x7f8cdc0aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/1417855590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5f00 0x7f8cdc0aeb50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc09ee40 tx=0x7f8cd401c9f0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 -- 172.21.15.84:0/1417855590 shutdown_connections 2024-03-07T07:31:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/1417855590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5f00 0x7f8cdc0aeb50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/1417855590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc0b5aa0 0x7f8cdc0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/1417855590 >> v2:172.21.15.161:3300/0 conn(0x7f8cdc147830 0x7f8cdc162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 -- 172.21.15.84:0/1417855590 >> 172.21.15.84:0/1417855590 conn(0x7f8cdc06b0f0 msgr2=0x7f8cdc06b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 -- 172.21.15.84:0/1417855590 shutdown_connections 2024-03-07T07:31:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 -- 172.21.15.84:0/1417855590 wait complete. 2024-03-07T07:31:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 Processor -- start 2024-03-07T07:31:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.763+0000 7f8ce0e00640 1 -- start start 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5aa0 0x7f8cdc15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cdc0b5f00 0x7f8cdc1449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc147830 0x7f8cdc144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0b47a0 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0b4620 con 0x7f8cdc0b5f00 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc06e3d0 con 0x7f8cdc147830 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5aa0 0x7f8cdc15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5aa0 0x7f8cdc15bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56902/0 (socket says 172.21.15.84:56902) 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 -- 172.21.15.84:0/2999537067 learned_addr learned my addr 172.21.15.84:0/2999537067 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 -- 172.21.15.84:0/2999537067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc147830 msgr2=0x7f8cdc144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc147830 0x7f8cdc144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 -- 172.21.15.84:0/2999537067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cdc0b5f00 msgr2=0x7f8cdc1449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cdc0b5f00 0x7f8cdc1449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 -- 172.21.15.84:0/2999537067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc13f940 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd9e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5aa0 0x7f8cdc15bb40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00d620 tx=0x7f8ccc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd2000640 1 -- 172.21.15.84:0/2999537067 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00b620 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd2000640 1 -- 172.21.15.84:0/2999537067 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc019070 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd2000640 1 -- 172.21.15.84:0/2999537067 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00b9e0 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc13f0d0 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc1615b0 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc062d40 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.767+0000 7f8cd2000640 1 -- 172.21.15.84:0/2999537067 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f8ccc00bb80 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.771+0000 7f8cd2000640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8cb8066f60 0x7f8cb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:06.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.771+0000 7f8cd2000640 1 -- 172.21.15.84:0/2999537067 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8ccc084fc0 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.771+0000 7f8cd3e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8cb8066f60 0x7f8cb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:06.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.771+0000 7f8cd3e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8cb8066f60 0x7f8cb8069420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc1435a0 tx=0x7f8cc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:06.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.775+0000 7f8cd2000640 1 -- 172.21.15.84:0/2999537067 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f8ccc0563b0 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cdc13f690 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8cd2000640 1 -- 172.21.15.84:0/2999537067 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ccc055cb0 con 0x7f8cdc0b5aa0 2024-03-07T07:31:06.933 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8cb8066f60 msgr2=0x7f8cb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8cb8066f60 0x7f8cb8069420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc1435a0 tx=0x7f8cc4008040 comp rx=0 tx=0).stop 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5aa0 msgr2=0x7f8cdc15bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5aa0 0x7f8cdc15bb40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00d620 tx=0x7f8ccc00dae0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 shutdown_connections 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8cb8066f60 0x7f8cb8069420 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8cdc147830 0x7f8cdc144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cdc0b5f00 0x7f8cdc1449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 --2- 172.21.15.84:0/2999537067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0b5aa0 0x7f8cdc15bb40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 >> 172.21.15.84:0/2999537067 conn(0x7f8cdc06b0f0 msgr2=0x7f8cdc143840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 shutdown_connections 2024-03-07T07:31:06.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:06.931+0000 7f8ce0e00640 1 -- 172.21.15.84:0/2999537067 wait complete. 2024-03-07T07:31:06.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.083+0000 7f8deda00640 1 Processor -- start 2024-03-07T07:31:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.083+0000 7f8deda00640 1 -- start start 2024-03-07T07:31:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8deda00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de8145a30 0x7f8de80729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8deda00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8de80a9540 0x7f8de8072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8deda00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8de806d230 0x7f8de80ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8deda00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de806d780 con 0x7f8de806d230 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8deda00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de806da60 con 0x7f8de80a9540 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8deda00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de806dd40 con 0x7f8de8145a30 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8de806d230 0x7f8de80ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8de806d230 0x7f8de80ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56910/0 (socket says 172.21.15.84:56910) 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 -- 172.21.15.84:0/3296092229 learned_addr learned my addr 172.21.15.84:0/3296092229 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de6a00640 1 --2- 172.21.15.84:0/3296092229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de8145a30 0x7f8de80729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 -- 172.21.15.84:0/3296092229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de8145a30 msgr2=0x7f8de80729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8dde000640 1 --2- 172.21.15.84:0/3296092229 >> v2:172.21.15.161:3300/0 conn(0x7f8de80a9540 0x7f8de8072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 --2- 172.21.15.84:0/3296092229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de8145a30 0x7f8de80729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 -- 172.21.15.84:0/3296092229 >> v2:172.21.15.161:3300/0 conn(0x7f8de80a9540 msgr2=0x7f8de8072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 --2- 172.21.15.84:0/3296092229 >> v2:172.21.15.161:3300/0 conn(0x7f8de80a9540 0x7f8de8072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 -- 172.21.15.84:0/3296092229 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de806e020 con 0x7f8de806d230 2024-03-07T07:31:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8dde000640 1 --2- 172.21.15.84:0/3296092229 >> v2:172.21.15.161:3300/0 conn(0x7f8de80a9540 0x7f8de8072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de6a00640 1 --2- 172.21.15.84:0/3296092229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de8145a30 0x7f8de80729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de7400640 1 --2- 172.21.15.84:0/3296092229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de806d230 0x7f8de80ceb80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8de8073880 tx=0x7f8de001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f64c62ba4c257a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de6000640 1 -- 172.21.15.84:0/3296092229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00a5660 con 0x7f8de806d230 2024-03-07T07:31:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.087+0000 7f8de6000640 1 -- 172.21.15.84:0/3296092229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00a5800 con 0x7f8de806d230 2024-03-07T07:31:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de6000640 1 -- 172.21.15.84:0/3296092229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00a5bd0 con 0x7f8de806d230 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- 172.21.15.84:0/3296092229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de806d230 msgr2=0x7f8de80ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 --2- 172.21.15.84:0/3296092229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de806d230 0x7f8de80ceb80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8de8073880 tx=0x7f8de001c8d0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- 172.21.15.84:0/3296092229 shutdown_connections 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 --2- 172.21.15.84:0/3296092229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de806d230 0x7f8de80ceb80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 --2- 172.21.15.84:0/3296092229 >> v2:172.21.15.161:3300/0 conn(0x7f8de80a9540 0x7f8de8072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 --2- 172.21.15.84:0/3296092229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de8145a30 0x7f8de80729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- 172.21.15.84:0/3296092229 >> 172.21.15.84:0/3296092229 conn(0x7f8de80704b0 msgr2=0x7f8de80708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- 172.21.15.84:0/3296092229 shutdown_connections 2024-03-07T07:31:07.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- 172.21.15.84:0/3296092229 wait complete. 2024-03-07T07:31:07.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 Processor -- start 2024-03-07T07:31:07.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- start start 2024-03-07T07:31:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de806d230 0x7f8de80ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de8145a30 0x7f8de81442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:07.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de80cb720 0x7f8de80cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de815cb70 con 0x7f8de80cb720 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de815c9f0 con 0x7f8de8145a30 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8deda00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de815ccf0 con 0x7f8de806d230 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de80cb720 0x7f8de80cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de80cb720 0x7f8de80cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56918/0 (socket says 172.21.15.84:56918) 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de7400640 1 -- 172.21.15.84:0/1408038366 learned_addr learned my addr 172.21.15.84:0/1408038366 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de6a00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de806d230 0x7f8de80ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8dde000640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de8145a30 0x7f8de81442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de7400640 1 -- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de806d230 msgr2=0x7f8de80ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de7400640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de806d230 0x7f8de80ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de7400640 1 -- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de8145a30 msgr2=0x7f8de81442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de7400640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de8145a30 0x7f8de81442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de7400640 1 -- 172.21.15.84:0/1408038366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de80cc0d0 con 0x7f8de80cb720 2024-03-07T07:31:07.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8dde000640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de8145a30 0x7f8de81442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.091+0000 7f8de6a00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de806d230 0x7f8de80ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8de7400640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de80cb720 0x7f8de80cbb90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8de001af80 tx=0x7f8de0019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8ddf400640 1 -- 172.21.15.84:0/1408038366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00bc020 con 0x7f8de80cb720 2024-03-07T07:31:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8ddf400640 1 -- 172.21.15.84:0/1408038366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0007bb0 con 0x7f8de80cb720 2024-03-07T07:31:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8ddf400640 1 -- 172.21.15.84:0/1408038366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00a5660 con 0x7f8de80cb720 2024-03-07T07:31:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de80cd5f0 con 0x7f8de80cb720 2024-03-07T07:31:07.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de80aad50 con 0x7f8de80cb720 2024-03-07T07:31:07.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de8062d40 con 0x7f8de80cb720 2024-03-07T07:31:07.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8ddf400640 1 -- 172.21.15.84:0/1408038366 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f8de00bf020 con 0x7f8de80cb720 2024-03-07T07:31:07.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8ddf400640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8dc4066f90 0x7f8dc4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:07.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8ddf400640 1 -- 172.21.15.84:0/1408038366 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8de01203d0 con 0x7f8de80cb720 2024-03-07T07:31:07.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.095+0000 7f8de6a00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8dc4066f90 0x7f8dc4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:07.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.099+0000 7f8de6a00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8dc4066f90 0x7f8dc4069450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800b840 tx=0x7f8dd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:07.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.099+0000 7f8ddf400640 1 -- 172.21.15.84:0/1408038366 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f8de00c6030 con 0x7f8de80cb720 2024-03-07T07:31:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8de80afc30 con 0x7f8de80cb720 2024-03-07T07:31:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8ddf400640 1 -- 172.21.15.84:0/1408038366 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f8de00165e0 con 0x7f8de80cb720 2024-03-07T07:31:07.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:07.293 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-07T07:31:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8dc4066f90 msgr2=0x7f8dc4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8dc4066f90 0x7f8dc4069450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800b840 tx=0x7f8dd8008040 comp rx=0 tx=0).stop 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de80cb720 msgr2=0x7f8de80cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de80cb720 0x7f8de80cbb90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8de001af80 tx=0x7f8de0019670 comp rx=0 tx=0).stop 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 shutdown_connections 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8dc4066f90 0x7f8dc4069450 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de80cb720 0x7f8de80cbb90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de8145a30 0x7f8de81442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 --2- 172.21.15.84:0/1408038366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de806d230 0x7f8de80ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 >> 172.21.15.84:0/1408038366 conn(0x7f8de80704b0 msgr2=0x7f8de8070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:07.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 shutdown_connections 2024-03-07T07:31:07.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:07.291+0000 7f8deda00640 1 -- 172.21.15.84:0/1408038366 wait complete. 2024-03-07T07:31:09.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.455+0000 7fa771e00640 1 Processor -- start 2024-03-07T07:31:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.455+0000 7fa771e00640 1 -- start start 2024-03-07T07:31:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa771e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa76c15abb0 0x7fa76c0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa771e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa76c0b39c0 0x7fa76c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa771e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0cdd60 con 0x7fa76c15b4d0 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa771e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c154e10 con 0x7fa76c15abb0 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa771e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c06cfc0 con 0x7fa76c0b39c0 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa770a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa76c15abb0 0x7fa76c0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa770a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa76c15abb0 0x7fa76c0cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56922/0 (socket says 172.21.15.84:56922) 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa770a00640 1 -- 172.21.15.84:0/2367429287 learned_addr learned my addr 172.21.15.84:0/2367429287 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa763e00640 1 --2- 172.21.15.84:0/2367429287 >> v2:172.21.15.161:3300/0 conn(0x7fa76c0b39c0 0x7fa76c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa770a00640 1 -- 172.21.15.84:0/2367429287 >> v2:172.21.15.161:3300/0 conn(0x7fa76c0b39c0 msgr2=0x7fa76c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa770a00640 1 --2- 172.21.15.84:0/2367429287 >> v2:172.21.15.161:3300/0 conn(0x7fa76c0b39c0 0x7fa76c15af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa770a00640 1 -- 172.21.15.84:0/2367429287 >> v1:172.21.15.161:6789/0 conn(0x7fa76c15b4d0 legacy=0x7fa76c06da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa770a00640 1 -- 172.21.15.84:0/2367429287 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0cdfe0 con 0x7fa76c15abb0 2024-03-07T07:31:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.459+0000 7fa763e00640 1 --2- 172.21.15.84:0/2367429287 >> v2:172.21.15.161:3300/0 conn(0x7fa76c0b39c0 0x7fa76c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa770a00640 1 --2- 172.21.15.84:0/2367429287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c0cd820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa76c06cd80 tx=0x7fa75c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eed734392a19cb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa76be00640 1 -- 172.21.15.84:0/2367429287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0b0070 con 0x7fa76c15abb0 2024-03-07T07:31:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa76be00640 1 -- 172.21.15.84:0/2367429287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0ab600 con 0x7fa76c15abb0 2024-03-07T07:31:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa76be00640 1 -- 172.21.15.84:0/2367429287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0ab9d0 con 0x7fa76c15abb0 2024-03-07T07:31:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 -- 172.21.15.84:0/2367429287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 msgr2=0x7fa76c0cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 --2- 172.21.15.84:0/2367429287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c0cd820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa76c06cd80 tx=0x7fa75c01c520 comp rx=0 tx=0).stop 2024-03-07T07:31:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 -- 172.21.15.84:0/2367429287 shutdown_connections 2024-03-07T07:31:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 --2- 172.21.15.84:0/2367429287 >> v2:172.21.15.161:3300/0 conn(0x7fa76c0b39c0 0x7fa76c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 --2- 172.21.15.84:0/2367429287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c0cd820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 -- 172.21.15.84:0/2367429287 >> 172.21.15.84:0/2367429287 conn(0x7fa76c0b2ea0 msgr2=0x7fa76c0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 -- 172.21.15.84:0/2367429287 shutdown_connections 2024-03-07T07:31:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 -- 172.21.15.84:0/2367429287 wait complete. 2024-03-07T07:31:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 Processor -- start 2024-03-07T07:31:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.463+0000 7fa771e00640 1 -- start start 2024-03-07T07:31:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76c0b39c0 0x7fa76c158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa76c15b4d0 0x7fa76c1620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c06e4f0 con 0x7fa76c15abb0 2024-03-07T07:31:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c06e370 con 0x7fa76c0b39c0 2024-03-07T07:31:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c06e670 con 0x7fa76c15b4d0 2024-03-07T07:31:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c15cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56926/0 (socket says 172.21.15.84:56926) 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 -- 172.21.15.84:0/1382895407 learned_addr learned my addr 172.21.15.84:0/1382895407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa770a00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76c0b39c0 0x7fa76c158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771400640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa76c15b4d0 0x7fa76c1620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 -- 172.21.15.84:0/1382895407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa76c15b4d0 msgr2=0x7fa76c1620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa76c15b4d0 0x7fa76c1620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 -- 172.21.15.84:0/1382895407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76c0b39c0 msgr2=0x7fa76c158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76c0b39c0 0x7fa76c158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 -- 172.21.15.84:0/1382895407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0b1800 con 0x7fa76c15abb0 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa763e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c15cb70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa75400e810 tx=0x7fa75400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa769600640 1 -- 172.21.15.84:0/1382895407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754017070 con 0x7fa76c15abb0 2024-03-07T07:31:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa769600640 1 -- 172.21.15.84:0/1382895407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75400c8d0 con 0x7fa76c15abb0 2024-03-07T07:31:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa769600640 1 -- 172.21.15.84:0/1382895407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400f040 con 0x7fa76c15abb0 2024-03-07T07:31:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c138400 con 0x7fa76c15abb0 2024-03-07T07:31:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c138ca0 con 0x7fa76c15abb0 2024-03-07T07:31:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c062d40 con 0x7fa76c15abb0 2024-03-07T07:31:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.467+0000 7fa769600640 1 -- 172.21.15.84:0/1382895407 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa75401a070 con 0x7fa76c15abb0 2024-03-07T07:31:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.471+0000 7fa769600640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa748066f60 0x7fa748069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.471+0000 7fa769600640 1 -- 172.21.15.84:0/1382895407 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa754084860 con 0x7fa76c15abb0 2024-03-07T07:31:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.471+0000 7fa770a00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa748066f60 0x7fa748069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.471+0000 7fa770a00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa748066f60 0x7fa748069420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0ad000 tx=0x7fa75c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.475+0000 7fa769600640 1 -- 172.21.15.84:0/1382895407 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa754055560 con 0x7fa76c15abb0 2024-03-07T07:31:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa76c1590a0 con 0x7fa76c15abb0 2024-03-07T07:31:09.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa769600640 1 -- 172.21.15.84:0/1382895407 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7fa754059600 con 0x7fa76c15abb0 2024-03-07T07:31:09.662 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:09.662 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-07T07:31:09.662 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa748066f60 msgr2=0x7fa748069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa748066f60 0x7fa748069420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0ad000 tx=0x7fa75c008040 comp rx=0 tx=0).stop 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 msgr2=0x7fa76c15cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c15cb70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa75400e810 tx=0x7fa75400ecd0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 shutdown_connections 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa748066f60 0x7fa748069420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa76c15b4d0 0x7fa76c1620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c15abb0 0x7fa76c15cb70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 --2- 172.21.15.84:0/1382895407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76c0b39c0 0x7fa76c158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 >> 172.21.15.84:0/1382895407 conn(0x7fa76c0b2ea0 msgr2=0x7fa76c15a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 shutdown_connections 2024-03-07T07:31:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.659+0000 7fa771e00640 1 -- 172.21.15.84:0/1382895407 wait complete. 2024-03-07T07:31:09.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:09.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f3376600640 1 Processor -- start 2024-03-07T07:31:09.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f3376600640 1 -- start start 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f3376600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3370147d10 0x7f33700b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f3376600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370071600 0x7f33700b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f3376600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33700724f0 con 0x7f33700b3a00 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f3376600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33701480f0 con 0x7f3370147d10 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f3376600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33700b0f80 con 0x7f3370071600 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f336f400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3370147d10 0x7f33700b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f336fe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f33700b3a00 0x7f33700aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35524/0 (socket says 172.21.15.84:35524) 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f336fe00640 1 -- 172.21.15.84:0/1514027084 learned_addr learned my addr 172.21.15.84:0/1514027084 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f3366a00640 1 --2- 172.21.15.84:0/1514027084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370071600 0x7f33700b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f336f400640 1 -- 172.21.15.84:0/1514027084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370071600 msgr2=0x7f33700b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f336f400640 1 --2- 172.21.15.84:0/1514027084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370071600 0x7f33700b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f336f400640 1 -- 172.21.15.84:0/1514027084 >> v1:172.21.15.84:6789/0 conn(0x7f33700b3a00 legacy=0x7f33700aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f336f400640 1 -- 172.21.15.84:0/1514027084 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700732f0 con 0x7f3370147d10 2024-03-07T07:31:09.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.815+0000 7f336ea00640 1 -- 172.21.15.84:0/1514027084 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118465137 0 0) 0x7f33680014a0 con 0x7f33700b3a00 2024-03-07T07:31:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f336f400640 1 --2- 172.21.15.84:0/1514027084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370147d10 0x7f33700b01c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33600097c0 tx=0x7f336001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d567f199e0b10fe8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f336ea00640 1 -- 172.21.15.84:0/1514027084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600b5070 con 0x7f3370147d10 2024-03-07T07:31:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f336ea00640 1 -- 172.21.15.84:0/1514027084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33600a8990 con 0x7f3370147d10 2024-03-07T07:31:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f336ea00640 1 -- 172.21.15.84:0/1514027084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600a8d60 con 0x7f3370147d10 2024-03-07T07:31:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f3376600640 1 -- 172.21.15.84:0/1514027084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370147d10 msgr2=0x7f33700b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f3376600640 1 --2- 172.21.15.84:0/1514027084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370147d10 0x7f33700b01c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33600097c0 tx=0x7f336001ec90 comp rx=0 tx=0).stop 2024-03-07T07:31:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f3376600640 1 -- 172.21.15.84:0/1514027084 shutdown_connections 2024-03-07T07:31:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f3376600640 1 --2- 172.21.15.84:0/1514027084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370071600 0x7f33700b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f3376600640 1 --2- 172.21.15.84:0/1514027084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370147d10 0x7f33700b01c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f3376600640 1 -- 172.21.15.84:0/1514027084 >> 172.21.15.84:0/1514027084 conn(0x7f33700b1ed0 msgr2=0x7f33700b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f3376600640 1 -- 172.21.15.84:0/1514027084 shutdown_connections 2024-03-07T07:31:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.819+0000 7f3376600640 1 -- 172.21.15.84:0/1514027084 wait complete. 2024-03-07T07:31:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 Processor -- start 2024-03-07T07:31:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 -- start start 2024-03-07T07:31:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370071600 0x7f337015de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700b3a00 0x7f33700b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370147d10 0x7f337013cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370072d30 con 0x7f3370071600 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370072a50 con 0x7f33700b3a00 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3370073010 con 0x7f3370147d10 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370071600 0x7f337015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370071600 0x7f337015de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56952/0 (socket says 172.21.15.84:56952) 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 -- 172.21.15.84:0/753789682 learned_addr learned my addr 172.21.15.84:0/753789682 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 -- 172.21.15.84:0/753789682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370147d10 msgr2=0x7f337013cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370147d10 0x7f337013cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 -- 172.21.15.84:0/753789682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700b3a00 msgr2=0x7f33700b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700b3a00 0x7f33700b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 -- 172.21.15.84:0/753789682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337015e350 con 0x7f3370071600 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f336f400640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370071600 0x7f337015de10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33600b3040 tx=0x7f336001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3367e00640 1 -- 172.21.15.84:0/753789682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600bf070 con 0x7f3370071600 2024-03-07T07:31:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3367e00640 1 -- 172.21.15.84:0/753789682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33600b07a0 con 0x7f3370071600 2024-03-07T07:31:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3367e00640 1 -- 172.21.15.84:0/753789682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600b5040 con 0x7f3370071600 2024-03-07T07:31:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337013bf40 con 0x7f3370071600 2024-03-07T07:31:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337013c500 con 0x7f3370071600 2024-03-07T07:31:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.823+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3370062d40 con 0x7f3370071600 2024-03-07T07:31:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.827+0000 7f3367e00640 1 -- 172.21.15.84:0/753789682 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f33600b0b90 con 0x7f3370071600 2024-03-07T07:31:09.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.827+0000 7f3367e00640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f334c066f90 0x7f334c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:09.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.827+0000 7f3367e00640 1 -- 172.21.15.84:0/753789682 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33601216a0 con 0x7f3370071600 2024-03-07T07:31:09.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.827+0000 7f3366a00640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f334c066f90 0x7f334c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.827+0000 7f3366a00640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f334c066f90 0x7f334c069450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f33700b1740 tx=0x7f3358008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:09.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.831+0000 7f3367e00640 1 -- 172.21.15.84:0/753789682 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f33600187f0 con 0x7f3370071600 2024-03-07T07:31:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.987+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33700d1b90 con 0x7f3370071600 2024-03-07T07:31:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.987+0000 7f3367e00640 1 -- 172.21.15.84:0/753789682 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12848 (secure 0 0 0) 0x7f33600f28d0 con 0x7f3370071600 2024-03-07T07:31:09.992 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:09.992 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:01.463222+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:09.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f334c066f90 msgr2=0x7f334c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f334c066f90 0x7f334c069450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f33700b1740 tx=0x7f3358008040 comp rx=0 tx=0).stop 2024-03-07T07:31:09.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370071600 msgr2=0x7f337015de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:09.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370071600 0x7f337015de10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33600b3040 tx=0x7f336001ba30 comp rx=0 tx=0).stop 2024-03-07T07:31:09.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 shutdown_connections 2024-03-07T07:31:09.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f334c066f90 0x7f334c069450 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3370147d10 0x7f337013cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700b3a00 0x7f33700b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 --2- 172.21.15.84:0/753789682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370071600 0x7f337015de10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:09.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 >> 172.21.15.84:0/753789682 conn(0x7f33700b1ed0 msgr2=0x7f33700b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:09.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 shutdown_connections 2024-03-07T07:31:09.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:09.991+0000 7f3376600640 1 -- 172.21.15.84:0/753789682 wait complete. 2024-03-07T07:31:10.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:10.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8f01c00640 1 Processor -- start 2024-03-07T07:31:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8f01c00640 1 -- start start 2024-03-07T07:31:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8f01c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8efc147b50 0x7f8efc073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8f01c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc06d360 0x7f8efc071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8f01c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc073640 con 0x7f8efc15f210 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8f01c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc0cfa70 con 0x7f8efc147b50 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8f01c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0cfd50 con 0x7f8efc06d360 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8efaa00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8efc147b50 0x7f8efc073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8efaa00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8efc147b50 0x7f8efc073100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56964/0 (socket says 172.21.15.84:56964) 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8efaa00640 1 -- 172.21.15.84:0/1255148340 learned_addr learned my addr 172.21.15.84:0/1255148340 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8efb400640 1 --2- 172.21.15.84:0/1255148340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc06d360 0x7f8efc071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8efaa00640 1 -- 172.21.15.84:0/1255148340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc06d360 msgr2=0x7f8efc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8efaa00640 1 --2- 172.21.15.84:0/1255148340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc06d360 0x7f8efc071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8efaa00640 1 -- 172.21.15.84:0/1255148340 >> v1:172.21.15.161:6789/0 conn(0x7f8efc15f210 legacy=0x7f8efc06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.151+0000 7f8efaa00640 1 -- 172.21.15.84:0/1255148340 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0d1740 con 0x7f8efc147b50 2024-03-07T07:31:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8efaa00640 1 --2- 172.21.15.84:0/1255148340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc147b50 0x7f8efc073100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a74347efc7913d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8ef9600640 1 -- 172.21.15.84:0/1255148340 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0b0070 con 0x7f8efc147b50 2024-03-07T07:31:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8ef9600640 1 -- 172.21.15.84:0/1255148340 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0ab600 con 0x7f8efc147b50 2024-03-07T07:31:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8ef9600640 1 -- 172.21.15.84:0/1255148340 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0ab9d0 con 0x7f8efc147b50 2024-03-07T07:31:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8f01c00640 1 -- 172.21.15.84:0/1255148340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc147b50 msgr2=0x7f8efc073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8f01c00640 1 --2- 172.21.15.84:0/1255148340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc147b50 0x7f8efc073100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec01c410 comp rx=0 tx=0).stop 2024-03-07T07:31:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8f01c00640 1 -- 172.21.15.84:0/1255148340 shutdown_connections 2024-03-07T07:31:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8f01c00640 1 --2- 172.21.15.84:0/1255148340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc06d360 0x7f8efc071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8f01c00640 1 --2- 172.21.15.84:0/1255148340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc147b50 0x7f8efc073100 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8f01c00640 1 -- 172.21.15.84:0/1255148340 >> 172.21.15.84:0/1255148340 conn(0x7f8efc0b3aa0 msgr2=0x7f8efc0b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8f01c00640 1 -- 172.21.15.84:0/1255148340 shutdown_connections 2024-03-07T07:31:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.155+0000 7f8f01c00640 1 -- 172.21.15.84:0/1255148340 wait complete. 2024-03-07T07:31:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 Processor -- start 2024-03-07T07:31:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 -- start start 2024-03-07T07:31:10.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8efc06d360 0x7f8efc0b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc147b50 0x7f8efc156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc15f210 0x7f8efc13a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc072740 con 0x7f8efc15f210 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0725c0 con 0x7f8efc06d360 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0728c0 con 0x7f8efc147b50 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc15f210 0x7f8efc13a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc15f210 0x7f8efc13a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56978/0 (socket says 172.21.15.84:56978) 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 -- 172.21.15.84:0/3677192661 learned_addr learned my addr 172.21.15.84:0/3677192661 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efaa00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8efc06d360 0x7f8efc0b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efa000640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc147b50 0x7f8efc156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 -- 172.21.15.84:0/3677192661 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc147b50 msgr2=0x7f8efc156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc147b50 0x7f8efc156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 -- 172.21.15.84:0/3677192661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8efc06d360 msgr2=0x7f8efc0b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8efc06d360 0x7f8efc0b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 -- 172.21.15.84:0/3677192661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc13e0c0 con 0x7f8efc15f210 2024-03-07T07:31:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8efb400640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc15f210 0x7f8efc13a860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009fd0 tx=0x7f8ef400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8ef2a00640 1 -- 172.21.15.84:0/3677192661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4014420 con 0x7f8efc15f210 2024-03-07T07:31:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8ef2a00640 1 -- 172.21.15.84:0/3677192661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4019070 con 0x7f8efc15f210 2024-03-07T07:31:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc144d20 con 0x7f8efc15f210 2024-03-07T07:31:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8ef2a00640 1 -- 172.21.15.84:0/3677192661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4014800 con 0x7f8efc15f210 2024-03-07T07:31:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.159+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc15bb70 con 0x7f8efc15f210 2024-03-07T07:31:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.163+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc062d40 con 0x7f8efc15f210 2024-03-07T07:31:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.163+0000 7f8ef2a00640 1 -- 172.21.15.84:0/3677192661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f8ef40149a0 con 0x7f8efc15f210 2024-03-07T07:31:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.163+0000 7f8ef2a00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8edc066f90 0x7f8edc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.163+0000 7f8ef2a00640 1 -- 172.21.15.84:0/3677192661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8ef40852e0 con 0x7f8efc15f210 2024-03-07T07:31:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.163+0000 7f8efaa00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8edc066f90 0x7f8edc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.163+0000 7f8efaa00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8edc066f90 0x7f8edc069450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ad000 tx=0x7f8eec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.167+0000 7f8ef2a00640 1 -- 172.21.15.84:0/3677192661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f8ef4056080 con 0x7f8efc15f210 2024-03-07T07:31:10.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.323+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8efc146c30 con 0x7f8efc15f210 2024-03-07T07:31:10.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.323+0000 7f8ef2a00640 1 -- 172.21.15.84:0/3677192661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ef405a120 con 0x7f8efc15f210 2024-03-07T07:31:10.328 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8edc066f90 msgr2=0x7f8edc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8edc066f90 0x7f8edc069450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ad000 tx=0x7f8eec008040 comp rx=0 tx=0).stop 2024-03-07T07:31:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc15f210 msgr2=0x7f8efc13a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc15f210 0x7f8efc13a860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009fd0 tx=0x7f8ef400e4b0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 shutdown_connections 2024-03-07T07:31:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8edc066f90 0x7f8edc069450 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8efc15f210 0x7f8efc13a860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8efc147b50 0x7f8efc156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 --2- 172.21.15.84:0/3677192661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8efc06d360 0x7f8efc0b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 >> 172.21.15.84:0/3677192661 conn(0x7f8efc0b3aa0 msgr2=0x7f8efc0b6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 shutdown_connections 2024-03-07T07:31:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.327+0000 7f8f01c00640 1 -- 172.21.15.84:0/3677192661 wait complete. 2024-03-07T07:31:10.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-07T07:31:10.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.479+0000 7fe1e1c00640 1 Processor -- start 2024-03-07T07:31:10.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.479+0000 7fe1e1c00640 1 -- start start 2024-03-07T07:31:10.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1e1c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1dc0aab90 0x7fe1dc15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1e1c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1e1c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1dc0731e0 con 0x7fe1dc1586d0 2024-03-07T07:31:10.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1e1c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1dc073490 con 0x7fe1dc0aab90 2024-03-07T07:31:10.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1e1c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc161db0 con 0x7fe1dc072d60 2024-03-07T07:31:10.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1db400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1da000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1dc0aab90 0x7fe1dc15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1daa00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe1dc1586d0 0x7fe1dc0aa480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:51378/0 (socket says 172.21.15.84:51378) 2024-03-07T07:31:10.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1daa00640 1 -- 172.21.15.84:0/1623023499 learned_addr learned my addr 172.21.15.84:0/1623023499 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:10.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1db400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc0704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:55150/0 (socket says 172.21.15.84:55150) 2024-03-07T07:31:10.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1da000640 1 -- 172.21.15.84:0/1623023499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 msgr2=0x7fe1dc0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:10.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1da000640 1 --2- 172.21.15.84:0/1623023499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1da000640 1 -- 172.21.15.84:0/1623023499 >> v1:172.21.15.161:6789/0 conn(0x7fe1dc1586d0 legacy=0x7fe1dc0aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.483+0000 7fe1da000640 1 -- 172.21.15.84:0/1623023499 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc162090 con 0x7fe1dc0aab90 2024-03-07T07:31:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1da000640 1 --2- 172.21.15.84:0/1623023499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 0x7fe1dc15f250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80097c0 tx=0x7fe1c801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49cc2685ccbac562 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1d9600640 1 -- 172.21.15.84:0/1623023499 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80b2070 con 0x7fe1dc0aab90 2024-03-07T07:31:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1d9600640 1 -- 172.21.15.84:0/1623023499 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c80ad640 con 0x7fe1dc0aab90 2024-03-07T07:31:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1d9600640 1 -- 172.21.15.84:0/1623023499 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80ada10 con 0x7fe1dc0aab90 2024-03-07T07:31:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1623023499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 msgr2=0x7fe1dc15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1623023499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 0x7fe1dc15f250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80097c0 tx=0x7fe1c801c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1623023499 shutdown_connections 2024-03-07T07:31:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1623023499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1623023499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 0x7fe1dc15f250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1623023499 >> 172.21.15.84:0/1623023499 conn(0x7fe1dc072240 msgr2=0x7fe1dc072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1623023499 shutdown_connections 2024-03-07T07:31:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1623023499 wait complete. 2024-03-07T07:31:10.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 Processor -- start 2024-03-07T07:31:10.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 -- start start 2024-03-07T07:31:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.487+0000 7fe1e1c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc138730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1e1c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 0x7fe1dc0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1e1c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc1586d0 0x7fe1dc156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1e1c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc158c30 con 0x7fe1dc1586d0 2024-03-07T07:31:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1e1c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc158ab0 con 0x7fe1dc0aab90 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1e1c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc071200 con 0x7fe1dc072d60 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc1586d0 0x7fe1dc156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc1586d0 0x7fe1dc156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56982/0 (socket says 172.21.15.84:56982) 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 -- 172.21.15.84:0/1773293292 learned_addr learned my addr 172.21.15.84:0/1773293292 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1daa00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc138730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1da000640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 0x7fe1dc0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 -- 172.21.15.84:0/1773293292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 msgr2=0x7fe1dc138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc138730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 -- 172.21.15.84:0/1773293292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 msgr2=0x7fe1dc0b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 0x7fe1dc0b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 -- 172.21.15.84:0/1773293292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc0ced80 con 0x7fe1dc1586d0 2024-03-07T07:31:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1db400640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc1586d0 0x7fe1dc156ec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009d20 tx=0x7fe1d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1d2a00640 1 -- 172.21.15.84:0/1773293292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4018020 con 0x7fe1dc1586d0 2024-03-07T07:31:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1d2a00640 1 -- 172.21.15.84:0/1773293292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d4009b10 con 0x7fe1dc1586d0 2024-03-07T07:31:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1dc0b1e80 con 0x7fe1dc1586d0 2024-03-07T07:31:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1d2a00640 1 -- 172.21.15.84:0/1773293292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40146c0 con 0x7fe1dc1586d0 2024-03-07T07:31:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1dc0b2440 con 0x7fe1dc1586d0 2024-03-07T07:31:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1dc062d40 con 0x7fe1dc1586d0 2024-03-07T07:31:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.491+0000 7fe1d2a00640 1 -- 172.21.15.84:0/1773293292 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe1d401b020 con 0x7fe1dc1586d0 2024-03-07T07:31:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.495+0000 7fe1d2a00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe1bc066f90 0x7fe1bc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.495+0000 7fe1d2a00640 1 -- 172.21.15.84:0/1773293292 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe1d40855e0 con 0x7fe1dc1586d0 2024-03-07T07:31:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.495+0000 7fe1daa00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe1bc066f90 0x7fe1bc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.495+0000 7fe1daa00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe1bc066f90 0x7fe1bc069450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc000f70 tx=0x7fe1cc007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.499+0000 7fe1d2a00640 1 -- 172.21.15.84:0/1773293292 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe1d4022070 con 0x7fe1dc1586d0 2024-03-07T07:31:10.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.651+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe1dc067400 con 0x7fe1dc1586d0 2024-03-07T07:31:10.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.651+0000 7fe1d2a00640 1 -- 172.21.15.84:0/1773293292 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe1d4010040 con 0x7fe1dc1586d0 2024-03-07T07:31:10.657 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:10.657 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2024-03-07T07:31:10.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:31:10.657 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2024-03-07T07:31:10.657 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2024-03-07T07:31:10.657 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:31:10.657 INFO:teuthology.orchestra.run.smithi084.stdout:] 2024-03-07T07:31:10.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe1bc066f90 msgr2=0x7fe1bc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe1bc066f90 0x7fe1bc069450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc000f70 tx=0x7fe1cc007e90 comp rx=0 tx=0).stop 2024-03-07T07:31:10.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc1586d0 msgr2=0x7fe1dc156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc1586d0 0x7fe1dc156ec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009d20 tx=0x7fe1d400c490 comp rx=0 tx=0).stop 2024-03-07T07:31:10.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 shutdown_connections 2024-03-07T07:31:10.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe1bc066f90 0x7fe1bc069450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc1586d0 0x7fe1dc156ec0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1dc0aab90 0x7fe1dc0b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 --2- 172.21.15.84:0/1773293292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1dc072d60 0x7fe1dc138730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 >> 172.21.15.84:0/1773293292 conn(0x7fe1dc072240 msgr2=0x7fe1dc160f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:10.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 shutdown_connections 2024-03-07T07:31:10.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.655+0000 7fe1e1c00640 1 -- 172.21.15.84:0/1773293292 wait complete. 2024-03-07T07:31:10.677 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-07T07:31:10.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-07T07:31:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.811+0000 7f840dc00640 1 Processor -- start 2024-03-07T07:31:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.811+0000 7f840dc00640 1 -- start start 2024-03-07T07:31:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.811+0000 7f840dc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f84080ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f840dc00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840806f3a0 con 0x7f840806ed10 2024-03-07T07:31:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f840dc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84080d0400 con 0x7f84081621d0 2024-03-07T07:31:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f840dc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84080cfc10 con 0x7f840815e2a0 2024-03-07T07:31:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8406000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f840806ed10 0x7f840815e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35526/0 (socket says 172.21.15.84:35526) 2024-03-07T07:31:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8406000640 1 -- 172.21.15.84:0/3134157356 learned_addr learned my addr 172.21.15.84:0/3134157356 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8406a00640 1 --2- 172.21.15.84:0/3134157356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f84080ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8405600640 1 -- 172.21.15.84:0/3134157356 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746945605 0 0) 0x7f83f4001120 con 0x7f840806ed10 2024-03-07T07:31:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8405600640 1 -- 172.21.15.84:0/3134157356 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ec003530 con 0x7f840806ed10 2024-03-07T07:31:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8406a00640 1 -- 172.21.15.84:0/3134157356 >> v1:172.21.15.161:6789/0 conn(0x7f84081621d0 legacy=0x7f840806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8405600640 1 -- 172.21.15.84:0/3134157356 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325582133 0 0) 0x7f84080d0400 con 0x7f84081621d0 2024-03-07T07:31:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8406a00640 1 -- 172.21.15.84:0/3134157356 >> v1:172.21.15.84:6789/0 conn(0x7f840806ed10 legacy=0x7f840815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8406a00640 1 -- 172.21.15.84:0/3134157356 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84080cfe40 con 0x7f840815e2a0 2024-03-07T07:31:10.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.815+0000 7f8406a00640 1 --2- 172.21.15.84:0/3134157356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f84080ce3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009dc0 tx=0x7f83f801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20421ff129b1b18 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f8405600640 1 -- 172.21.15.84:0/3134157356 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80b2070 con 0x7f840815e2a0 2024-03-07T07:31:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f8405600640 1 -- 172.21.15.84:0/3134157356 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80a58b0 con 0x7f840815e2a0 2024-03-07T07:31:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f8405600640 1 -- 172.21.15.84:0/3134157356 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80a5c80 con 0x7f840815e2a0 2024-03-07T07:31:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- 172.21.15.84:0/3134157356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 msgr2=0x7f84080ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 --2- 172.21.15.84:0/3134157356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f84080ce3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009dc0 tx=0x7f83f801c900 comp rx=0 tx=0).stop 2024-03-07T07:31:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- 172.21.15.84:0/3134157356 shutdown_connections 2024-03-07T07:31:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 --2- 172.21.15.84:0/3134157356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f84080ce3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- 172.21.15.84:0/3134157356 >> 172.21.15.84:0/3134157356 conn(0x7f840806c2d0 msgr2=0x7f84080b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- 172.21.15.84:0/3134157356 shutdown_connections 2024-03-07T07:31:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- 172.21.15.84:0/3134157356 wait complete. 2024-03-07T07:31:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 Processor -- start 2024-03-07T07:31:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- start start 2024-03-07T07:31:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840806ed10 0x7f840814e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f840814b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84081621d0 0x7f8408160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840806e200 con 0x7f840806ed10 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840815ed90 con 0x7f84081621d0 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f840dc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840806e380 con 0x7f840815e2a0 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f8406a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840806ed10 0x7f840814e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f8406a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840806ed10 0x7f840814e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56990/0 (socket says 172.21.15.84:56990) 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f8406a00640 1 -- 172.21.15.84:0/1124202308 learned_addr learned my addr 172.21.15.84:0/1124202308 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f8406000640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f840814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.819+0000 7f8407400640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84081621d0 0x7f8408160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f8406a00640 1 -- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 msgr2=0x7f840814b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f8406a00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f840814b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f8406a00640 1 -- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84081621d0 msgr2=0x7f8408160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f8406a00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84081621d0 0x7f8408160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f8406a00640 1 -- 172.21.15.84:0/1124202308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840815f0b0 con 0x7f840806ed10 2024-03-07T07:31:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f8406000640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f840814b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f8406a00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840806ed10 0x7f840814e050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f83f801a530 tx=0x7f83f80196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f83fea00640 1 -- 172.21.15.84:0/1124202308 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80bd020 con 0x7f840806ed10 2024-03-07T07:31:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f83fea00640 1 -- 172.21.15.84:0/1124202308 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80b8470 con 0x7f840806ed10 2024-03-07T07:31:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f83fea00640 1 -- 172.21.15.84:0/1124202308 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80b2040 con 0x7f840806ed10 2024-03-07T07:31:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840815f350 con 0x7f840806ed10 2024-03-07T07:31:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840815f910 con 0x7f840806ed10 2024-03-07T07:31:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8408062d40 con 0x7f840806ed10 2024-03-07T07:31:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f83fea00640 1 -- 172.21.15.84:0/1124202308 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f83f80c0020 con 0x7f840806ed10 2024-03-07T07:31:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f83fea00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f83e8066f60 0x7f83e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.823+0000 7f83fea00640 1 -- 172.21.15.84:0/1124202308 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f83f811fc80 con 0x7f840806ed10 2024-03-07T07:31:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.827+0000 7f8406000640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f83e8066f60 0x7f83e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.827+0000 7f8406000640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f83e8066f60 0x7f83e8069420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8408155750 tx=0x7f83f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.831+0000 7f83fea00640 1 -- 172.21.15.84:0/1124202308 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f83f80c7030 con 0x7f840806ed10 2024-03-07T07:31:10.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:10.987+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f84081554a0 con 0x7f840806ed10 2024-03-07T07:31:11.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:31:11.171 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:31:11.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.967+0000 7f83fea00640 1 -- 172.21.15.84:0/1124202308 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f83f8016580 con 0x7f840806ed10 2024-03-07T07:31:11.972 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f83e8066f60 msgr2=0x7f83e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f83e8066f60 0x7f83e8069420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8408155750 tx=0x7f83f4009040 comp rx=0 tx=0).stop 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840806ed10 msgr2=0x7f840814e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840806ed10 0x7f840814e050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f83f801a530 tx=0x7f83f80196a0 comp rx=0 tx=0).stop 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 shutdown_connections 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f83e8066f60 0x7f83e8069420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84081621d0 0x7f8408160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f840815e2a0 0x7f840814b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 --2- 172.21.15.84:0/1124202308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840806ed10 0x7f840814e050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 >> 172.21.15.84:0/1124202308 conn(0x7f840806c2d0 msgr2=0x7f84081559c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 shutdown_connections 2024-03-07T07:31:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:11.971+0000 7f840dc00640 1 -- 172.21.15.84:0/1124202308 wait complete. 2024-03-07T07:31:12.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-07T07:31:12.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b73400640 1 Processor -- start 2024-03-07T07:31:12.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b73400640 1 -- start start 2024-03-07T07:31:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b73400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b73400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c0b51f0 con 0x7f5b6c0b3350 2024-03-07T07:31:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b73400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c06eec0 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b73400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c06f1a0 con 0x7f5b6c1442a0 2024-03-07T07:31:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b6be00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5b6c0b3350 0x7f5b6c0b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35000/0 (socket says 172.21.15.84:35000) 2024-03-07T07:31:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b6be00640 1 -- 172.21.15.84:0/109052753 learned_addr learned my addr 172.21.15.84:0/109052753 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:12.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b70a00640 1 --2- 172.21.15.84:0/109052753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:12.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b6b400640 1 -- 172.21.15.84:0/109052753 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451133314 0 0) 0x7f5b6c0b51f0 con 0x7f5b6c0b3350 2024-03-07T07:31:12.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b6b400640 1 -- 172.21.15.84:0/109052753 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b54003530 con 0x7f5b6c0b3350 2024-03-07T07:31:12.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b6b400640 1 -- 172.21.15.84:0/109052753 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979042158 0 0) 0x7f5b6c06eec0 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b6b400640 1 -- 172.21.15.84:0/109052753 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b6c0b51f0 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b70a00640 1 -- 172.21.15.84:0/109052753 >> v1:172.21.15.161:6789/0 conn(0x7f5b6c0b3ec0 legacy=0x7f5b6c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:12.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b70a00640 1 -- 172.21.15.84:0/109052753 >> v1:172.21.15.84:6789/0 conn(0x7f5b6c0b3350 legacy=0x7f5b6c0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:12.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.147+0000 7f5b70a00640 1 -- 172.21.15.84:0/109052753 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0cc800 con 0x7f5b6c1442a0 2024-03-07T07:31:12.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b70a00640 1 --2- 172.21.15.84:0/109052753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c0b4cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b600097f0 tx=0x7f5b6001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa66f339f068dae server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:12.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b6b400640 1 -- 172.21.15.84:0/109052753 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600ab600 con 0x7f5b6c1442a0 2024-03-07T07:31:12.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b6b400640 1 -- 172.21.15.84:0/109052753 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b600b0070 con 0x7f5b6c1442a0 2024-03-07T07:31:12.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b6b400640 1 -- 172.21.15.84:0/109052753 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600ab9c0 con 0x7f5b6c1442a0 2024-03-07T07:31:12.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b73400640 1 -- 172.21.15.84:0/109052753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 msgr2=0x7f5b6c0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:12.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b73400640 1 --2- 172.21.15.84:0/109052753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c0b4cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b600097f0 tx=0x7f5b6001c4e0 comp rx=0 tx=0).stop 2024-03-07T07:31:12.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b73400640 1 -- 172.21.15.84:0/109052753 shutdown_connections 2024-03-07T07:31:12.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b73400640 1 --2- 172.21.15.84:0/109052753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c0b4cb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:12.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b73400640 1 -- 172.21.15.84:0/109052753 >> 172.21.15.84:0/109052753 conn(0x7f5b6c0b1c50 msgr2=0x7f5b6c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:12.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b73400640 1 -- 172.21.15.84:0/109052753 shutdown_connections 2024-03-07T07:31:12.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.151+0000 7f5b73400640 1 -- 172.21.15.84:0/109052753 wait complete. 2024-03-07T07:31:12.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 Processor -- start 2024-03-07T07:31:12.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 -- start start 2024-03-07T07:31:12.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c0b3350 0x7f5b6c13b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:12.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6c0b3ec0 0x7f5b6c150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:12.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:12.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c168b60 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1689e0 con 0x7f5b6c0b3350 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c168ce0 con 0x7f5b6c1442a0 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6c0b3ec0 0x7f5b6c150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6c0b3ec0 0x7f5b6c150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38608/0 (socket says 172.21.15.84:38608) 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 -- 172.21.15.84:0/1597623012 learned_addr learned my addr 172.21.15.84:0/1597623012 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b70a00640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c0b3350 0x7f5b6c13b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b71400640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 -- 172.21.15.84:0/1597623012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 msgr2=0x7f5b6c15c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c15c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 -- 172.21.15.84:0/1597623012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c0b3350 msgr2=0x7f5b6c13b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c0b3350 0x7f5b6c13b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:12.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 -- 172.21.15.84:0/1597623012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c141da0 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b6be00640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6c0b3ec0 0x7f5b6c150a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c500 tx=0x7f5b5800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:12.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b68c00640 1 -- 172.21.15.84:0/1597623012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58017070 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b68c00640 1 -- 172.21.15.84:0/1597623012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58005cf0 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c142080 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b68c00640 1 -- 172.21.15.84:0/1597623012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58007330 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c142640 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.155+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c062d40 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.159+0000 7f5b68c00640 1 -- 172.21.15.84:0/1597623012 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f5b5801a070 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.159+0000 7f5b68c00640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5b4c066f60 0x7f5b4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:12.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.159+0000 7f5b68c00640 1 -- 172.21.15.84:0/1597623012 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5b58084240 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.159+0000 7f5b70a00640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5b4c066f60 0x7f5b4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:12.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.159+0000 7f5b70a00640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5b4c066f60 0x7f5b4c069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b600af000 tx=0x7f5b600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:12.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.163+0000 7f5b68c00640 1 -- 172.21.15.84:0/1597623012 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f5b58054dd0 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.315+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5b6c155f90 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.975+0000 7f5b68c00640 1 -- 172.21.15.84:0/1597623012 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5b5805b120 con 0x7f5b6c0b3ec0 2024-03-07T07:31:12.979 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2024-03-07T07:31:12.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5b4c066f60 msgr2=0x7f5b4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:12.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5b4c066f60 0x7f5b4c069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b600af000 tx=0x7f5b600a7000 comp rx=0 tx=0).stop 2024-03-07T07:31:12.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6c0b3ec0 msgr2=0x7f5b6c150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:12.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6c0b3ec0 0x7f5b6c150a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c500 tx=0x7f5b5800c9c0 comp rx=0 tx=0).stop 2024-03-07T07:31:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 shutdown_connections 2024-03-07T07:31:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5b4c066f60 0x7f5b4c069420 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b600af000 tx=0x7f5b600a7000 comp rx=0 tx=0).stop 2024-03-07T07:31:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b6c1442a0 0x7f5b6c15c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6c0b3ec0 0x7f5b6c150a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 --2- 172.21.15.84:0/1597623012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b6c0b3350 0x7f5b6c13b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 >> 172.21.15.84:0/1597623012 conn(0x7f5b6c0b1c50 msgr2=0x7f5b6c0af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 shutdown_connections 2024-03-07T07:31:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:12.979+0000 7f5b73400640 1 -- 172.21.15.84:0/1597623012 wait complete. 2024-03-07T07:31:13.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-07T07:31:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.163+0000 7f282b800640 1 Processor -- start 2024-03-07T07:31:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f282b800640 1 -- start start 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f282b800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 0x7f28240cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f282b800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28240b4a60 con 0x7f282415c3d0 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f282b800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28240b4d40 con 0x7f28240cdb20 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f282b800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28240719c0 con 0x7f2824145090 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2823e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f282415c3d0 0x7f28240cd410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35004/0 (socket says 172.21.15.84:35004) 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2823e00640 1 -- 172.21.15.84:0/3657126738 learned_addr learned my addr 172.21.15.84:0/3657126738 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2828e00640 1 --2- 172.21.15.84:0/3657126738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 0x7f28240cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2823400640 1 -- 172.21.15.84:0/3657126738 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242956930 0 0) 0x7f28240b4a60 con 0x7f282415c3d0 2024-03-07T07:31:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2823400640 1 -- 172.21.15.84:0/3657126738 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c003530 con 0x7f282415c3d0 2024-03-07T07:31:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2823400640 1 -- 172.21.15.84:0/3657126738 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925349339 0 0) 0x7f28240b4d40 con 0x7f28240cdb20 2024-03-07T07:31:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2823400640 1 -- 172.21.15.84:0/3657126738 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28240b4a60 con 0x7f28240cdb20 2024-03-07T07:31:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2823400640 1 -- 172.21.15.84:0/3657126738 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3731098797 0 0) 0x7f280c003530 con 0x7f282415c3d0 2024-03-07T07:31:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2828e00640 1 -- 172.21.15.84:0/3657126738 >> v1:172.21.15.161:6789/0 conn(0x7f28240cdb20 legacy=0x7f28240724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2828e00640 1 -- 172.21.15.84:0/3657126738 >> v1:172.21.15.84:6789/0 conn(0x7f282415c3d0 legacy=0x7f28240cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.167+0000 7f2828e00640 1 -- 172.21.15.84:0/3657126738 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2824071ca0 con 0x7f2824145090 2024-03-07T07:31:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f2828e00640 1 --2- 172.21.15.84:0/3657126738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 0x7f28240cf540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28180097f0 tx=0x7f281801c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187f3f01b206975c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f2823400640 1 -- 172.21.15.84:0/3657126738 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180b0070 con 0x7f2824145090 2024-03-07T07:31:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f2823400640 1 -- 172.21.15.84:0/3657126738 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28180ab400 con 0x7f2824145090 2024-03-07T07:31:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f2823400640 1 -- 172.21.15.84:0/3657126738 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810001600 con 0x7f2824145090 2024-03-07T07:31:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 -- 172.21.15.84:0/3657126738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 msgr2=0x7f28240cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 --2- 172.21.15.84:0/3657126738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 0x7f28240cf540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28180097f0 tx=0x7f281801c3d0 comp rx=0 tx=0).stop 2024-03-07T07:31:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 -- 172.21.15.84:0/3657126738 shutdown_connections 2024-03-07T07:31:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 --2- 172.21.15.84:0/3657126738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 0x7f28240cf540 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 -- 172.21.15.84:0/3657126738 >> 172.21.15.84:0/3657126738 conn(0x7f28240b1c50 msgr2=0x7f28240b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 -- 172.21.15.84:0/3657126738 shutdown_connections 2024-03-07T07:31:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 -- 172.21.15.84:0/3657126738 wait complete. 2024-03-07T07:31:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 Processor -- start 2024-03-07T07:31:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.171+0000 7f282b800640 1 -- start start 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240cdb20 0x7f282415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 0x7f28240aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f282415c3d0 0x7f28240af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2824145830 con 0x7f28240cdb20 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28240b4710 con 0x7f282415c3d0 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28241459b0 con 0x7f2824145090 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240cdb20 0x7f282415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240cdb20 0x7f282415ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38620/0 (socket says 172.21.15.84:38620) 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 -- 172.21.15.84:0/4096850978 learned_addr learned my addr 172.21.15.84:0/4096850978 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 -- 172.21.15.84:0/4096850978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 msgr2=0x7f28240aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 0x7f28240aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 -- 172.21.15.84:0/4096850978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f282415c3d0 msgr2=0x7f28240af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f282415c3d0 0x7f28240af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 -- 172.21.15.84:0/4096850978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282415b350 con 0x7f28240cdb20 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2828e00640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240cdb20 0x7f282415ae10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28180097f0 tx=0x7f2818019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2820c00640 1 -- 172.21.15.84:0/4096850978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180b0040 con 0x7f28240cdb20 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2820c00640 1 -- 172.21.15.84:0/4096850978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28180abcb0 con 0x7f28240cdb20 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f2820c00640 1 -- 172.21.15.84:0/4096850978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180abe60 con 0x7f28240cdb20 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282415e600 con 0x7f28240cdb20 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282415ebc0 con 0x7f28240cdb20 2024-03-07T07:31:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.175+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2824062d40 con 0x7f28240cdb20 2024-03-07T07:31:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.179+0000 7f2820c00640 1 -- 172.21.15.84:0/4096850978 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f28180bd030 con 0x7f28240cdb20 2024-03-07T07:31:13.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.179+0000 7f2820c00640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2804066f60 0x7f2804069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:13.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.179+0000 7f2820c00640 1 -- 172.21.15.84:0/4096850978 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f281811dfe0 con 0x7f28240cdb20 2024-03-07T07:31:13.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.179+0000 7f2823e00640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2804066f60 0x7f2804069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:13.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.179+0000 7f2823e00640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2804066f60 0x7f2804069420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f282413f420 tx=0x7f2810001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:13.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.183+0000 7f2820c00640 1 -- 172.21.15.84:0/4096850978 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f2818015ff0 con 0x7f28240cdb20 2024-03-07T07:31:13.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.367+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f28241447e0 con 0x7f28240cdb20 2024-03-07T07:31:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f2820c00640 1 -- 172.21.15.84:0/4096850978 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f28180ef0e0 con 0x7f28240cdb20 2024-03-07T07:31:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2024-03-07T07:31:13.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2804066f60 msgr2=0x7f2804069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2804066f60 0x7f2804069420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f282413f420 tx=0x7f2810001240 comp rx=0 tx=0).stop 2024-03-07T07:31:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240cdb20 msgr2=0x7f282415ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240cdb20 0x7f282415ae10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28180097f0 tx=0x7f2818019170 comp rx=0 tx=0).stop 2024-03-07T07:31:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 shutdown_connections 2024-03-07T07:31:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2804066f60 0x7f2804069420 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f282415c3d0 0x7f28240af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2824145090 0x7f28240aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 --2- 172.21.15.84:0/4096850978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240cdb20 0x7f282415ae10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.979+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 >> 172.21.15.84:0/4096850978 conn(0x7f28240b1c50 msgr2=0x7f2824143910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.983+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 shutdown_connections 2024-03-07T07:31:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:13.983+0000 7f282b800640 1 -- 172.21.15.84:0/4096850978 wait complete. 2024-03-07T07:31:14.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:14.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4288000640 1 Processor -- start 2024-03-07T07:31:14.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4288000640 1 -- start start 2024-03-07T07:31:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4288000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f42800b08d0 0x7f42800cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4288000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4280071600 0x7f42800cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4288000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800724f0 con 0x7f4280147d10 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4288000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42801480f0 con 0x7f4280071600 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4288000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800b0f80 con 0x7f42800b08d0 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4286000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4280071600 0x7f42800cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4286000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4280071600 0x7f42800cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38634/0 (socket says 172.21.15.84:38634) 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4286000640 1 -- 172.21.15.84:0/3153044140 learned_addr learned my addr 172.21.15.84:0/3153044140 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4284c00640 1 --2- 172.21.15.84:0/3153044140 >> v2:172.21.15.161:3300/0 conn(0x7f42800b08d0 0x7f42800cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4286000640 1 -- 172.21.15.84:0/3153044140 >> v2:172.21.15.161:3300/0 conn(0x7f42800b08d0 msgr2=0x7f42800cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4286000640 1 --2- 172.21.15.84:0/3153044140 >> v2:172.21.15.161:3300/0 conn(0x7f42800b08d0 0x7f42800cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4286000640 1 -- 172.21.15.84:0/3153044140 >> v1:172.21.15.161:6789/0 conn(0x7f4280147d10 legacy=0x7f42800b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.167+0000 7f4286000640 1 -- 172.21.15.84:0/3153044140 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800732f0 con 0x7f4280071600 2024-03-07T07:31:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4286000640 1 --2- 172.21.15.84:0/3153044140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4280071600 0x7f42800cfcf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42800a02f0 tx=0x7f427801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5cc4b9157c3a4e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f427fe00640 1 -- 172.21.15.84:0/3153044140 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780a5880 con 0x7f4280071600 2024-03-07T07:31:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f427fe00640 1 -- 172.21.15.84:0/3153044140 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780a5a20 con 0x7f4280071600 2024-03-07T07:31:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f427fe00640 1 -- 172.21.15.84:0/3153044140 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780a5df0 con 0x7f4280071600 2024-03-07T07:31:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4288000640 1 -- 172.21.15.84:0/3153044140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4280071600 msgr2=0x7f42800cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4288000640 1 --2- 172.21.15.84:0/3153044140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4280071600 0x7f42800cfcf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42800a02f0 tx=0x7f427801c9c0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4288000640 1 -- 172.21.15.84:0/3153044140 shutdown_connections 2024-03-07T07:31:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4288000640 1 --2- 172.21.15.84:0/3153044140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4280071600 0x7f42800cfcf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4288000640 1 --2- 172.21.15.84:0/3153044140 >> v2:172.21.15.161:3300/0 conn(0x7f42800b08d0 0x7f42800cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4288000640 1 -- 172.21.15.84:0/3153044140 >> 172.21.15.84:0/3153044140 conn(0x7f42800b1ed0 msgr2=0x7f42800b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4288000640 1 -- 172.21.15.84:0/3153044140 shutdown_connections 2024-03-07T07:31:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.171+0000 7f4288000640 1 -- 172.21.15.84:0/3153044140 wait complete. 2024-03-07T07:31:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 Processor -- start 2024-03-07T07:31:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 -- start start 2024-03-07T07:31:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4280071600 0x7f428015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800b08d0 0x7f428006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4280147d10 0x7f428006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428016af60 con 0x7f42800b08d0 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280073010 con 0x7f4280147d10 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428016b0e0 con 0x7f4280071600 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800b08d0 0x7f428006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800b08d0 0x7f428006c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38638/0 (socket says 172.21.15.84:38638) 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 -- 172.21.15.84:0/2527713376 learned_addr learned my addr 172.21.15.84:0/2527713376 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4286000640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4280147d10 0x7f428006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4285600640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4280071600 0x7f428015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 -- 172.21.15.84:0/2527713376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4280071600 msgr2=0x7f428015d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4280071600 0x7f428015d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 -- 172.21.15.84:0/2527713376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4280147d10 msgr2=0x7f428006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4280147d10 0x7f428006cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 -- 172.21.15.84:0/2527713376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280136550 con 0x7f42800b08d0 2024-03-07T07:31:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4284c00640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800b08d0 0x7f428006c8a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f426c00d800 tx=0x7f426c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f427d600640 1 -- 172.21.15.84:0/2527713376 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00b6c0 con 0x7f42800b08d0 2024-03-07T07:31:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f427d600640 1 -- 172.21.15.84:0/2527713376 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c019070 con 0x7f42800b08d0 2024-03-07T07:31:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280136830 con 0x7f42800b08d0 2024-03-07T07:31:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f427d600640 1 -- 172.21.15.84:0/2527713376 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00bae0 con 0x7f42800b08d0 2024-03-07T07:31:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.175+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4280136df0 con 0x7f42800b08d0 2024-03-07T07:31:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.179+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4280062d40 con 0x7f42800b08d0 2024-03-07T07:31:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.179+0000 7f427d600640 1 -- 172.21.15.84:0/2527713376 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f426c00bc80 con 0x7f42800b08d0 2024-03-07T07:31:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.179+0000 7f427d600640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4260066f60 0x7f4260069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.179+0000 7f427d600640 1 -- 172.21.15.84:0/2527713376 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f426c0854f0 con 0x7f42800b08d0 2024-03-07T07:31:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.179+0000 7f4285600640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4260066f60 0x7f4260069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.179+0000 7f4285600640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4260066f60 0x7f4260069420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4280141da0 tx=0x7f4274009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.183+0000 7f427d600640 1 -- 172.21.15.84:0/2527713376 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f426c055e10 con 0x7f42800b08d0 2024-03-07T07:31:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.335+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42800b05b0 con 0x7f42800b08d0 2024-03-07T07:31:14.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f427d600640 1 -- 172.21.15.84:0/2527713376 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16586 (secure 0 0 0) 0x7f426c059eb0 con 0x7f42800b08d0 2024-03-07T07:31:14.343 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:14.343 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:13.374773+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:14.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4260066f60 msgr2=0x7f4260069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4260066f60 0x7f4260069420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4280141da0 tx=0x7f4274009040 comp rx=0 tx=0).stop 2024-03-07T07:31:14.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800b08d0 msgr2=0x7f428006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800b08d0 0x7f428006c8a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f426c00d800 tx=0x7f426c00dcc0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 shutdown_connections 2024-03-07T07:31:14.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4260066f60 0x7f4260069420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4280147d10 0x7f428006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42800b08d0 0x7f428006c8a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 --2- 172.21.15.84:0/2527713376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4280071600 0x7f428015d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 >> 172.21.15.84:0/2527713376 conn(0x7f42800b1ed0 msgr2=0x7f428006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:14.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 shutdown_connections 2024-03-07T07:31:14.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.339+0000 7f4288000640 1 -- 172.21.15.84:0/2527713376 wait complete. 2024-03-07T07:31:14.362 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:14.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.491+0000 7fc394000640 1 Processor -- start 2024-03-07T07:31:14.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.491+0000 7fc394000640 1 -- start start 2024-03-07T07:31:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc394000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc38c1586d0 0x7fc38c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc394000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc38c072d60 0x7fc38c0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc394000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c0aa9c0 0x7fc38c0a9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc394000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c0aae00 con 0x7fc38c072d60 2024-03-07T07:31:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc394000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c073210 con 0x7fc38c1586d0 2024-03-07T07:31:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc394000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c073490 con 0x7fc38c0aa9c0 2024-03-07T07:31:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc390c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc38c072d60 0x7fc38c0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc390c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc38c072d60 0x7fc38c0aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38654/0 (socket says 172.21.15.84:38654) 2024-03-07T07:31:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc390c00640 1 -- 172.21.15.84:0/2792530509 learned_addr learned my addr 172.21.15.84:0/2792530509 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc392000640 1 --2- 172.21.15.84:0/2792530509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c0aa9c0 0x7fc38c0a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc391600640 1 --2- 172.21.15.84:0/2792530509 >> v2:172.21.15.161:3300/0 conn(0x7fc38c1586d0 0x7fc38c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc390c00640 1 -- 172.21.15.84:0/2792530509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c0aa9c0 msgr2=0x7fc38c0a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc390c00640 1 --2- 172.21.15.84:0/2792530509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c0aa9c0 0x7fc38c0a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc390c00640 1 -- 172.21.15.84:0/2792530509 >> v2:172.21.15.161:3300/0 conn(0x7fc38c1586d0 msgr2=0x7fc38c15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc390c00640 1 --2- 172.21.15.84:0/2792530509 >> v2:172.21.15.161:3300/0 conn(0x7fc38c1586d0 0x7fc38c15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc390c00640 1 -- 172.21.15.84:0/2792530509 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c161db0 con 0x7fc38c072d60 2024-03-07T07:31:14.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.495+0000 7fc392000640 1 --2- 172.21.15.84:0/2792530509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c0aa9c0 0x7fc38c0a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc390c00640 1 --2- 172.21.15.84:0/2792530509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c072d60 0x7fc38c0aa480 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0aa450 tx=0x7fc37801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba4fb470a47ae2f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc38be00640 1 -- 172.21.15.84:0/2792530509 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780b0070 con 0x7fc38c072d60 2024-03-07T07:31:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc38be00640 1 -- 172.21.15.84:0/2792530509 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3780ab600 con 0x7fc38c072d60 2024-03-07T07:31:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc38be00640 1 -- 172.21.15.84:0/2792530509 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780ab9d0 con 0x7fc38c072d60 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 -- 172.21.15.84:0/2792530509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c072d60 msgr2=0x7fc38c0aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 --2- 172.21.15.84:0/2792530509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c072d60 0x7fc38c0aa480 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0aa450 tx=0x7fc37801c260 comp rx=0 tx=0).stop 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 -- 172.21.15.84:0/2792530509 shutdown_connections 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 --2- 172.21.15.84:0/2792530509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c0aa9c0 0x7fc38c0a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 --2- 172.21.15.84:0/2792530509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c072d60 0x7fc38c0aa480 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 --2- 172.21.15.84:0/2792530509 >> v2:172.21.15.161:3300/0 conn(0x7fc38c1586d0 0x7fc38c15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 -- 172.21.15.84:0/2792530509 >> 172.21.15.84:0/2792530509 conn(0x7fc38c072240 msgr2=0x7fc38c072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 -- 172.21.15.84:0/2792530509 shutdown_connections 2024-03-07T07:31:14.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 -- 172.21.15.84:0/2792530509 wait complete. 2024-03-07T07:31:14.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 Processor -- start 2024-03-07T07:31:14.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.499+0000 7fc394000640 1 -- start start 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c072d60 0x7fc38c13c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc38c0aa9c0 0x7fc38c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c1586d0 0x7fc38c139d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c158ab0 con 0x7fc38c1586d0 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c162b70 con 0x7fc38c0aa9c0 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c158c30 con 0x7fc38c072d60 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c1586d0 0x7fc38c139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c1586d0 0x7fc38c139d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38666/0 (socket says 172.21.15.84:38666) 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 -- 172.21.15.84:0/2083024459 learned_addr learned my addr 172.21.15.84:0/2083024459 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc391600640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c072d60 0x7fc38c13c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc390c00640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc38c0aa9c0 0x7fc38c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 -- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c072d60 msgr2=0x7fc38c13c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c072d60 0x7fc38c13c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 -- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc38c0aa9c0 msgr2=0x7fc38c156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc38c0aa9c0 0x7fc38c156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 -- 172.21.15.84:0/2083024459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c142b50 con 0x7fc38c1586d0 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc390c00640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc38c0aa9c0 0x7fc38c156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc392000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c1586d0 0x7fc38c139d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc38400d530 tx=0x7fc38400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc389600640 1 -- 172.21.15.84:0/2083024459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384004030 con 0x7fc38c1586d0 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc389600640 1 -- 172.21.15.84:0/2083024459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3840041d0 con 0x7fc38c1586d0 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc389600640 1 -- 172.21.15.84:0/2083024459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384003620 con 0x7fc38c1586d0 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c1422b0 con 0x7fc38c1586d0 2024-03-07T07:31:14.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c142870 con 0x7fc38c1586d0 2024-03-07T07:31:14.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c062d40 con 0x7fc38c1586d0 2024-03-07T07:31:14.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.503+0000 7fc389600640 1 -- 172.21.15.84:0/2083024459 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc3840037c0 con 0x7fc38c1586d0 2024-03-07T07:31:14.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.507+0000 7fc389600640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc36c066f90 0x7fc36c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.507+0000 7fc389600640 1 -- 172.21.15.84:0/2083024459 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3840856a0 con 0x7fc38c1586d0 2024-03-07T07:31:14.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.507+0000 7fc391600640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc36c066f90 0x7fc36c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.507+0000 7fc391600640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc36c066f90 0x7fc36c069450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc380003fd0 tx=0x7fc3800039c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.511+0000 7fc389600640 1 -- 172.21.15.84:0/2083024459 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc3840566a0 con 0x7fc38c1586d0 2024-03-07T07:31:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.663+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc38c13eae0 con 0x7fc38c1586d0 2024-03-07T07:31:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.663+0000 7fc389600640 1 -- 172.21.15.84:0/2083024459 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16586 (secure 0 0 0) 0x7fc384055fa0 con 0x7fc38c1586d0 2024-03-07T07:31:14.667 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:14.667 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:13.374773+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc36c066f90 msgr2=0x7fc36c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc36c066f90 0x7fc36c069450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc380003fd0 tx=0x7fc3800039c0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c1586d0 msgr2=0x7fc38c139d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c1586d0 0x7fc38c139d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc38400d530 tx=0x7fc38400d9f0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 shutdown_connections 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc36c066f90 0x7fc36c069450 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc38c1586d0 0x7fc38c139d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc38c0aa9c0 0x7fc38c156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 --2- 172.21.15.84:0/2083024459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc38c072d60 0x7fc38c13c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 >> 172.21.15.84:0/2083024459 conn(0x7fc38c072240 msgr2=0x7fc38c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 shutdown_connections 2024-03-07T07:31:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.667+0000 7fc394000640 1 -- 172.21.15.84:0/2083024459 wait complete. 2024-03-07T07:31:14.688 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-07T07:31:14.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f542d400640 1 Processor -- start 2024-03-07T07:31:14.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f542d400640 1 -- start start 2024-03-07T07:31:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f542d400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f54280cef40 0x7f54281659c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f542d400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542806eec0 con 0x7f54280ce3d0 2024-03-07T07:31:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f542d400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542806f1a0 con 0x7f54281442a0 2024-03-07T07:31:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f542d400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542806ec50 con 0x7f54280cef40 2024-03-07T07:31:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f5427200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f54280cef40 0x7f54281659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f5425e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f54280ce3d0 0x7f54280ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35020/0 (socket says 172.21.15.84:35020) 2024-03-07T07:31:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f5425e00640 1 -- 172.21.15.84:0/761744923 learned_addr learned my addr 172.21.15.84:0/761744923 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:14.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f5427200640 1 -- 172.21.15.84:0/761744923 >> v1:172.21.15.161:6789/0 conn(0x7f54281442a0 legacy=0x7f54280b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f5427200640 1 -- 172.21.15.84:0/761744923 >> v1:172.21.15.84:6789/0 conn(0x7f54280ce3d0 legacy=0x7f54280ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.823+0000 7f5427200640 1 -- 172.21.15.84:0/761744923 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280cc800 con 0x7f54280cef40 2024-03-07T07:31:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f5427200640 1 --2- 172.21.15.84:0/761744923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f54281659c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5420009d90 tx=0x7f542001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3e76b9ecd1d91d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f5425400640 1 -- 172.21.15.84:0/761744923 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200b2070 con 0x7f54280cef40 2024-03-07T07:31:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f5425400640 1 -- 172.21.15.84:0/761744923 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54200a58c0 con 0x7f54280cef40 2024-03-07T07:31:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f5425400640 1 -- 172.21.15.84:0/761744923 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200a5c90 con 0x7f54280cef40 2024-03-07T07:31:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 -- 172.21.15.84:0/761744923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 msgr2=0x7f54281659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 --2- 172.21.15.84:0/761744923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f54281659c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5420009d90 tx=0x7f542001c970 comp rx=0 tx=0).stop 2024-03-07T07:31:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 -- 172.21.15.84:0/761744923 shutdown_connections 2024-03-07T07:31:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 --2- 172.21.15.84:0/761744923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f54281659c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 -- 172.21.15.84:0/761744923 >> 172.21.15.84:0/761744923 conn(0x7f54280b1c50 msgr2=0x7f54280b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 -- 172.21.15.84:0/761744923 shutdown_connections 2024-03-07T07:31:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 -- 172.21.15.84:0/761744923 wait complete. 2024-03-07T07:31:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 Processor -- start 2024-03-07T07:31:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.827+0000 7f542d400640 1 -- start start 2024-03-07T07:31:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54280ce3d0 0x7f542813a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f5428072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54281442a0 0x7f5428072790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54281688a0 con 0x7f54280cef40 2024-03-07T07:31:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5428168720 con 0x7f54280ce3d0 2024-03-07T07:31:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5428168a20 con 0x7f54281442a0 2024-03-07T07:31:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f5428072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f5428072250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38686/0 (socket says 172.21.15.84:38686) 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 -- 172.21.15.84:0/945352035 learned_addr learned my addr 172.21.15.84:0/945352035 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5427200640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54281442a0 0x7f5428072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5426800640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54280ce3d0 0x7f542813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 -- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54281442a0 msgr2=0x7f5428072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54281442a0 0x7f5428072790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 -- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54280ce3d0 msgr2=0x7f542813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54280ce3d0 0x7f542813a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 -- 172.21.15.84:0/945352035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428140e30 con 0x7f54280cef40 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5426800640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54280ce3d0 0x7f542813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f5425e00640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f5428072250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f541400c400 tx=0x7f541400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f541ea00640 1 -- 172.21.15.84:0/945352035 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414017070 con 0x7f54280cef40 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f541ea00640 1 -- 172.21.15.84:0/945352035 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414005cf0 con 0x7f54280cef40 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5428159da0 con 0x7f54280cef40 2024-03-07T07:31:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f541ea00640 1 -- 172.21.15.84:0/945352035 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54140072d0 con 0x7f54280cef40 2024-03-07T07:31:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5428140b50 con 0x7f54280cef40 2024-03-07T07:31:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5428062d40 con 0x7f54280cef40 2024-03-07T07:31:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.831+0000 7f541ea00640 1 -- 172.21.15.84:0/945352035 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f541401a070 con 0x7f54280cef40 2024-03-07T07:31:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.835+0000 7f541ea00640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5408066f60 0x7f5408069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.835+0000 7f541ea00640 1 -- 172.21.15.84:0/945352035 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54140842f0 con 0x7f54280cef40 2024-03-07T07:31:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.835+0000 7f5426800640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5408066f60 0x7f5408069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.835+0000 7f5426800640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5408066f60 0x7f5408069420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5418001710 tx=0x7f5418009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:14.839+0000 7f541ea00640 1 -- 172.21.15.84:0/945352035 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f5414054ca0 con 0x7f54280cef40 2024-03-07T07:31:15.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:15.031+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f54280682a0 con 0x7f54280cef40 2024-03-07T07:31:16.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.003+0000 7f541ea00640 1 -- 172.21.15.84:0/945352035 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5414058d40 con 0x7f54280cef40 2024-03-07T07:31:16.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5408066f60 msgr2=0x7f5408069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5408066f60 0x7f5408069420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5418001710 tx=0x7f5418009040 comp rx=0 tx=0).stop 2024-03-07T07:31:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 msgr2=0x7f5428072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f5428072250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f541400c400 tx=0x7f541400c8c0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 shutdown_connections 2024-03-07T07:31:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5408066f60 0x7f5408069420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54281442a0 0x7f5428072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54280cef40 0x7f5428072250 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 --2- 172.21.15.84:0/945352035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54280ce3d0 0x7f542813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 >> 172.21.15.84:0/945352035 conn(0x7f54280b1c50 msgr2=0x7f5428143050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:16.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 shutdown_connections 2024-03-07T07:31:16.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.007+0000 7f542d400640 1 -- 172.21.15.84:0/945352035 wait complete. 2024-03-07T07:31:16.032 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-07T07:31:16.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-07T07:31:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.171+0000 7f71ea800640 1 Processor -- start 2024-03-07T07:31:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.171+0000 7f71ea800640 1 -- start start 2024-03-07T07:31:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.171+0000 7f71ea800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71e415df00 0x7f71e406f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.171+0000 7f71ea800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e415e2e0 0x7f71e40b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.171+0000 7f71ea800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f71e406f920 0x7f71e40b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.171+0000 7f71ea800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40b45b0 con 0x7f71e415df00 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.171+0000 7f71ea800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40704b0 con 0x7f71e406f920 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.171+0000 7f71ea800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e40b4800 con 0x7f71e415e2e0 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71e415df00 0x7f71e406f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71e415df00 0x7f71e406f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38696/0 (socket says 172.21.15.84:38696) 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 -- 172.21.15.84:0/2028938450 learned_addr learned my addr 172.21.15.84:0/2028938450 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71daa00640 1 --2- 172.21.15.84:0/2028938450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e415e2e0 0x7f71e40b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3e00640 1 --2- 172.21.15.84:0/2028938450 >> v2:172.21.15.161:3300/0 conn(0x7f71e406f920 0x7f71e40b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 -- 172.21.15.84:0/2028938450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e415e2e0 msgr2=0x7f71e40b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 --2- 172.21.15.84:0/2028938450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e415e2e0 0x7f71e40b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 -- 172.21.15.84:0/2028938450 >> v2:172.21.15.161:3300/0 conn(0x7f71e406f920 msgr2=0x7f71e40b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 --2- 172.21.15.84:0/2028938450 >> v2:172.21.15.161:3300/0 conn(0x7f71e406f920 0x7f71e40b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 -- 172.21.15.84:0/2028938450 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40b4ae0 con 0x7f71e415df00 2024-03-07T07:31:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3e00640 1 --2- 172.21.15.84:0/2028938450 >> v2:172.21.15.161:3300/0 conn(0x7f71e406f920 0x7f71e40b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e3400640 1 --2- 172.21.15.84:0/2028938450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e406f3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71e4067630 tx=0x7f71d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e3ba4caa29b50f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e2a00640 1 -- 172.21.15.84:0/2028938450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b1070 con 0x7f71e415df00 2024-03-07T07:31:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e2a00640 1 -- 172.21.15.84:0/2028938450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40ac630 con 0x7f71e415df00 2024-03-07T07:31:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.175+0000 7f71e2a00640 1 -- 172.21.15.84:0/2028938450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40a8050 con 0x7f71e415df00 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- 172.21.15.84:0/2028938450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 msgr2=0x7f71e406f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 --2- 172.21.15.84:0/2028938450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e406f3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71e4067630 tx=0x7f71d401c520 comp rx=0 tx=0).stop 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- 172.21.15.84:0/2028938450 shutdown_connections 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 --2- 172.21.15.84:0/2028938450 >> v2:172.21.15.161:3300/0 conn(0x7f71e406f920 0x7f71e40b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 --2- 172.21.15.84:0/2028938450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e415e2e0 0x7f71e40b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 --2- 172.21.15.84:0/2028938450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e406f3e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- 172.21.15.84:0/2028938450 >> 172.21.15.84:0/2028938450 conn(0x7f71e40cd530 msgr2=0x7f71e40cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- 172.21.15.84:0/2028938450 shutdown_connections 2024-03-07T07:31:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- 172.21.15.84:0/2028938450 wait complete. 2024-03-07T07:31:16.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 Processor -- start 2024-03-07T07:31:16.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- start start 2024-03-07T07:31:16.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e406f920 0x7f71e415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:16.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e41537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:16.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e415e2e0 0x7f71e4144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4162850 con 0x7f71e415df00 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41626d0 con 0x7f71e415e2e0 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71ea800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41629d0 con 0x7f71e406f920 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e41537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e41537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38708/0 (socket says 172.21.15.84:38708) 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 -- 172.21.15.84:0/3538337530 learned_addr learned my addr 172.21.15.84:0/3538337530 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71e3400640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e406f920 0x7f71e415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71e3e00640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e415e2e0 0x7f71e4144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 -- 172.21.15.84:0/3538337530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e406f920 msgr2=0x7f71e415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e406f920 0x7f71e415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 -- 172.21.15.84:0/3538337530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e415e2e0 msgr2=0x7f71e4144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e415e2e0 0x7f71e4144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 -- 172.21.15.84:0/3538337530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4144960 con 0x7f71e415df00 2024-03-07T07:31:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.179+0000 7f71daa00640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e41537e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00e900 tx=0x7f71cc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:16.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71dbe00640 1 -- 172.21.15.84:0/3538337530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc017070 con 0x7f71e415df00 2024-03-07T07:31:16.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71dbe00640 1 -- 172.21.15.84:0/3538337530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00c9a0 con 0x7f71e415df00 2024-03-07T07:31:16.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71dbe00640 1 -- 172.21.15.84:0/3538337530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00cd90 con 0x7f71e415df00 2024-03-07T07:31:16.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e4153f10 con 0x7f71e415df00 2024-03-07T07:31:16.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e414b7f0 con 0x7f71e415df00 2024-03-07T07:31:16.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e4062d40 con 0x7f71e415df00 2024-03-07T07:31:16.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71dbe00640 1 -- 172.21.15.84:0/3538337530 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f71cc01a070 con 0x7f71e415df00 2024-03-07T07:31:16.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71dbe00640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f71c0066f90 0x7f71c0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:16.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71dbe00640 1 -- 172.21.15.84:0/3538337530 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71cc084e70 con 0x7f71e415df00 2024-03-07T07:31:16.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71e3400640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f71c0066f90 0x7f71c0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:16.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.183+0000 7f71e3400640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f71c0066f90 0x7f71c0069450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71d40ae000 tx=0x7f71d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:16.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.187+0000 7f71dbe00640 1 -- 172.21.15.84:0/3538337530 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f71cc055820 con 0x7f71e415df00 2024-03-07T07:31:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:16.375+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f71e4070d10 con 0x7f71e415df00 2024-03-07T07:31:17.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71dbe00640 1 -- 172.21.15.84:0/3538337530 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f71cc0598c0 con 0x7f71e415df00 2024-03-07T07:31:17.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f71c0066f90 msgr2=0x7f71c0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f71c0066f90 0x7f71c0069450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71d40ae000 tx=0x7f71d4008040 comp rx=0 tx=0).stop 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 msgr2=0x7f71e41537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e41537e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00e900 tx=0x7f71cc00edc0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 shutdown_connections 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f71c0066f90 0x7f71c0069450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e415e2e0 0x7f71e4144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e415df00 0x7f71e41537e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 --2- 172.21.15.84:0/3538337530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71e406f920 0x7f71e415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 >> 172.21.15.84:0/3538337530 conn(0x7f71e40cd530 msgr2=0x7f71e40cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 shutdown_connections 2024-03-07T07:31:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.011+0000 7f71ea800640 1 -- 172.21.15.84:0/3538337530 wait complete. 2024-03-07T07:31:17.038 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-07T07:31:17.038 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:17.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff586200640 1 Processor -- start 2024-03-07T07:31:17.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff586200640 1 -- start start 2024-03-07T07:31:17.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff586200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff580144620 0x7ff5800cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff586200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5800b32b0 0x7ff58006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff586200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58006f090 0x7ff5800704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff586200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58006f520 con 0x7ff5800b32b0 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff586200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800d0530 con 0x7ff580144620 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff586200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58015f430 con 0x7ff58006f090 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff577e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5800b32b0 0x7ff58006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff577e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5800b32b0 0x7ff58006eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38710/0 (socket says 172.21.15.84:38710) 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff577e00640 1 -- 172.21.15.84:0/2678256539 learned_addr learned my addr 172.21.15.84:0/2678256539 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff585800640 1 --2- 172.21.15.84:0/2678256539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58006f090 0x7ff5800704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff584e00640 1 --2- 172.21.15.84:0/2678256539 >> v2:172.21.15.161:3300/0 conn(0x7ff580144620 0x7ff5800cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff577e00640 1 -- 172.21.15.84:0/2678256539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58006f090 msgr2=0x7ff5800704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff577e00640 1 --2- 172.21.15.84:0/2678256539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58006f090 0x7ff5800704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff577e00640 1 -- 172.21.15.84:0/2678256539 >> v2:172.21.15.161:3300/0 conn(0x7ff580144620 msgr2=0x7ff5800cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff577e00640 1 --2- 172.21.15.84:0/2678256539 >> v2:172.21.15.161:3300/0 conn(0x7ff580144620 0x7ff5800cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.175+0000 7ff577e00640 1 -- 172.21.15.84:0/2678256539 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58015e670 con 0x7ff5800b32b0 2024-03-07T07:31:17.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff577e00640 1 --2- 172.21.15.84:0/2678256539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5800b32b0 0x7ff58006eb50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5800720f0 tx=0x7ff56801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b528c1beb8ef853a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff57fe00640 1 -- 172.21.15.84:0/2678256539 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680b0070 con 0x7ff5800b32b0 2024-03-07T07:31:17.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff57fe00640 1 -- 172.21.15.84:0/2678256539 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5680ab600 con 0x7ff5800b32b0 2024-03-07T07:31:17.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff57fe00640 1 -- 172.21.15.84:0/2678256539 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680ab9d0 con 0x7ff5800b32b0 2024-03-07T07:31:17.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 -- 172.21.15.84:0/2678256539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5800b32b0 msgr2=0x7ff58006eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 --2- 172.21.15.84:0/2678256539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5800b32b0 0x7ff58006eb50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5800720f0 tx=0x7ff56801c260 comp rx=0 tx=0).stop 2024-03-07T07:31:17.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 -- 172.21.15.84:0/2678256539 shutdown_connections 2024-03-07T07:31:17.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 --2- 172.21.15.84:0/2678256539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff58006f090 0x7ff5800704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 --2- 172.21.15.84:0/2678256539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5800b32b0 0x7ff58006eb50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 --2- 172.21.15.84:0/2678256539 >> v2:172.21.15.161:3300/0 conn(0x7ff580144620 0x7ff5800cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 -- 172.21.15.84:0/2678256539 >> 172.21.15.84:0/2678256539 conn(0x7ff580066f60 msgr2=0x7ff580067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:17.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 -- 172.21.15.84:0/2678256539 shutdown_connections 2024-03-07T07:31:17.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 -- 172.21.15.84:0/2678256539 wait complete. 2024-03-07T07:31:17.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 Processor -- start 2024-03-07T07:31:17.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.179+0000 7ff586200640 1 -- start start 2024-03-07T07:31:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff58006f090 0x7ff5801495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5800b32b0 0x7ff580158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff580144620 0x7ff580159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800b3730 con 0x7ff58006f090 2024-03-07T07:31:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800d0760 con 0x7ff5800b32b0 2024-03-07T07:31:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff580161b10 con 0x7ff580144620 2024-03-07T07:31:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff58006f090 0x7ff5801495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff58006f090 0x7ff5801495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38716/0 (socket says 172.21.15.84:38716) 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 -- 172.21.15.84:0/3287253584 learned_addr learned my addr 172.21.15.84:0/3287253584 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff585800640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff580144620 0x7ff580159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff577e00640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5800b32b0 0x7ff580158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 -- 172.21.15.84:0/3287253584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff580144620 msgr2=0x7ff580159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff580144620 0x7ff580159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 -- 172.21.15.84:0/3287253584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5800b32b0 msgr2=0x7ff580158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5800b32b0 0x7ff580158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 -- 172.21.15.84:0/3287253584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580158350 con 0x7ff58006f090 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff584e00640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff58006f090 0x7ff5801495a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff57000e870 tx=0x7ff57000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff57d600640 1 -- 172.21.15.84:0/3287253584 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570017070 con 0x7ff58006f090 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff57d600640 1 -- 172.21.15.84:0/3287253584 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57000c940 con 0x7ff58006f090 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff580158630 con 0x7ff58006f090 2024-03-07T07:31:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff57d600640 1 -- 172.21.15.84:0/3287253584 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57000ccf0 con 0x7ff58006f090 2024-03-07T07:31:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff580157770 con 0x7ff58006f090 2024-03-07T07:31:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff580062d40 con 0x7ff58006f090 2024-03-07T07:31:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.183+0000 7ff57d600640 1 -- 172.21.15.84:0/3287253584 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7ff57001a070 con 0x7ff58006f090 2024-03-07T07:31:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.187+0000 7ff57d600640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff55c066f60 0x7ff55c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.187+0000 7ff57d600640 1 -- 172.21.15.84:0/3287253584 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff570085220 con 0x7ff58006f090 2024-03-07T07:31:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.187+0000 7ff577e00640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff55c066f60 0x7ff55c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.187+0000 7ff577e00640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff55c066f60 0x7ff55c069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff5680ad000 tx=0x7ff568008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.191+0000 7ff57d600640 1 -- 172.21.15.84:0/3287253584 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7ff570055bd0 con 0x7ff58006f090 2024-03-07T07:31:17.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.379+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5801618f0 con 0x7ff58006f090 2024-03-07T07:31:17.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.379+0000 7ff57d600640 1 -- 172.21.15.84:0/3287253584 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4974 (secure 0 0 0) 0x7ff570059c70 con 0x7ff58006f090 2024-03-07T07:31:17.383 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:31:13.375093+0000","modified":"2024-03-07T07:31:16.379882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4315,"qdb_cluster":[4315]},"id":1}]} 2024-03-07T07:31:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff55c066f60 msgr2=0x7ff55c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff55c066f60 0x7ff55c069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff5680ad000 tx=0x7ff568008040 comp rx=0 tx=0).stop 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff58006f090 msgr2=0x7ff5801495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff58006f090 0x7ff5801495a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff57000e870 tx=0x7ff57000ec70 comp rx=0 tx=0).stop 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 shutdown_connections 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff55c066f60 0x7ff55c069420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff580144620 0x7ff580159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5800b32b0 0x7ff580158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 --2- 172.21.15.84:0/3287253584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff58006f090 0x7ff5801495a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 >> 172.21.15.84:0/3287253584 conn(0x7ff580066f60 msgr2=0x7ff5800b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 shutdown_connections 2024-03-07T07:31:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.383+0000 7ff586200640 1 -- 172.21.15.84:0/3287253584 wait complete. 2024-03-07T07:31:17.391 INFO:tasks.ceph.mds.b.smithi161.stderr:2024-03-07T07:31:17.389+0000 7f15e1600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T07:31:17.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe62a400640 1 Processor -- start 2024-03-07T07:31:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe62a400640 1 -- start start 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe62a400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6240cf100 0x7fe6240b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe62a400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6240b0290 con 0x7fe6240b3a00 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe62a400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6240b0570 con 0x7fe62415c1f0 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe62a400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240b1d40 con 0x7fe6240cf100 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe623e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe6240b3a00 0x7fe6240aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35028/0 (socket says 172.21.15.84:35028) 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe623e00640 1 -- 172.21.15.84:0/227106481 learned_addr learned my addr 172.21.15.84:0/227106481 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe61aa00640 1 --2- 172.21.15.84:0/227106481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6240cf100 0x7fe6240b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe622a00640 1 -- 172.21.15.84:0/227106481 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336874510 0 0) 0x7fe6240b0290 con 0x7fe6240b3a00 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe622a00640 1 -- 172.21.15.84:0/227106481 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe608003530 con 0x7fe6240b3a00 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe622a00640 1 -- 172.21.15.84:0/227106481 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950103374 0 0) 0x7fe6240b0570 con 0x7fe62415c1f0 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe61aa00640 1 -- 172.21.15.84:0/227106481 >> v1:172.21.15.161:6789/0 conn(0x7fe62415c1f0 legacy=0x7fe6240d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe61aa00640 1 -- 172.21.15.84:0/227106481 >> v1:172.21.15.84:6789/0 conn(0x7fe6240b3a00 legacy=0x7fe6240aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.535+0000 7fe61aa00640 1 -- 172.21.15.84:0/227106481 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240b0850 con 0x7fe6240cf100 2024-03-07T07:31:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe61aa00640 1 --2- 172.21.15.84:0/227106481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6240cf100 0x7fe6240b1330 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097f0 tx=0x7fe60c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=515ddc4a0cdce573 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe622a00640 1 -- 172.21.15.84:0/227106481 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0b2070 con 0x7fe6240cf100 2024-03-07T07:31:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe622a00640 1 -- 172.21.15.84:0/227106481 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c0a9070 con 0x7fe6240cf100 2024-03-07T07:31:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe622a00640 1 -- 172.21.15.84:0/227106481 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0ad880 con 0x7fe6240cf100 2024-03-07T07:31:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe62a400640 1 -- 172.21.15.84:0/227106481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6240cf100 msgr2=0x7fe6240b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe62a400640 1 --2- 172.21.15.84:0/227106481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6240cf100 0x7fe6240b1330 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097f0 tx=0x7fe60c01c450 comp rx=0 tx=0).stop 2024-03-07T07:31:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe62a400640 1 -- 172.21.15.84:0/227106481 shutdown_connections 2024-03-07T07:31:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe62a400640 1 --2- 172.21.15.84:0/227106481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6240cf100 0x7fe6240b1330 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe62a400640 1 -- 172.21.15.84:0/227106481 >> 172.21.15.84:0/227106481 conn(0x7fe6240b1ed0 msgr2=0x7fe6240b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe62a400640 1 -- 172.21.15.84:0/227106481 shutdown_connections 2024-03-07T07:31:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.539+0000 7fe62a400640 1 -- 172.21.15.84:0/227106481 wait complete. 2024-03-07T07:31:17.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 Processor -- start 2024-03-07T07:31:17.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 -- start start 2024-03-07T07:31:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6240b3a00 0x7fe62406c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240cf100 0x7fe6240b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe62415c1f0 0x7fe624153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62416a080 con 0x7fe6240cf100 2024-03-07T07:31:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe624169f00 con 0x7fe6240b3a00 2024-03-07T07:31:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62416a200 con 0x7fe62415c1f0 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240cf100 0x7fe6240b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240cf100 0x7fe6240b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38732/0 (socket says 172.21.15.84:38732) 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 -- 172.21.15.84:0/4279891687 learned_addr learned my addr 172.21.15.84:0/4279891687 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe623400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6240b3a00 0x7fe62406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe623e00640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe62415c1f0 0x7fe624153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 -- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe62415c1f0 msgr2=0x7fe624153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe62415c1f0 0x7fe624153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 -- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6240b3a00 msgr2=0x7fe62406c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6240b3a00 0x7fe62406c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 -- 172.21.15.84:0/4279891687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe624155c20 con 0x7fe6240cf100 2024-03-07T07:31:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe623400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6240b3a00 0x7fe62406c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61aa00640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240cf100 0x7fe6240b57b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097f0 tx=0x7fe60c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61be00640 1 -- 172.21.15.84:0/4279891687 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0bd020 con 0x7fe6240cf100 2024-03-07T07:31:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61be00640 1 -- 172.21.15.84:0/4279891687 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c0b3040 con 0x7fe6240cf100 2024-03-07T07:31:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe61be00640 1 -- 172.21.15.84:0/4279891687 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0b2050 con 0x7fe6240cf100 2024-03-07T07:31:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe624155f00 con 0x7fe6240cf100 2024-03-07T07:31:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.543+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6241564c0 con 0x7fe6240cf100 2024-03-07T07:31:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.547+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe624062d40 con 0x7fe6240cf100 2024-03-07T07:31:17.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.547+0000 7fe61be00640 1 -- 172.21.15.84:0/4279891687 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe60c0c0070 con 0x7fe6240cf100 2024-03-07T07:31:17.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.547+0000 7fe61be00640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe600066f60 0x7fe600069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.547+0000 7fe61be00640 1 -- 172.21.15.84:0/4279891687 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe60c11e7f0 con 0x7fe6240cf100 2024-03-07T07:31:17.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.547+0000 7fe623400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe600066f60 0x7fe600069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.547+0000 7fe623400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe600066f60 0x7fe600069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6140012f0 tx=0x7fe614009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.551+0000 7fe61be00640 1 -- 172.21.15.84:0/4279891687 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe60c0160d0 con 0x7fe6240cf100 2024-03-07T07:31:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe624072de0 con 0x7fe6240cf100 2024-03-07T07:31:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe61be00640 1 -- 172.21.15.84:0/4279891687 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7fe60c0ef110 con 0x7fe6240cf100 2024-03-07T07:31:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:17.710 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:17.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe600066f60 msgr2=0x7fe600069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe600066f60 0x7fe600069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6140012f0 tx=0x7fe614009040 comp rx=0 tx=0).stop 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240cf100 msgr2=0x7fe6240b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240cf100 0x7fe6240b57b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097f0 tx=0x7fe60c01ac90 comp rx=0 tx=0).stop 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 shutdown_connections 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe600066f60 0x7fe600069420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe62415c1f0 0x7fe624153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240cf100 0x7fe6240b57b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 --2- 172.21.15.84:0/4279891687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6240b3a00 0x7fe62406c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 >> 172.21.15.84:0/4279891687 conn(0x7fe6240b1ed0 msgr2=0x7fe6240aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 shutdown_connections 2024-03-07T07:31:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.707+0000 7fe62a400640 1 -- 172.21.15.84:0/4279891687 wait complete. 2024-03-07T07:31:17.731 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-07T07:31:17.731 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:31:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97f2800640 1 Processor -- start 2024-03-07T07:31:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97f2800640 1 -- start start 2024-03-07T07:31:17.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97f2800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec147d10 0x7f97ec0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97f2800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f97ec071600 0x7f97ec0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97f2800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec0724f0 con 0x7f97ec0b3a00 2024-03-07T07:31:17.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97f2800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec1480f0 con 0x7f97ec071600 2024-03-07T07:31:17.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97f2800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0b0f80 con 0x7f97ec147d10 2024-03-07T07:31:17.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97eb400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec147d10 0x7f97ec0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97eb400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec147d10 0x7f97ec0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:58194/0 (socket says 172.21.15.84:58194) 2024-03-07T07:31:17.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97eb400640 1 -- 172.21.15.84:0/31577349 learned_addr learned my addr 172.21.15.84:0/31577349 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:17.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97e2a00640 1 --2- 172.21.15.84:0/31577349 >> v2:172.21.15.161:3300/0 conn(0x7f97ec071600 0x7f97ec0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97eb400640 1 -- 172.21.15.84:0/31577349 >> v2:172.21.15.161:3300/0 conn(0x7f97ec071600 msgr2=0x7f97ec0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:17.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97eb400640 1 --2- 172.21.15.84:0/31577349 >> v2:172.21.15.161:3300/0 conn(0x7f97ec071600 0x7f97ec0b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97eb400640 1 -- 172.21.15.84:0/31577349 >> v1:172.21.15.161:6789/0 conn(0x7f97ec0b3a00 legacy=0x7f97ec0aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.863+0000 7f97eb400640 1 -- 172.21.15.84:0/31577349 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0732f0 con 0x7f97ec147d10 2024-03-07T07:31:17.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97eb400640 1 --2- 172.21.15.84:0/31577349 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec147d10 0x7f97ec0b01c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009870 tx=0x7f97dc01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de25defe98126712 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97eaa00640 1 -- 172.21.15.84:0/31577349 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0b5070 con 0x7f97ec147d10 2024-03-07T07:31:17.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97eaa00640 1 -- 172.21.15.84:0/31577349 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc0a8a50 con 0x7f97ec147d10 2024-03-07T07:31:17.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97eaa00640 1 -- 172.21.15.84:0/31577349 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0a8e20 con 0x7f97ec147d10 2024-03-07T07:31:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97f2800640 1 -- 172.21.15.84:0/31577349 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec147d10 msgr2=0x7f97ec0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97f2800640 1 --2- 172.21.15.84:0/31577349 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec147d10 0x7f97ec0b01c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009870 tx=0x7f97dc01ed50 comp rx=0 tx=0).stop 2024-03-07T07:31:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97f2800640 1 -- 172.21.15.84:0/31577349 shutdown_connections 2024-03-07T07:31:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97f2800640 1 --2- 172.21.15.84:0/31577349 >> v2:172.21.15.161:3300/0 conn(0x7f97ec071600 0x7f97ec0b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97f2800640 1 --2- 172.21.15.84:0/31577349 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec147d10 0x7f97ec0b01c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97f2800640 1 -- 172.21.15.84:0/31577349 >> 172.21.15.84:0/31577349 conn(0x7f97ec0b1ed0 msgr2=0x7f97ec0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97f2800640 1 -- 172.21.15.84:0/31577349 shutdown_connections 2024-03-07T07:31:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.867+0000 7f97f2800640 1 -- 172.21.15.84:0/31577349 wait complete. 2024-03-07T07:31:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 Processor -- start 2024-03-07T07:31:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 -- start start 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec071600 0x7f97ec15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97ec0b3a00 0x7f97ec1448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ec147d10 0x7f97ec0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec072d30 con 0x7f97ec0b3a00 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec072a50 con 0x7f97ec147d10 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec073010 con 0x7f97ec071600 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97eb400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec071600 0x7f97ec15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97ec0b3a00 0x7f97ec1448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97eb400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec071600 0x7f97ec15dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:58202/0 (socket says 172.21.15.84:58202) 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97eb400640 1 -- 172.21.15.84:0/974956224 learned_addr learned my addr 172.21.15.84:0/974956224 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97ebe00640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ec147d10 0x7f97ec0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e2a00640 1 -- 172.21.15.84:0/974956224 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec071600 msgr2=0x7f97ec15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e2a00640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec071600 0x7f97ec15dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e2a00640 1 -- 172.21.15.84:0/974956224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ec147d10 msgr2=0x7f97ec0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e2a00640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ec147d10 0x7f97ec0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e2a00640 1 -- 172.21.15.84:0/974956224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0cb830 con 0x7f97ec0b3a00 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e2a00640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97ec0b3a00 0x7f97ec1448a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e8a0 tx=0x7f97d400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e3e00640 1 -- 172.21.15.84:0/974956224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4017070 con 0x7f97ec0b3a00 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e3e00640 1 -- 172.21.15.84:0/974956224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d400c940 con 0x7f97ec0b3a00 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97e3e00640 1 -- 172.21.15.84:0/974956224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d400ccf0 con 0x7f97ec0b3a00 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec0cbb10 con 0x7f97ec0b3a00 2024-03-07T07:31:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec0cc0d0 con 0x7f97ec0b3a00 2024-03-07T07:31:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.871+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec062d40 con 0x7f97ec0b3a00 2024-03-07T07:31:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.875+0000 7f97e3e00640 1 -- 172.21.15.84:0/974956224 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f97d401a070 con 0x7f97ec0b3a00 2024-03-07T07:31:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.875+0000 7f97e3e00640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f97c8066f60 0x7f97c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.875+0000 7f97e3e00640 1 -- 172.21.15.84:0/974956224 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97d4084f40 con 0x7f97ec0b3a00 2024-03-07T07:31:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.875+0000 7f97eb400640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f97c8066f60 0x7f97c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.875+0000 7f97eb400640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f97c8066f60 0x7f97c8069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97dc01ed90 tx=0x7f97dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:17.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:17.879+0000 7f97e3e00640 1 -- 172.21.15.84:0/974956224 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f97d40558f0 con 0x7f97ec0b3a00 2024-03-07T07:31:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.031+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97ec071e80 con 0x7f97c8066f60 2024-03-07T07:31:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.039+0000 7f97e3e00640 1 -- 172.21.15.84:0/974956224 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249498 (secure 0 0 0) 0x7f97ec071e80 con 0x7f97c8066f60 2024-03-07T07:31:18.044 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:18.046 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:31:18.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f97c8066f60 msgr2=0x7f97c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f97c8066f60 0x7f97c8069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97dc01ed90 tx=0x7f97dc009040 comp rx=0 tx=0).stop 2024-03-07T07:31:18.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97ec0b3a00 msgr2=0x7f97ec1448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97ec0b3a00 0x7f97ec1448a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e8a0 tx=0x7f97d400ed60 comp rx=0 tx=0).stop 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 shutdown_connections 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f97c8066f60 0x7f97c8069420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ec147d10 0x7f97ec0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97ec0b3a00 0x7f97ec1448a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 --2- 172.21.15.84:0/974956224 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97ec071600 0x7f97ec15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 >> 172.21.15.84:0/974956224 conn(0x7f97ec0b1ed0 msgr2=0x7f97ec1e9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 shutdown_connections 2024-03-07T07:31:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.043+0000 7f97f2800640 1 -- 172.21.15.84:0/974956224 wait complete. 2024-03-07T07:31:18.064 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-07T07:31:16.877576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218864,"kb_used_data":2676,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755856,"statfs":{"total":773094113280,"available":772869996544,"internally_reserved":0,"allocated":2740224,"data_stored":1685772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.903119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027771+0000","last_change":"2024-03-07T07:31:14.022667+0000","last_active":"2024-03-07T07:31:14.027771+0000","last_peered":"2024-03-07T07:31:14.027771+0000","last_clean":"2024-03-07T07:31:14.027771+0000","last_became_active":"2024-03-07T07:31:14.021747+0000","last_became_peered":"2024-03-07T07:31:14.021747+0000","last_unstale":"2024-03-07T07:31:14.027771+0000","last_undegraded":"2024-03-07T07:31:14.027771+0000","last_fullsized":"2024-03-07T07:31:14.027771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.004120+0000","last_change":"2024-03-07T07:31:13.004120+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.004120+0000","last_undegraded":"2024-03-07T07:31:13.004120+0000","last_fullsized":"2024-03-07T07:31:13.004120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001187+0000","last_change":"2024-03-07T07:31:13.001187+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001187+0000","last_undegraded":"2024-03-07T07:31:13.001187+0000","last_fullsized":"2024-03-07T07:31:13.001187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016604+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:14.016604+0000","last_peered":"2024-03-07T07:31:14.016604+0000","last_clean":"2024-03-07T07:31:14.016604+0000","last_became_active":"2024-03-07T07:31:14.014792+0000","last_became_peered":"2024-03-07T07:31:14.014792+0000","last_unstale":"2024-03-07T07:31:14.016604+0000","last_undegraded":"2024-03-07T07:31:14.016604+0000","last_fullsized":"2024-03-07T07:31:14.016604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:45.587377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026125+0000","last_change":"2024-03-07T07:31:14.020574+0000","last_active":"2024-03-07T07:31:14.026125+0000","last_peered":"2024-03-07T07:31:14.026125+0000","last_clean":"2024-03-07T07:31:14.026125+0000","last_became_active":"2024-03-07T07:31:14.020305+0000","last_became_peered":"2024-03-07T07:31:14.020305+0000","last_unstale":"2024-03-07T07:31:14.026125+0000","last_undegraded":"2024-03-07T07:31:14.026125+0000","last_fullsized":"2024-03-07T07:31:14.026125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016723+0000","last_change":"2024-03-07T07:31:14.014335+0000","last_active":"2024-03-07T07:31:14.016723+0000","last_peered":"2024-03-07T07:31:14.016723+0000","last_clean":"2024-03-07T07:31:14.016723+0000","last_became_active":"2024-03-07T07:31:14.013975+0000","last_became_peered":"2024-03-07T07:31:14.013975+0000","last_unstale":"2024-03-07T07:31:14.016723+0000","last_undegraded":"2024-03-07T07:31:14.016723+0000","last_fullsized":"2024-03-07T07:31:14.016723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:37:22.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026231+0000","last_change":"2024-03-07T07:31:14.021322+0000","last_active":"2024-03-07T07:31:14.026231+0000","last_peered":"2024-03-07T07:31:14.026231+0000","last_clean":"2024-03-07T07:31:14.026231+0000","last_became_active":"2024-03-07T07:31:14.021007+0000","last_became_peered":"2024-03-07T07:31:14.021007+0000","last_unstale":"2024-03-07T07:31:14.026231+0000","last_undegraded":"2024-03-07T07:31:14.026231+0000","last_fullsized":"2024-03-07T07:31:14.026231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.006273+0000","last_change":"2024-03-07T07:31:13.006273+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.006273+0000","last_undegraded":"2024-03-07T07:31:13.006273+0000","last_fullsized":"2024-03-07T07:31:13.006273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016995+0000","last_change":"2024-03-07T07:31:14.011155+0000","last_active":"2024-03-07T07:31:14.016995+0000","last_peered":"2024-03-07T07:31:14.016995+0000","last_clean":"2024-03-07T07:31:14.016995+0000","last_became_active":"2024-03-07T07:31:14.010799+0000","last_became_peered":"2024-03-07T07:31:14.010799+0000","last_unstale":"2024-03-07T07:31:14.016995+0000","last_undegraded":"2024-03-07T07:31:14.016995+0000","last_fullsized":"2024-03-07T07:31:14.016995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:11.668041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014425+0000","last_change":"2024-03-07T07:31:14.002815+0000","last_active":"2024-03-07T07:31:14.014425+0000","last_peered":"2024-03-07T07:31:14.014425+0000","last_clean":"2024-03-07T07:31:14.014425+0000","last_became_active":"2024-03-07T07:31:14.002600+0000","last_became_peered":"2024-03-07T07:31:14.002600+0000","last_unstale":"2024-03-07T07:31:14.014425+0000","last_undegraded":"2024-03-07T07:31:14.014425+0000","last_fullsized":"2024-03-07T07:31:14.014425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026157+0000","last_change":"2024-03-07T07:31:14.020556+0000","last_active":"2024-03-07T07:31:14.026157+0000","last_peered":"2024-03-07T07:31:14.026157+0000","last_clean":"2024-03-07T07:31:14.026157+0000","last_became_active":"2024-03-07T07:31:14.020256+0000","last_became_peered":"2024-03-07T07:31:14.020256+0000","last_unstale":"2024-03-07T07:31:14.026157+0000","last_undegraded":"2024-03-07T07:31:14.026157+0000","last_fullsized":"2024-03-07T07:31:14.026157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025902+0000","last_change":"2024-03-07T07:31:14.014180+0000","last_active":"2024-03-07T07:31:14.025902+0000","last_peered":"2024-03-07T07:31:14.025902+0000","last_clean":"2024-03-07T07:31:14.025902+0000","last_became_active":"2024-03-07T07:31:14.013845+0000","last_became_peered":"2024-03-07T07:31:14.013845+0000","last_unstale":"2024-03-07T07:31:14.025902+0000","last_undegraded":"2024-03-07T07:31:14.025902+0000","last_fullsized":"2024-03-07T07:31:14.025902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:05.763428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991054+0000","last_change":"2024-03-07T07:31:12.991054+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991054+0000","last_undegraded":"2024-03-07T07:31:12.991054+0000","last_fullsized":"2024-03-07T07:31:12.991054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.993627+0000","last_change":"2024-03-07T07:31:12.993627+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.993627+0000","last_undegraded":"2024-03-07T07:31:12.993627+0000","last_fullsized":"2024-03-07T07:31:12.993627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.003021+0000","last_change":"2024-03-07T07:31:13.003021+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.003021+0000","last_undegraded":"2024-03-07T07:31:13.003021+0000","last_fullsized":"2024-03-07T07:31:13.003021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.019786+0000","last_change":"2024-03-07T07:31:14.004296+0000","last_active":"2024-03-07T07:31:14.019786+0000","last_peered":"2024-03-07T07:31:14.019786+0000","last_clean":"2024-03-07T07:31:14.019786+0000","last_became_active":"2024-03-07T07:31:14.003978+0000","last_became_peered":"2024-03-07T07:31:14.003978+0000","last_unstale":"2024-03-07T07:31:14.019786+0000","last_undegraded":"2024-03-07T07:31:14.019786+0000","last_fullsized":"2024-03-07T07:31:14.019786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.029918+0000","last_change":"2024-03-07T07:31:14.026782+0000","last_active":"2024-03-07T07:31:14.029918+0000","last_peered":"2024-03-07T07:31:14.029918+0000","last_clean":"2024-03-07T07:31:14.029918+0000","last_became_active":"2024-03-07T07:31:14.026435+0000","last_became_peered":"2024-03-07T07:31:14.026435+0000","last_unstale":"2024-03-07T07:31:14.029918+0000","last_undegraded":"2024-03-07T07:31:14.029918+0000","last_fullsized":"2024-03-07T07:31:14.029918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992656+0000","last_change":"2024-03-07T07:31:12.992656+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992656+0000","last_undegraded":"2024-03-07T07:31:12.992656+0000","last_fullsized":"2024-03-07T07:31:12.992656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028130+0000","last_change":"2024-03-07T07:31:14.018840+0000","last_active":"2024-03-07T07:31:14.028130+0000","last_peered":"2024-03-07T07:31:14.028130+0000","last_clean":"2024-03-07T07:31:14.028130+0000","last_became_active":"2024-03-07T07:31:14.015465+0000","last_became_peered":"2024-03-07T07:31:14.015465+0000","last_unstale":"2024-03-07T07:31:14.028130+0000","last_undegraded":"2024-03-07T07:31:14.028130+0000","last_fullsized":"2024-03-07T07:31:14.028130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016418+0000","last_change":"2024-03-07T07:31:14.003946+0000","last_active":"2024-03-07T07:31:14.016418+0000","last_peered":"2024-03-07T07:31:14.016418+0000","last_clean":"2024-03-07T07:31:14.016418+0000","last_became_active":"2024-03-07T07:31:14.003724+0000","last_became_peered":"2024-03-07T07:31:14.003724+0000","last_unstale":"2024-03-07T07:31:14.016418+0000","last_undegraded":"2024-03-07T07:31:14.016418+0000","last_fullsized":"2024-03-07T07:31:14.016418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:31.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.988516+0000","last_change":"2024-03-07T07:31:12.988516+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.988516+0000","last_undegraded":"2024-03-07T07:31:12.988516+0000","last_fullsized":"2024-03-07T07:31:12.988516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.023700+0000","last_change":"2024-03-07T07:31:14.019962+0000","last_active":"2024-03-07T07:31:14.023700+0000","last_peered":"2024-03-07T07:31:14.023700+0000","last_clean":"2024-03-07T07:31:14.023700+0000","last_became_active":"2024-03-07T07:31:14.019664+0000","last_became_peered":"2024-03-07T07:31:14.019664+0000","last_unstale":"2024-03-07T07:31:14.023700+0000","last_undegraded":"2024-03-07T07:31:14.023700+0000","last_fullsized":"2024-03-07T07:31:14.023700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:56.429772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.994230+0000","last_change":"2024-03-07T07:31:12.994230+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.994230+0000","last_undegraded":"2024-03-07T07:31:12.994230+0000","last_fullsized":"2024-03-07T07:31:12.994230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027861+0000","last_change":"2024-03-07T07:31:14.019616+0000","last_active":"2024-03-07T07:31:14.027861+0000","last_peered":"2024-03-07T07:31:14.027861+0000","last_clean":"2024-03-07T07:31:14.027861+0000","last_became_active":"2024-03-07T07:31:14.019246+0000","last_became_peered":"2024-03-07T07:31:14.019246+0000","last_unstale":"2024-03-07T07:31:14.027861+0000","last_undegraded":"2024-03-07T07:31:14.027861+0000","last_fullsized":"2024-03-07T07:31:14.027861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001690+0000","last_change":"2024-03-07T07:31:13.001690+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001690+0000","last_undegraded":"2024-03-07T07:31:13.001690+0000","last_fullsized":"2024-03-07T07:31:13.001690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.018316+0000","last_change":"2024-03-07T07:31:14.017123+0000","last_active":"2024-03-07T07:31:14.018316+0000","last_peered":"2024-03-07T07:31:14.018316+0000","last_clean":"2024-03-07T07:31:14.018316+0000","last_became_active":"2024-03-07T07:31:14.016071+0000","last_became_peered":"2024-03-07T07:31:14.016071+0000","last_unstale":"2024-03-07T07:31:14.018316+0000","last_undegraded":"2024-03-07T07:31:14.018316+0000","last_fullsized":"2024-03-07T07:31:14.018316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:46.926372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991173+0000","last_change":"2024-03-07T07:31:12.991173+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991173+0000","last_undegraded":"2024-03-07T07:31:12.991173+0000","last_fullsized":"2024-03-07T07:31:12.991173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992584+0000","last_change":"2024-03-07T07:31:12.992584+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992584+0000","last_undegraded":"2024-03-07T07:31:12.992584+0000","last_fullsized":"2024-03-07T07:31:12.992584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.998641+0000","last_change":"2024-03-07T07:31:12.998641+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.998641+0000","last_undegraded":"2024-03-07T07:31:12.998641+0000","last_fullsized":"2024-03-07T07:31:12.998641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025797+0000","last_change":"2024-03-07T07:31:14.018277+0000","last_active":"2024-03-07T07:31:14.025797+0000","last_peered":"2024-03-07T07:31:14.025797+0000","last_clean":"2024-03-07T07:31:14.025797+0000","last_became_active":"2024-03-07T07:31:14.017969+0000","last_became_peered":"2024-03-07T07:31:14.017969+0000","last_unstale":"2024-03-07T07:31:14.025797+0000","last_undegraded":"2024-03-07T07:31:14.025797+0000","last_fullsized":"2024-03-07T07:31:14.025797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992343+0000","last_change":"2024-03-07T07:31:12.992343+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992343+0000","last_undegraded":"2024-03-07T07:31:12.992343+0000","last_fullsized":"2024-03-07T07:31:12.992343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.030095+0000","last_change":"2024-03-07T07:31:14.025073+0000","last_active":"2024-03-07T07:31:14.030095+0000","last_peered":"2024-03-07T07:31:14.030095+0000","last_clean":"2024-03-07T07:31:14.030095+0000","last_became_active":"2024-03-07T07:31:14.024374+0000","last_became_peered":"2024-03-07T07:31:14.024374+0000","last_unstale":"2024-03-07T07:31:14.030095+0000","last_undegraded":"2024-03-07T07:31:14.030095+0000","last_fullsized":"2024-03-07T07:31:14.030095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:11.668041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.011254+0000","last_change":"2024-03-07T07:31:14.009391+0000","last_active":"2024-03-07T07:31:14.011254+0000","last_peered":"2024-03-07T07:31:14.011254+0000","last_clean":"2024-03-07T07:31:14.011254+0000","last_became_active":"2024-03-07T07:31:14.009148+0000","last_became_peered":"2024-03-07T07:31:14.009148+0000","last_unstale":"2024-03-07T07:31:14.011254+0000","last_undegraded":"2024-03-07T07:31:14.011254+0000","last_fullsized":"2024-03-07T07:31:14.011254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:46.926372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.012693+0000","last_change":"2024-03-07T07:31:13.010423+0000","last_active":"2024-03-07T07:31:13.012693+0000","last_peered":"2024-03-07T07:31:13.012693+0000","last_clean":"2024-03-07T07:31:13.012693+0000","last_became_active":"2024-03-07T07:31:13.010096+0000","last_became_peered":"2024-03-07T07:31:13.010096+0000","last_unstale":"2024-03-07T07:31:13.012693+0000","last_undegraded":"2024-03-07T07:31:13.012693+0000","last_fullsized":"2024-03-07T07:31:13.012693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:24.512582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986402+0000","last_change":"2024-03-07T07:31:12.986402+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986402+0000","last_undegraded":"2024-03-07T07:31:12.986402+0000","last_fullsized":"2024-03-07T07:31:12.986402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027850+0000","last_change":"2024-03-07T07:31:13.006659+0000","last_active":"2024-03-07T07:31:14.027850+0000","last_peered":"2024-03-07T07:31:14.027850+0000","last_clean":"2024-03-07T07:31:14.027850+0000","last_became_active":"2024-03-07T07:31:13.005927+0000","last_became_peered":"2024-03-07T07:31:13.005927+0000","last_unstale":"2024-03-07T07:31:14.027850+0000","last_undegraded":"2024-03-07T07:31:14.027850+0000","last_fullsized":"2024-03-07T07:31:14.027850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010196+0000","last_change":"2024-03-07T07:31:13.003135+0000","last_active":"2024-03-07T07:31:13.010196+0000","last_peered":"2024-03-07T07:31:13.010196+0000","last_clean":"2024-03-07T07:31:13.010196+0000","last_became_active":"2024-03-07T07:31:13.002843+0000","last_became_peered":"2024-03-07T07:31:13.002843+0000","last_unstale":"2024-03-07T07:31:13.010196+0000","last_undegraded":"2024-03-07T07:31:13.010196+0000","last_fullsized":"2024-03-07T07:31:13.010196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:36:06.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.997002+0000","last_change":"2024-03-07T07:31:12.997002+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.997002+0000","last_undegraded":"2024-03-07T07:31:12.997002+0000","last_fullsized":"2024-03-07T07:31:12.997002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.997483+0000","last_change":"2024-03-07T07:31:13.006518+0000","last_active":"2024-03-07T07:31:13.997483+0000","last_peered":"2024-03-07T07:31:13.997483+0000","last_clean":"2024-03-07T07:31:13.997483+0000","last_became_active":"2024-03-07T07:31:13.005662+0000","last_became_peered":"2024-03-07T07:31:13.005662+0000","last_unstale":"2024-03-07T07:31:13.997483+0000","last_undegraded":"2024-03-07T07:31:13.997483+0000","last_fullsized":"2024-03-07T07:31:13.997483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986679+0000","last_change":"2024-03-07T07:31:12.986679+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986679+0000","last_undegraded":"2024-03-07T07:31:12.986679+0000","last_fullsized":"2024-03-07T07:31:12.986679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.997623+0000","last_change":"2024-03-07T07:31:13.014357+0000","last_active":"2024-03-07T07:31:13.997623+0000","last_peered":"2024-03-07T07:31:13.997623+0000","last_clean":"2024-03-07T07:31:13.997623+0000","last_became_active":"2024-03-07T07:31:13.014065+0000","last_became_peered":"2024-03-07T07:31:13.014065+0000","last_unstale":"2024-03-07T07:31:13.997623+0000","last_undegraded":"2024-03-07T07:31:13.997623+0000","last_fullsized":"2024-03-07T07:31:13.997623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.018298+0000","last_change":"2024-03-07T07:31:14.016928+0000","last_active":"2024-03-07T07:31:14.018298+0000","last_peered":"2024-03-07T07:31:14.018298+0000","last_clean":"2024-03-07T07:31:14.018298+0000","last_became_active":"2024-03-07T07:31:14.016029+0000","last_became_peered":"2024-03-07T07:31:14.016029+0000","last_unstale":"2024-03-07T07:31:14.018298+0000","last_undegraded":"2024-03-07T07:31:14.018298+0000","last_fullsized":"2024-03-07T07:31:14.018298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:24.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.987853+0000","last_change":"2024-03-07T07:31:13.017045+0000","last_active":"2024-03-07T07:31:13.987853+0000","last_peered":"2024-03-07T07:31:13.987853+0000","last_clean":"2024-03-07T07:31:13.987853+0000","last_became_active":"2024-03-07T07:31:13.016712+0000","last_became_peered":"2024-03-07T07:31:13.016712+0000","last_unstale":"2024-03-07T07:31:13.987853+0000","last_undegraded":"2024-03-07T07:31:13.987853+0000","last_fullsized":"2024-03-07T07:31:13.987853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.000461+0000","last_change":"2024-03-07T07:31:13.000461+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.000461+0000","last_undegraded":"2024-03-07T07:31:13.000461+0000","last_fullsized":"2024-03-07T07:31:13.000461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010890+0000","last_change":"2024-03-07T07:31:13.004264+0000","last_active":"2024-03-07T07:31:13.010890+0000","last_peered":"2024-03-07T07:31:13.010890+0000","last_clean":"2024-03-07T07:31:13.010890+0000","last_became_active":"2024-03-07T07:31:13.003883+0000","last_became_peered":"2024-03-07T07:31:13.003883+0000","last_unstale":"2024-03-07T07:31:13.010890+0000","last_undegraded":"2024-03-07T07:31:13.010890+0000","last_fullsized":"2024-03-07T07:31:13.010890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:37.603421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025523+0000","last_change":"2024-03-07T07:31:14.007051+0000","last_active":"2024-03-07T07:31:14.025523+0000","last_peered":"2024-03-07T07:31:14.025523+0000","last_clean":"2024-03-07T07:31:14.025523+0000","last_became_active":"2024-03-07T07:31:14.005904+0000","last_became_peered":"2024-03-07T07:31:14.005904+0000","last_unstale":"2024-03-07T07:31:14.025523+0000","last_undegraded":"2024-03-07T07:31:14.025523+0000","last_fullsized":"2024-03-07T07:31:14.025523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.031099+0000","last_change":"2024-03-07T07:31:12.997602+0000","last_active":"2024-03-07T07:31:14.031099+0000","last_peered":"2024-03-07T07:31:14.031099+0000","last_clean":"2024-03-07T07:31:14.031099+0000","last_became_active":"2024-03-07T07:31:12.997204+0000","last_became_peered":"2024-03-07T07:31:12.997204+0000","last_unstale":"2024-03-07T07:31:14.031099+0000","last_undegraded":"2024-03-07T07:31:14.031099+0000","last_fullsized":"2024-03-07T07:31:14.031099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.032451+0000","last_change":"2024-03-07T07:31:14.028791+0000","last_active":"2024-03-07T07:31:14.032451+0000","last_peered":"2024-03-07T07:31:14.032451+0000","last_clean":"2024-03-07T07:31:14.032451+0000","last_became_active":"2024-03-07T07:31:14.028591+0000","last_became_peered":"2024-03-07T07:31:14.028591+0000","last_unstale":"2024-03-07T07:31:14.032451+0000","last_undegraded":"2024-03-07T07:31:14.032451+0000","last_fullsized":"2024-03-07T07:31:14.032451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.015380+0000","last_change":"2024-03-07T07:31:13.011937+0000","last_active":"2024-03-07T07:31:13.015380+0000","last_peered":"2024-03-07T07:31:13.015380+0000","last_clean":"2024-03-07T07:31:13.015380+0000","last_became_active":"2024-03-07T07:31:13.011577+0000","last_became_peered":"2024-03-07T07:31:13.011577+0000","last_unstale":"2024-03-07T07:31:13.015380+0000","last_undegraded":"2024-03-07T07:31:13.015380+0000","last_fullsized":"2024-03-07T07:31:13.015380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990977+0000","last_change":"2024-03-07T07:31:12.990977+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990977+0000","last_undegraded":"2024-03-07T07:31:12.990977+0000","last_fullsized":"2024-03-07T07:31:12.990977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004304+0000","last_change":"2024-03-07T07:31:13.000961+0000","last_active":"2024-03-07T07:31:14.004304+0000","last_peered":"2024-03-07T07:31:14.004304+0000","last_clean":"2024-03-07T07:31:14.004304+0000","last_became_active":"2024-03-07T07:31:13.000129+0000","last_became_peered":"2024-03-07T07:31:13.000129+0000","last_unstale":"2024-03-07T07:31:14.004304+0000","last_undegraded":"2024-03-07T07:31:14.004304+0000","last_fullsized":"2024-03-07T07:31:14.004304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:58.045352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028425+0000","last_change":"2024-03-07T07:31:14.022537+0000","last_active":"2024-03-07T07:31:14.028425+0000","last_peered":"2024-03-07T07:31:14.028425+0000","last_clean":"2024-03-07T07:31:14.028425+0000","last_became_active":"2024-03-07T07:31:14.022221+0000","last_became_peered":"2024-03-07T07:31:14.022221+0000","last_unstale":"2024-03-07T07:31:14.028425+0000","last_undegraded":"2024-03-07T07:31:14.028425+0000","last_fullsized":"2024-03-07T07:31:14.028425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.986705+0000","last_change":"2024-03-07T07:31:13.009533+0000","last_active":"2024-03-07T07:31:13.986705+0000","last_peered":"2024-03-07T07:31:13.986705+0000","last_clean":"2024-03-07T07:31:13.986705+0000","last_became_active":"2024-03-07T07:31:13.009224+0000","last_became_peered":"2024-03-07T07:31:13.009224+0000","last_unstale":"2024-03-07T07:31:13.986705+0000","last_undegraded":"2024-03-07T07:31:13.986705+0000","last_fullsized":"2024-03-07T07:31:13.986705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:40.675440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.019222+0000","last_change":"2024-03-07T07:31:14.015133+0000","last_active":"2024-03-07T07:31:14.019222+0000","last_peered":"2024-03-07T07:31:14.019222+0000","last_clean":"2024-03-07T07:31:14.019222+0000","last_became_active":"2024-03-07T07:31:14.014859+0000","last_became_peered":"2024-03-07T07:31:14.014859+0000","last_unstale":"2024-03-07T07:31:14.019222+0000","last_undegraded":"2024-03-07T07:31:14.019222+0000","last_fullsized":"2024-03-07T07:31:14.019222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:41.682431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011044+0000","last_change":"2024-03-07T07:31:13.000976+0000","last_active":"2024-03-07T07:31:13.011044+0000","last_peered":"2024-03-07T07:31:13.011044+0000","last_clean":"2024-03-07T07:31:13.011044+0000","last_became_active":"2024-03-07T07:31:13.000624+0000","last_became_peered":"2024-03-07T07:31:13.000624+0000","last_unstale":"2024-03-07T07:31:13.011044+0000","last_undegraded":"2024-03-07T07:31:13.011044+0000","last_fullsized":"2024-03-07T07:31:13.011044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:36:06.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025488+0000","last_change":"2024-03-07T07:31:14.008321+0000","last_active":"2024-03-07T07:31:14.025488+0000","last_peered":"2024-03-07T07:31:14.025488+0000","last_clean":"2024-03-07T07:31:14.025488+0000","last_became_active":"2024-03-07T07:31:14.008039+0000","last_became_peered":"2024-03-07T07:31:14.008039+0000","last_unstale":"2024-03-07T07:31:14.025488+0000","last_undegraded":"2024-03-07T07:31:14.025488+0000","last_fullsized":"2024-03-07T07:31:14.025488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.023370+0000","last_change":"2024-03-07T07:31:13.008580+0000","last_active":"2024-03-07T07:31:14.023370+0000","last_peered":"2024-03-07T07:31:14.023370+0000","last_clean":"2024-03-07T07:31:14.023370+0000","last_became_active":"2024-03-07T07:31:13.008276+0000","last_became_peered":"2024-03-07T07:31:13.008276+0000","last_unstale":"2024-03-07T07:31:14.023370+0000","last_undegraded":"2024-03-07T07:31:14.023370+0000","last_fullsized":"2024-03-07T07:31:14.023370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.008377+0000","last_change":"2024-03-07T07:31:14.003764+0000","last_active":"2024-03-07T07:31:14.008377+0000","last_peered":"2024-03-07T07:31:14.008377+0000","last_clean":"2024-03-07T07:31:14.008377+0000","last_became_active":"2024-03-07T07:31:14.002976+0000","last_became_peered":"2024-03-07T07:31:14.002976+0000","last_unstale":"2024-03-07T07:31:14.008377+0000","last_undegraded":"2024-03-07T07:31:14.008377+0000","last_fullsized":"2024-03-07T07:31:14.008377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:51.219777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013778+0000","last_change":"2024-03-07T07:31:13.010016+0000","last_active":"2024-03-07T07:31:13.013778+0000","last_peered":"2024-03-07T07:31:13.013778+0000","last_clean":"2024-03-07T07:31:13.013778+0000","last_became_active":"2024-03-07T07:31:13.009751+0000","last_became_peered":"2024-03-07T07:31:13.009751+0000","last_unstale":"2024-03-07T07:31:13.013778+0000","last_undegraded":"2024-03-07T07:31:13.013778+0000","last_fullsized":"2024-03-07T07:31:13.013778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:45:09.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025474+0000","last_change":"2024-03-07T07:31:14.013078+0000","last_active":"2024-03-07T07:31:14.025474+0000","last_peered":"2024-03-07T07:31:14.025474+0000","last_clean":"2024-03-07T07:31:14.025474+0000","last_became_active":"2024-03-07T07:31:14.012816+0000","last_became_peered":"2024-03-07T07:31:14.012816+0000","last_unstale":"2024-03-07T07:31:14.025474+0000","last_undegraded":"2024-03-07T07:31:14.025474+0000","last_fullsized":"2024-03-07T07:31:14.025474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:18.111128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.020779+0000","last_change":"2024-03-07T07:31:13.016042+0000","last_active":"2024-03-07T07:31:13.020779+0000","last_peered":"2024-03-07T07:31:13.020779+0000","last_clean":"2024-03-07T07:31:13.020779+0000","last_became_active":"2024-03-07T07:31:13.015749+0000","last_became_peered":"2024-03-07T07:31:13.015749+0000","last_unstale":"2024-03-07T07:31:13.020779+0000","last_undegraded":"2024-03-07T07:31:13.020779+0000","last_fullsized":"2024-03-07T07:31:13.020779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025934+0000","last_change":"2024-03-07T07:31:14.015090+0000","last_active":"2024-03-07T07:31:14.025934+0000","last_peered":"2024-03-07T07:31:14.025934+0000","last_clean":"2024-03-07T07:31:14.025934+0000","last_became_active":"2024-03-07T07:31:14.014806+0000","last_became_peered":"2024-03-07T07:31:14.014806+0000","last_unstale":"2024-03-07T07:31:14.025934+0000","last_undegraded":"2024-03-07T07:31:14.025934+0000","last_fullsized":"2024-03-07T07:31:14.025934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:37.677717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010244+0000","last_change":"2024-03-07T07:31:13.002882+0000","last_active":"2024-03-07T07:31:13.010244+0000","last_peered":"2024-03-07T07:31:13.010244+0000","last_clean":"2024-03-07T07:31:13.010244+0000","last_became_active":"2024-03-07T07:31:13.002570+0000","last_became_peered":"2024-03-07T07:31:13.002570+0000","last_unstale":"2024-03-07T07:31:13.010244+0000","last_undegraded":"2024-03-07T07:31:13.010244+0000","last_fullsized":"2024-03-07T07:31:13.010244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:47:07.277106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025420+0000","last_change":"2024-03-07T07:31:14.008276+0000","last_active":"2024-03-07T07:31:14.025420+0000","last_peered":"2024-03-07T07:31:14.025420+0000","last_clean":"2024-03-07T07:31:14.025420+0000","last_became_active":"2024-03-07T07:31:14.007776+0000","last_became_peered":"2024-03-07T07:31:14.007776+0000","last_unstale":"2024-03-07T07:31:14.025420+0000","last_undegraded":"2024-03-07T07:31:14.025420+0000","last_fullsized":"2024-03-07T07:31:14.025420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.995173+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:31:13.995173+0000","last_peered":"2024-03-07T07:31:13.995173+0000","last_clean":"2024-03-07T07:31:13.995173+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:31:13.995173+0000","last_undegraded":"2024-03-07T07:31:13.995173+0000","last_fullsized":"2024-03-07T07:31:13.995173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004578+0000","last_change":"2024-03-07T07:31:13.008377+0000","last_active":"2024-03-07T07:31:14.004578+0000","last_peered":"2024-03-07T07:31:14.004578+0000","last_clean":"2024-03-07T07:31:14.004578+0000","last_became_active":"2024-03-07T07:31:13.007831+0000","last_became_peered":"2024-03-07T07:31:13.007831+0000","last_unstale":"2024-03-07T07:31:14.004578+0000","last_undegraded":"2024-03-07T07:31:14.004578+0000","last_fullsized":"2024-03-07T07:31:14.004578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:04.756437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986419+0000","last_change":"2024-03-07T07:31:12.986419+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986419+0000","last_undegraded":"2024-03-07T07:31:12.986419+0000","last_fullsized":"2024-03-07T07:31:12.986419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.003599+0000","last_change":"2024-03-07T07:31:13.008418+0000","last_active":"2024-03-07T07:31:14.003599+0000","last_peered":"2024-03-07T07:31:14.003599+0000","last_clean":"2024-03-07T07:31:14.003599+0000","last_became_active":"2024-03-07T07:31:13.008022+0000","last_became_peered":"2024-03-07T07:31:13.008022+0000","last_unstale":"2024-03-07T07:31:14.003599+0000","last_undegraded":"2024-03-07T07:31:14.003599+0000","last_fullsized":"2024-03-07T07:31:14.003599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990303+0000","last_change":"2024-03-07T07:31:12.990303+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990303+0000","last_undegraded":"2024-03-07T07:31:12.990303+0000","last_fullsized":"2024-03-07T07:31:12.990303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.020519+0000","last_change":"2024-03-07T07:31:13.012807+0000","last_active":"2024-03-07T07:31:13.020519+0000","last_peered":"2024-03-07T07:31:13.020519+0000","last_clean":"2024-03-07T07:31:13.020519+0000","last_became_active":"2024-03-07T07:31:13.011968+0000","last_became_peered":"2024-03-07T07:31:13.011968+0000","last_unstale":"2024-03-07T07:31:13.020519+0000","last_undegraded":"2024-03-07T07:31:13.020519+0000","last_fullsized":"2024-03-07T07:31:13.020519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:50.212787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.005761+0000","last_change":"2024-03-07T07:31:13.005761+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.005761+0000","last_undegraded":"2024-03-07T07:31:13.005761+0000","last_fullsized":"2024-03-07T07:31:13.005761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004381+0000","last_change":"2024-03-07T07:31:13.004811+0000","last_active":"2024-03-07T07:31:14.004381+0000","last_peered":"2024-03-07T07:31:14.004381+0000","last_clean":"2024-03-07T07:31:14.004381+0000","last_became_active":"2024-03-07T07:31:13.001378+0000","last_became_peered":"2024-03-07T07:31:13.001378+0000","last_unstale":"2024-03-07T07:31:14.004381+0000","last_undegraded":"2024-03-07T07:31:14.004381+0000","last_fullsized":"2024-03-07T07:31:14.004381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:30.900538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.020685+0000","last_change":"2024-03-07T07:31:14.001567+0000","last_active":"2024-03-07T07:31:14.020685+0000","last_peered":"2024-03-07T07:31:14.020685+0000","last_clean":"2024-03-07T07:31:14.020685+0000","last_became_active":"2024-03-07T07:31:14.001209+0000","last_became_peered":"2024-03-07T07:31:14.001209+0000","last_unstale":"2024-03-07T07:31:14.020685+0000","last_undegraded":"2024-03-07T07:31:14.020685+0000","last_fullsized":"2024-03-07T07:31:14.020685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011322+0000","last_change":"2024-03-07T07:31:13.009741+0000","last_active":"2024-03-07T07:31:13.011322+0000","last_peered":"2024-03-07T07:31:13.011322+0000","last_clean":"2024-03-07T07:31:13.011322+0000","last_became_active":"2024-03-07T07:31:13.009377+0000","last_became_peered":"2024-03-07T07:31:13.009377+0000","last_unstale":"2024-03-07T07:31:13.011322+0000","last_undegraded":"2024-03-07T07:31:13.011322+0000","last_fullsized":"2024-03-07T07:31:13.011322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:46:14.381163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.032452+0000","last_change":"2024-03-07T07:31:14.029593+0000","last_active":"2024-03-07T07:31:14.032452+0000","last_peered":"2024-03-07T07:31:14.032452+0000","last_clean":"2024-03-07T07:31:14.032452+0000","last_became_active":"2024-03-07T07:31:14.029271+0000","last_became_peered":"2024-03-07T07:31:14.029271+0000","last_unstale":"2024-03-07T07:31:14.032452+0000","last_undegraded":"2024-03-07T07:31:14.032452+0000","last_fullsized":"2024-03-07T07:31:14.032452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:41.682431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004972+0000","last_change":"2024-03-07T07:31:12.999335+0000","last_active":"2024-03-07T07:31:14.004972+0000","last_peered":"2024-03-07T07:31:14.004972+0000","last_clean":"2024-03-07T07:31:14.004972+0000","last_became_active":"2024-03-07T07:31:12.998960+0000","last_became_peered":"2024-03-07T07:31:12.998960+0000","last_unstale":"2024-03-07T07:31:14.004972+0000","last_undegraded":"2024-03-07T07:31:14.004972+0000","last_fullsized":"2024-03-07T07:31:14.004972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:36.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990933+0000","last_change":"2024-03-07T07:31:12.990933+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990933+0000","last_undegraded":"2024-03-07T07:31:12.990933+0000","last_fullsized":"2024-03-07T07:31:12.990933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013696+0000","last_change":"2024-03-07T07:31:13.004776+0000","last_active":"2024-03-07T07:31:13.013696+0000","last_peered":"2024-03-07T07:31:13.013696+0000","last_clean":"2024-03-07T07:31:13.013696+0000","last_became_active":"2024-03-07T07:31:13.004179+0000","last_became_peered":"2024-03-07T07:31:13.004179+0000","last_unstale":"2024-03-07T07:31:13.013696+0000","last_undegraded":"2024-03-07T07:31:13.013696+0000","last_fullsized":"2024-03-07T07:31:13.013696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:45.950345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986414+0000","last_change":"2024-03-07T07:31:12.986414+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986414+0000","last_undegraded":"2024-03-07T07:31:12.986414+0000","last_fullsized":"2024-03-07T07:31:12.986414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026653+0000","last_change":"2024-03-07T07:31:13.014574+0000","last_active":"2024-03-07T07:31:14.026653+0000","last_peered":"2024-03-07T07:31:14.026653+0000","last_clean":"2024-03-07T07:31:14.026653+0000","last_became_active":"2024-03-07T07:31:13.014264+0000","last_became_peered":"2024-03-07T07:31:13.014264+0000","last_unstale":"2024-03-07T07:31:14.026653+0000","last_undegraded":"2024-03-07T07:31:14.026653+0000","last_fullsized":"2024-03-07T07:31:14.026653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.987092+0000","last_change":"2024-03-07T07:31:12.987092+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.987092+0000","last_undegraded":"2024-03-07T07:31:12.987092+0000","last_fullsized":"2024-03-07T07:31:12.987092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.986217+0000","last_change":"2024-03-07T07:31:13.010611+0000","last_active":"2024-03-07T07:31:13.986217+0000","last_peered":"2024-03-07T07:31:13.986217+0000","last_clean":"2024-03-07T07:31:13.986217+0000","last_became_active":"2024-03-07T07:31:13.005305+0000","last_became_peered":"2024-03-07T07:31:13.005305+0000","last_unstale":"2024-03-07T07:31:13.986217+0000","last_undegraded":"2024-03-07T07:31:13.986217+0000","last_fullsized":"2024-03-07T07:31:13.986217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:10.661050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028674+0000","last_change":"2024-03-07T07:31:14.021524+0000","last_active":"2024-03-07T07:31:14.028674+0000","last_peered":"2024-03-07T07:31:14.028674+0000","last_clean":"2024-03-07T07:31:14.028674+0000","last_became_active":"2024-03-07T07:31:14.021248+0000","last_became_peered":"2024-03-07T07:31:14.021248+0000","last_unstale":"2024-03-07T07:31:14.028674+0000","last_undegraded":"2024-03-07T07:31:14.028674+0000","last_fullsized":"2024-03-07T07:31:14.028674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013629+0000","last_change":"2024-03-07T07:31:13.002330+0000","last_active":"2024-03-07T07:31:13.013629+0000","last_peered":"2024-03-07T07:31:13.013629+0000","last_clean":"2024-03-07T07:31:13.013629+0000","last_became_active":"2024-03-07T07:31:13.002030+0000","last_became_peered":"2024-03-07T07:31:13.002030+0000","last_unstale":"2024-03-07T07:31:13.013629+0000","last_undegraded":"2024-03-07T07:31:13.013629+0000","last_fullsized":"2024-03-07T07:31:13.013629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:08:44.860696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.987514+0000","last_change":"2024-03-07T07:31:12.987514+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.987514+0000","last_undegraded":"2024-03-07T07:31:12.987514+0000","last_fullsized":"2024-03-07T07:31:12.987514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011105+0000","last_change":"2024-03-07T07:31:13.008737+0000","last_active":"2024-03-07T07:31:13.011105+0000","last_peered":"2024-03-07T07:31:13.011105+0000","last_clean":"2024-03-07T07:31:13.011105+0000","last_became_active":"2024-03-07T07:31:13.008485+0000","last_became_peered":"2024-03-07T07:31:13.008485+0000","last_unstale":"2024-03-07T07:31:13.011105+0000","last_undegraded":"2024-03-07T07:31:13.011105+0000","last_fullsized":"2024-03-07T07:31:13.011105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:08:44.860696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991966+0000","last_change":"2024-03-07T07:31:12.991966+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991966+0000","last_undegraded":"2024-03-07T07:31:12.991966+0000","last_fullsized":"2024-03-07T07:31:12.991966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025664+0000","last_change":"2024-03-07T07:31:13.008117+0000","last_active":"2024-03-07T07:31:14.025664+0000","last_peered":"2024-03-07T07:31:14.025664+0000","last_clean":"2024-03-07T07:31:14.025664+0000","last_became_active":"2024-03-07T07:31:13.006517+0000","last_became_peered":"2024-03-07T07:31:13.006517+0000","last_unstale":"2024-03-07T07:31:14.025664+0000","last_undegraded":"2024-03-07T07:31:14.025664+0000","last_fullsized":"2024-03-07T07:31:14.025664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:17.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025684+0000","last_change":"2024-03-07T07:31:14.011780+0000","last_active":"2024-03-07T07:31:14.025684+0000","last_peered":"2024-03-07T07:31:14.025684+0000","last_clean":"2024-03-07T07:31:14.025684+0000","last_became_active":"2024-03-07T07:31:14.011509+0000","last_became_peered":"2024-03-07T07:31:14.011509+0000","last_unstale":"2024-03-07T07:31:14.025684+0000","last_undegraded":"2024-03-07T07:31:14.025684+0000","last_fullsized":"2024-03-07T07:31:14.025684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028411+0000","last_change":"2024-03-07T07:31:14.024307+0000","last_active":"2024-03-07T07:31:14.028411+0000","last_peered":"2024-03-07T07:31:14.028411+0000","last_clean":"2024-03-07T07:31:14.028411+0000","last_became_active":"2024-03-07T07:31:14.024003+0000","last_became_peered":"2024-03-07T07:31:14.024003+0000","last_unstale":"2024-03-07T07:31:14.028411+0000","last_undegraded":"2024-03-07T07:31:14.028411+0000","last_fullsized":"2024-03-07T07:31:14.028411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014498+0000","last_change":"2024-03-07T07:31:13.017220+0000","last_active":"2024-03-07T07:31:14.014498+0000","last_peered":"2024-03-07T07:31:14.014498+0000","last_clean":"2024-03-07T07:31:14.014498+0000","last_became_active":"2024-03-07T07:31:13.016766+0000","last_became_peered":"2024-03-07T07:31:13.016766+0000","last_unstale":"2024-03-07T07:31:14.014498+0000","last_undegraded":"2024-03-07T07:31:14.014498+0000","last_fullsized":"2024-03-07T07:31:14.014498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.010263+0000","last_change":"2024-03-07T07:31:14.008305+0000","last_active":"2024-03-07T07:31:14.010263+0000","last_peered":"2024-03-07T07:31:14.010263+0000","last_clean":"2024-03-07T07:31:14.010263+0000","last_became_active":"2024-03-07T07:31:14.006803+0000","last_became_peered":"2024-03-07T07:31:14.006803+0000","last_unstale":"2024-03-07T07:31:14.010263+0000","last_undegraded":"2024-03-07T07:31:14.010263+0000","last_fullsized":"2024-03-07T07:31:14.010263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:24.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014088+0000","last_change":"2024-03-07T07:31:13.016945+0000","last_active":"2024-03-07T07:31:14.014088+0000","last_peered":"2024-03-07T07:31:14.014088+0000","last_clean":"2024-03-07T07:31:14.014088+0000","last_became_active":"2024-03-07T07:31:13.016362+0000","last_became_peered":"2024-03-07T07:31:13.016362+0000","last_unstale":"2024-03-07T07:31:14.014088+0000","last_undegraded":"2024-03-07T07:31:14.014088+0000","last_fullsized":"2024-03-07T07:31:14.014088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001103+0000","last_change":"2024-03-07T07:31:13.001103+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001103+0000","last_undegraded":"2024-03-07T07:31:13.001103+0000","last_fullsized":"2024-03-07T07:31:13.001103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013451+0000","last_change":"2024-03-07T07:31:13.011989+0000","last_active":"2024-03-07T07:31:13.013451+0000","last_peered":"2024-03-07T07:31:13.013451+0000","last_clean":"2024-03-07T07:31:13.013451+0000","last_became_active":"2024-03-07T07:31:13.011663+0000","last_became_peered":"2024-03-07T07:31:13.011663+0000","last_unstale":"2024-03-07T07:31:13.013451+0000","last_undegraded":"2024-03-07T07:31:13.013451+0000","last_fullsized":"2024-03-07T07:31:13.013451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:37.603421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.003631+0000","last_change":"2024-03-07T07:31:13.003631+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.003631+0000","last_undegraded":"2024-03-07T07:31:13.003631+0000","last_fullsized":"2024-03-07T07:31:13.003631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.002561+0000","last_change":"2024-03-07T07:31:12.997330+0000","last_active":"2024-03-07T07:31:13.002561+0000","last_peered":"2024-03-07T07:31:13.002561+0000","last_clean":"2024-03-07T07:31:13.002561+0000","last_became_active":"2024-03-07T07:31:12.997026+0000","last_became_peered":"2024-03-07T07:31:12.997026+0000","last_unstale":"2024-03-07T07:31:13.002561+0000","last_undegraded":"2024-03-07T07:31:13.002561+0000","last_fullsized":"2024-03-07T07:31:13.002561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:47:07.277106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":66809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":656665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":649820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:31:18.069 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:31:18.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.239+0000 7fb251800640 1 Processor -- start 2024-03-07T07:31:18.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.239+0000 7fb251800640 1 -- start start 2024-03-07T07:31:18.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb251800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb24c15e450 0x7fb24c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb251800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 0x7fb24c06be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb251800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0d0e20 con 0x7fb24c0b1260 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb251800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c0cbe10 con 0x7fb24c15e450 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb251800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0ce010 con 0x7fb24c0b16a0 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24aa00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb24c15e450 0x7fb24c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24aa00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb24c15e450 0x7fb24c0cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38760/0 (socket says 172.21.15.84:38760) 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24aa00640 1 -- 172.21.15.84:0/3552802918 learned_addr learned my addr 172.21.15.84:0/3552802918 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb242000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb24c0b1260 0x7fb24c06b6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:57608/0 (socket says 172.21.15.84:57608) 2024-03-07T07:31:18.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24b400640 1 --2- 172.21.15.84:0/3552802918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 0x7fb24c06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24aa00640 1 -- 172.21.15.84:0/3552802918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 msgr2=0x7fb24c06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:18.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24aa00640 1 --2- 172.21.15.84:0/3552802918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 0x7fb24c06be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24aa00640 1 -- 172.21.15.84:0/3552802918 >> v1:172.21.15.161:6789/0 conn(0x7fb24c0b1260 legacy=0x7fb24c06b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24a000640 1 -- 172.21.15.84:0/3552802918 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262478194 0 0) 0x7fb24c0d0e20 con 0x7fb24c0b1260 2024-03-07T07:31:18.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.243+0000 7fb24aa00640 1 -- 172.21.15.84:0/3552802918 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0cb7c0 con 0x7fb24c15e450 2024-03-07T07:31:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb24aa00640 1 --2- 172.21.15.84:0/3552802918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0cc2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009870 tx=0x7fb23c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b50397e529e72dd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb24a000640 1 -- 172.21.15.84:0/3552802918 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0aa650 con 0x7fb24c15e450 2024-03-07T07:31:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb24a000640 1 -- 172.21.15.84:0/3552802918 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c0af070 con 0x7fb24c15e450 2024-03-07T07:31:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb24a000640 1 -- 172.21.15.84:0/3552802918 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0aaa10 con 0x7fb24c15e450 2024-03-07T07:31:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- 172.21.15.84:0/3552802918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 msgr2=0x7fb24c0cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 --2- 172.21.15.84:0/3552802918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0cc2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009870 tx=0x7fb23c01c530 comp rx=0 tx=0).stop 2024-03-07T07:31:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- 172.21.15.84:0/3552802918 shutdown_connections 2024-03-07T07:31:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 --2- 172.21.15.84:0/3552802918 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 0x7fb24c06be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 --2- 172.21.15.84:0/3552802918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0cc2a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- 172.21.15.84:0/3552802918 >> 172.21.15.84:0/3552802918 conn(0x7fb24c0b4400 msgr2=0x7fb24c0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:18.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- 172.21.15.84:0/3552802918 shutdown_connections 2024-03-07T07:31:18.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- 172.21.15.84:0/3552802918 wait complete. 2024-03-07T07:31:18.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 Processor -- start 2024-03-07T07:31:18.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- start start 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb24c0b1260 0x7fb24c14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 0x7fb24c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c15e9b0 con 0x7fb24c15e450 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c15e830 con 0x7fb24c0b1260 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb251800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0cea20 con 0x7fb24c0b16a0 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb24b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb242000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 0x7fb24c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.247+0000 7fb24aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb24c0b1260 0x7fb24c14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38762/0 (socket says 172.21.15.84:38762) 2024-03-07T07:31:18.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24aa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb24c0b1260 0x7fb24c14c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51912/0 (socket says 172.21.15.84:51912) 2024-03-07T07:31:18.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24b400640 1 -- 172.21.15.84:0/2612981627 learned_addr learned my addr 172.21.15.84:0/2612981627 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24b400640 1 -- 172.21.15.84:0/2612981627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 msgr2=0x7fb24c156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24b400640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 0x7fb24c156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24b400640 1 -- 172.21.15.84:0/2612981627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb24c0b1260 msgr2=0x7fb24c14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24b400640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb24c0b1260 0x7fb24c14c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24b400640 1 -- 172.21.15.84:0/2612981627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c156e50 con 0x7fb24c15e450 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24aa00640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb24c0b1260 0x7fb24c14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb24b400640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0b2a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb24400efc0 tx=0x7fb24400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb243400640 1 -- 172.21.15.84:0/2612981627 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244018020 con 0x7fb24c15e450 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb243400640 1 -- 172.21.15.84:0/2612981627 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244014480 con 0x7fb24c15e450 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb243400640 1 -- 172.21.15.84:0/2612981627 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244014870 con 0x7fb24c15e450 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c157130 con 0x7fb24c15e450 2024-03-07T07:31:18.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c0b5900 con 0x7fb24c15e450 2024-03-07T07:31:18.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c062d40 con 0x7fb24c15e450 2024-03-07T07:31:18.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.251+0000 7fb243400640 1 -- 172.21.15.84:0/2612981627 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb24401b020 con 0x7fb24c15e450 2024-03-07T07:31:18.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.255+0000 7fb243400640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb228066f60 0x7fb228069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.255+0000 7fb243400640 1 -- 172.21.15.84:0/2612981627 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb244085dc0 con 0x7fb24c15e450 2024-03-07T07:31:18.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.255+0000 7fb24aa00640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb228066f60 0x7fb228069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.255+0000 7fb24aa00640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb228066f60 0x7fb228069420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0ae000 tx=0x7fb23c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:18.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.259+0000 7fb243400640 1 -- 172.21.15.84:0/2612981627 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb244022030 con 0x7fb24c15e450 2024-03-07T07:31:18.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.407+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb24c072200 con 0x7fb228066f60 2024-03-07T07:31:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.415+0000 7fb243400640 1 -- 172.21.15.84:0/2612981627 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249498 (secure 0 0 0) 0x7fb24c072200 con 0x7fb228066f60 2024-03-07T07:31:18.420 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:18.421 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:31:18.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb228066f60 msgr2=0x7fb228069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb228066f60 0x7fb228069420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0ae000 tx=0x7fb23c0a7000 comp rx=0 tx=0).stop 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 msgr2=0x7fb24c0b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0b2a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb24400efc0 tx=0x7fb24400c490 comp rx=0 tx=0).stop 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 shutdown_connections 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb228066f60 0x7fb228069420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb24c15e450 0x7fb24c0b2a80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb24c0b16a0 0x7fb24c156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 --2- 172.21.15.84:0/2612981627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb24c0b1260 0x7fb24c14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 >> 172.21.15.84:0/2612981627 conn(0x7fb24c0b4400 msgr2=0x7fb24c0724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 shutdown_connections 2024-03-07T07:31:18.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.419+0000 7fb251800640 1 -- 172.21.15.84:0/2612981627 wait complete. 2024-03-07T07:31:18.441 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-07T07:31:16.877576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218864,"kb_used_data":2676,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755856,"statfs":{"total":773094113280,"available":772869996544,"internally_reserved":0,"allocated":2740224,"data_stored":1685772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.903119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027771+0000","last_change":"2024-03-07T07:31:14.022667+0000","last_active":"2024-03-07T07:31:14.027771+0000","last_peered":"2024-03-07T07:31:14.027771+0000","last_clean":"2024-03-07T07:31:14.027771+0000","last_became_active":"2024-03-07T07:31:14.021747+0000","last_became_peered":"2024-03-07T07:31:14.021747+0000","last_unstale":"2024-03-07T07:31:14.027771+0000","last_undegraded":"2024-03-07T07:31:14.027771+0000","last_fullsized":"2024-03-07T07:31:14.027771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.004120+0000","last_change":"2024-03-07T07:31:13.004120+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.004120+0000","last_undegraded":"2024-03-07T07:31:13.004120+0000","last_fullsized":"2024-03-07T07:31:13.004120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001187+0000","last_change":"2024-03-07T07:31:13.001187+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001187+0000","last_undegraded":"2024-03-07T07:31:13.001187+0000","last_fullsized":"2024-03-07T07:31:13.001187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016604+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:14.016604+0000","last_peered":"2024-03-07T07:31:14.016604+0000","last_clean":"2024-03-07T07:31:14.016604+0000","last_became_active":"2024-03-07T07:31:14.014792+0000","last_became_peered":"2024-03-07T07:31:14.014792+0000","last_unstale":"2024-03-07T07:31:14.016604+0000","last_undegraded":"2024-03-07T07:31:14.016604+0000","last_fullsized":"2024-03-07T07:31:14.016604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:45.587377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026125+0000","last_change":"2024-03-07T07:31:14.020574+0000","last_active":"2024-03-07T07:31:14.026125+0000","last_peered":"2024-03-07T07:31:14.026125+0000","last_clean":"2024-03-07T07:31:14.026125+0000","last_became_active":"2024-03-07T07:31:14.020305+0000","last_became_peered":"2024-03-07T07:31:14.020305+0000","last_unstale":"2024-03-07T07:31:14.026125+0000","last_undegraded":"2024-03-07T07:31:14.026125+0000","last_fullsized":"2024-03-07T07:31:14.026125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016723+0000","last_change":"2024-03-07T07:31:14.014335+0000","last_active":"2024-03-07T07:31:14.016723+0000","last_peered":"2024-03-07T07:31:14.016723+0000","last_clean":"2024-03-07T07:31:14.016723+0000","last_became_active":"2024-03-07T07:31:14.013975+0000","last_became_peered":"2024-03-07T07:31:14.013975+0000","last_unstale":"2024-03-07T07:31:14.016723+0000","last_undegraded":"2024-03-07T07:31:14.016723+0000","last_fullsized":"2024-03-07T07:31:14.016723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:37:22.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026231+0000","last_change":"2024-03-07T07:31:14.021322+0000","last_active":"2024-03-07T07:31:14.026231+0000","last_peered":"2024-03-07T07:31:14.026231+0000","last_clean":"2024-03-07T07:31:14.026231+0000","last_became_active":"2024-03-07T07:31:14.021007+0000","last_became_peered":"2024-03-07T07:31:14.021007+0000","last_unstale":"2024-03-07T07:31:14.026231+0000","last_undegraded":"2024-03-07T07:31:14.026231+0000","last_fullsized":"2024-03-07T07:31:14.026231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.006273+0000","last_change":"2024-03-07T07:31:13.006273+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.006273+0000","last_undegraded":"2024-03-07T07:31:13.006273+0000","last_fullsized":"2024-03-07T07:31:13.006273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016995+0000","last_change":"2024-03-07T07:31:14.011155+0000","last_active":"2024-03-07T07:31:14.016995+0000","last_peered":"2024-03-07T07:31:14.016995+0000","last_clean":"2024-03-07T07:31:14.016995+0000","last_became_active":"2024-03-07T07:31:14.010799+0000","last_became_peered":"2024-03-07T07:31:14.010799+0000","last_unstale":"2024-03-07T07:31:14.016995+0000","last_undegraded":"2024-03-07T07:31:14.016995+0000","last_fullsized":"2024-03-07T07:31:14.016995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:11.668041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014425+0000","last_change":"2024-03-07T07:31:14.002815+0000","last_active":"2024-03-07T07:31:14.014425+0000","last_peered":"2024-03-07T07:31:14.014425+0000","last_clean":"2024-03-07T07:31:14.014425+0000","last_became_active":"2024-03-07T07:31:14.002600+0000","last_became_peered":"2024-03-07T07:31:14.002600+0000","last_unstale":"2024-03-07T07:31:14.014425+0000","last_undegraded":"2024-03-07T07:31:14.014425+0000","last_fullsized":"2024-03-07T07:31:14.014425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026157+0000","last_change":"2024-03-07T07:31:14.020556+0000","last_active":"2024-03-07T07:31:14.026157+0000","last_peered":"2024-03-07T07:31:14.026157+0000","last_clean":"2024-03-07T07:31:14.026157+0000","last_became_active":"2024-03-07T07:31:14.020256+0000","last_became_peered":"2024-03-07T07:31:14.020256+0000","last_unstale":"2024-03-07T07:31:14.026157+0000","last_undegraded":"2024-03-07T07:31:14.026157+0000","last_fullsized":"2024-03-07T07:31:14.026157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025902+0000","last_change":"2024-03-07T07:31:14.014180+0000","last_active":"2024-03-07T07:31:14.025902+0000","last_peered":"2024-03-07T07:31:14.025902+0000","last_clean":"2024-03-07T07:31:14.025902+0000","last_became_active":"2024-03-07T07:31:14.013845+0000","last_became_peered":"2024-03-07T07:31:14.013845+0000","last_unstale":"2024-03-07T07:31:14.025902+0000","last_undegraded":"2024-03-07T07:31:14.025902+0000","last_fullsized":"2024-03-07T07:31:14.025902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:05.763428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991054+0000","last_change":"2024-03-07T07:31:12.991054+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991054+0000","last_undegraded":"2024-03-07T07:31:12.991054+0000","last_fullsized":"2024-03-07T07:31:12.991054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.993627+0000","last_change":"2024-03-07T07:31:12.993627+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.993627+0000","last_undegraded":"2024-03-07T07:31:12.993627+0000","last_fullsized":"2024-03-07T07:31:12.993627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.003021+0000","last_change":"2024-03-07T07:31:13.003021+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.003021+0000","last_undegraded":"2024-03-07T07:31:13.003021+0000","last_fullsized":"2024-03-07T07:31:13.003021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.019786+0000","last_change":"2024-03-07T07:31:14.004296+0000","last_active":"2024-03-07T07:31:14.019786+0000","last_peered":"2024-03-07T07:31:14.019786+0000","last_clean":"2024-03-07T07:31:14.019786+0000","last_became_active":"2024-03-07T07:31:14.003978+0000","last_became_peered":"2024-03-07T07:31:14.003978+0000","last_unstale":"2024-03-07T07:31:14.019786+0000","last_undegraded":"2024-03-07T07:31:14.019786+0000","last_fullsized":"2024-03-07T07:31:14.019786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.029918+0000","last_change":"2024-03-07T07:31:14.026782+0000","last_active":"2024-03-07T07:31:14.029918+0000","last_peered":"2024-03-07T07:31:14.029918+0000","last_clean":"2024-03-07T07:31:14.029918+0000","last_became_active":"2024-03-07T07:31:14.026435+0000","last_became_peered":"2024-03-07T07:31:14.026435+0000","last_unstale":"2024-03-07T07:31:14.029918+0000","last_undegraded":"2024-03-07T07:31:14.029918+0000","last_fullsized":"2024-03-07T07:31:14.029918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992656+0000","last_change":"2024-03-07T07:31:12.992656+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992656+0000","last_undegraded":"2024-03-07T07:31:12.992656+0000","last_fullsized":"2024-03-07T07:31:12.992656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028130+0000","last_change":"2024-03-07T07:31:14.018840+0000","last_active":"2024-03-07T07:31:14.028130+0000","last_peered":"2024-03-07T07:31:14.028130+0000","last_clean":"2024-03-07T07:31:14.028130+0000","last_became_active":"2024-03-07T07:31:14.015465+0000","last_became_peered":"2024-03-07T07:31:14.015465+0000","last_unstale":"2024-03-07T07:31:14.028130+0000","last_undegraded":"2024-03-07T07:31:14.028130+0000","last_fullsized":"2024-03-07T07:31:14.028130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016418+0000","last_change":"2024-03-07T07:31:14.003946+0000","last_active":"2024-03-07T07:31:14.016418+0000","last_peered":"2024-03-07T07:31:14.016418+0000","last_clean":"2024-03-07T07:31:14.016418+0000","last_became_active":"2024-03-07T07:31:14.003724+0000","last_became_peered":"2024-03-07T07:31:14.003724+0000","last_unstale":"2024-03-07T07:31:14.016418+0000","last_undegraded":"2024-03-07T07:31:14.016418+0000","last_fullsized":"2024-03-07T07:31:14.016418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:31.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.988516+0000","last_change":"2024-03-07T07:31:12.988516+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.988516+0000","last_undegraded":"2024-03-07T07:31:12.988516+0000","last_fullsized":"2024-03-07T07:31:12.988516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.023700+0000","last_change":"2024-03-07T07:31:14.019962+0000","last_active":"2024-03-07T07:31:14.023700+0000","last_peered":"2024-03-07T07:31:14.023700+0000","last_clean":"2024-03-07T07:31:14.023700+0000","last_became_active":"2024-03-07T07:31:14.019664+0000","last_became_peered":"2024-03-07T07:31:14.019664+0000","last_unstale":"2024-03-07T07:31:14.023700+0000","last_undegraded":"2024-03-07T07:31:14.023700+0000","last_fullsized":"2024-03-07T07:31:14.023700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:56.429772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.994230+0000","last_change":"2024-03-07T07:31:12.994230+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.994230+0000","last_undegraded":"2024-03-07T07:31:12.994230+0000","last_fullsized":"2024-03-07T07:31:12.994230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027861+0000","last_change":"2024-03-07T07:31:14.019616+0000","last_active":"2024-03-07T07:31:14.027861+0000","last_peered":"2024-03-07T07:31:14.027861+0000","last_clean":"2024-03-07T07:31:14.027861+0000","last_became_active":"2024-03-07T07:31:14.019246+0000","last_became_peered":"2024-03-07T07:31:14.019246+0000","last_unstale":"2024-03-07T07:31:14.027861+0000","last_undegraded":"2024-03-07T07:31:14.027861+0000","last_fullsized":"2024-03-07T07:31:14.027861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001690+0000","last_change":"2024-03-07T07:31:13.001690+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001690+0000","last_undegraded":"2024-03-07T07:31:13.001690+0000","last_fullsized":"2024-03-07T07:31:13.001690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.018316+0000","last_change":"2024-03-07T07:31:14.017123+0000","last_active":"2024-03-07T07:31:14.018316+0000","last_peered":"2024-03-07T07:31:14.018316+0000","last_clean":"2024-03-07T07:31:14.018316+0000","last_became_active":"2024-03-07T07:31:14.016071+0000","last_became_peered":"2024-03-07T07:31:14.016071+0000","last_unstale":"2024-03-07T07:31:14.018316+0000","last_undegraded":"2024-03-07T07:31:14.018316+0000","last_fullsized":"2024-03-07T07:31:14.018316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:46.926372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991173+0000","last_change":"2024-03-07T07:31:12.991173+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991173+0000","last_undegraded":"2024-03-07T07:31:12.991173+0000","last_fullsized":"2024-03-07T07:31:12.991173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992584+0000","last_change":"2024-03-07T07:31:12.992584+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992584+0000","last_undegraded":"2024-03-07T07:31:12.992584+0000","last_fullsized":"2024-03-07T07:31:12.992584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.998641+0000","last_change":"2024-03-07T07:31:12.998641+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.998641+0000","last_undegraded":"2024-03-07T07:31:12.998641+0000","last_fullsized":"2024-03-07T07:31:12.998641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025797+0000","last_change":"2024-03-07T07:31:14.018277+0000","last_active":"2024-03-07T07:31:14.025797+0000","last_peered":"2024-03-07T07:31:14.025797+0000","last_clean":"2024-03-07T07:31:14.025797+0000","last_became_active":"2024-03-07T07:31:14.017969+0000","last_became_peered":"2024-03-07T07:31:14.017969+0000","last_unstale":"2024-03-07T07:31:14.025797+0000","last_undegraded":"2024-03-07T07:31:14.025797+0000","last_fullsized":"2024-03-07T07:31:14.025797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992343+0000","last_change":"2024-03-07T07:31:12.992343+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992343+0000","last_undegraded":"2024-03-07T07:31:12.992343+0000","last_fullsized":"2024-03-07T07:31:12.992343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.030095+0000","last_change":"2024-03-07T07:31:14.025073+0000","last_active":"2024-03-07T07:31:14.030095+0000","last_peered":"2024-03-07T07:31:14.030095+0000","last_clean":"2024-03-07T07:31:14.030095+0000","last_became_active":"2024-03-07T07:31:14.024374+0000","last_became_peered":"2024-03-07T07:31:14.024374+0000","last_unstale":"2024-03-07T07:31:14.030095+0000","last_undegraded":"2024-03-07T07:31:14.030095+0000","last_fullsized":"2024-03-07T07:31:14.030095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:11.668041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.011254+0000","last_change":"2024-03-07T07:31:14.009391+0000","last_active":"2024-03-07T07:31:14.011254+0000","last_peered":"2024-03-07T07:31:14.011254+0000","last_clean":"2024-03-07T07:31:14.011254+0000","last_became_active":"2024-03-07T07:31:14.009148+0000","last_became_peered":"2024-03-07T07:31:14.009148+0000","last_unstale":"2024-03-07T07:31:14.011254+0000","last_undegraded":"2024-03-07T07:31:14.011254+0000","last_fullsized":"2024-03-07T07:31:14.011254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:46.926372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.012693+0000","last_change":"2024-03-07T07:31:13.010423+0000","last_active":"2024-03-07T07:31:13.012693+0000","last_peered":"2024-03-07T07:31:13.012693+0000","last_clean":"2024-03-07T07:31:13.012693+0000","last_became_active":"2024-03-07T07:31:13.010096+0000","last_became_peered":"2024-03-07T07:31:13.010096+0000","last_unstale":"2024-03-07T07:31:13.012693+0000","last_undegraded":"2024-03-07T07:31:13.012693+0000","last_fullsized":"2024-03-07T07:31:13.012693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:24.512582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986402+0000","last_change":"2024-03-07T07:31:12.986402+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986402+0000","last_undegraded":"2024-03-07T07:31:12.986402+0000","last_fullsized":"2024-03-07T07:31:12.986402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027850+0000","last_change":"2024-03-07T07:31:13.006659+0000","last_active":"2024-03-07T07:31:14.027850+0000","last_peered":"2024-03-07T07:31:14.027850+0000","last_clean":"2024-03-07T07:31:14.027850+0000","last_became_active":"2024-03-07T07:31:13.005927+0000","last_became_peered":"2024-03-07T07:31:13.005927+0000","last_unstale":"2024-03-07T07:31:14.027850+0000","last_undegraded":"2024-03-07T07:31:14.027850+0000","last_fullsized":"2024-03-07T07:31:14.027850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010196+0000","last_change":"2024-03-07T07:31:13.003135+0000","last_active":"2024-03-07T07:31:13.010196+0000","last_peered":"2024-03-07T07:31:13.010196+0000","last_clean":"2024-03-07T07:31:13.010196+0000","last_became_active":"2024-03-07T07:31:13.002843+0000","last_became_peered":"2024-03-07T07:31:13.002843+0000","last_unstale":"2024-03-07T07:31:13.010196+0000","last_undegraded":"2024-03-07T07:31:13.010196+0000","last_fullsized":"2024-03-07T07:31:13.010196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:36:06.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.997002+0000","last_change":"2024-03-07T07:31:12.997002+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.997002+0000","last_undegraded":"2024-03-07T07:31:12.997002+0000","last_fullsized":"2024-03-07T07:31:12.997002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.997483+0000","last_change":"2024-03-07T07:31:13.006518+0000","last_active":"2024-03-07T07:31:13.997483+0000","last_peered":"2024-03-07T07:31:13.997483+0000","last_clean":"2024-03-07T07:31:13.997483+0000","last_became_active":"2024-03-07T07:31:13.005662+0000","last_became_peered":"2024-03-07T07:31:13.005662+0000","last_unstale":"2024-03-07T07:31:13.997483+0000","last_undegraded":"2024-03-07T07:31:13.997483+0000","last_fullsized":"2024-03-07T07:31:13.997483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986679+0000","last_change":"2024-03-07T07:31:12.986679+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986679+0000","last_undegraded":"2024-03-07T07:31:12.986679+0000","last_fullsized":"2024-03-07T07:31:12.986679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.997623+0000","last_change":"2024-03-07T07:31:13.014357+0000","last_active":"2024-03-07T07:31:13.997623+0000","last_peered":"2024-03-07T07:31:13.997623+0000","last_clean":"2024-03-07T07:31:13.997623+0000","last_became_active":"2024-03-07T07:31:13.014065+0000","last_became_peered":"2024-03-07T07:31:13.014065+0000","last_unstale":"2024-03-07T07:31:13.997623+0000","last_undegraded":"2024-03-07T07:31:13.997623+0000","last_fullsized":"2024-03-07T07:31:13.997623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.018298+0000","last_change":"2024-03-07T07:31:14.016928+0000","last_active":"2024-03-07T07:31:14.018298+0000","last_peered":"2024-03-07T07:31:14.018298+0000","last_clean":"2024-03-07T07:31:14.018298+0000","last_became_active":"2024-03-07T07:31:14.016029+0000","last_became_peered":"2024-03-07T07:31:14.016029+0000","last_unstale":"2024-03-07T07:31:14.018298+0000","last_undegraded":"2024-03-07T07:31:14.018298+0000","last_fullsized":"2024-03-07T07:31:14.018298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:24.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.987853+0000","last_change":"2024-03-07T07:31:13.017045+0000","last_active":"2024-03-07T07:31:13.987853+0000","last_peered":"2024-03-07T07:31:13.987853+0000","last_clean":"2024-03-07T07:31:13.987853+0000","last_became_active":"2024-03-07T07:31:13.016712+0000","last_became_peered":"2024-03-07T07:31:13.016712+0000","last_unstale":"2024-03-07T07:31:13.987853+0000","last_undegraded":"2024-03-07T07:31:13.987853+0000","last_fullsized":"2024-03-07T07:31:13.987853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.000461+0000","last_change":"2024-03-07T07:31:13.000461+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.000461+0000","last_undegraded":"2024-03-07T07:31:13.000461+0000","last_fullsized":"2024-03-07T07:31:13.000461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010890+0000","last_change":"2024-03-07T07:31:13.004264+0000","last_active":"2024-03-07T07:31:13.010890+0000","last_peered":"2024-03-07T07:31:13.010890+0000","last_clean":"2024-03-07T07:31:13.010890+0000","last_became_active":"2024-03-07T07:31:13.003883+0000","last_became_peered":"2024-03-07T07:31:13.003883+0000","last_unstale":"2024-03-07T07:31:13.010890+0000","last_undegraded":"2024-03-07T07:31:13.010890+0000","last_fullsized":"2024-03-07T07:31:13.010890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:37.603421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025523+0000","last_change":"2024-03-07T07:31:14.007051+0000","last_active":"2024-03-07T07:31:14.025523+0000","last_peered":"2024-03-07T07:31:14.025523+0000","last_clean":"2024-03-07T07:31:14.025523+0000","last_became_active":"2024-03-07T07:31:14.005904+0000","last_became_peered":"2024-03-07T07:31:14.005904+0000","last_unstale":"2024-03-07T07:31:14.025523+0000","last_undegraded":"2024-03-07T07:31:14.025523+0000","last_fullsized":"2024-03-07T07:31:14.025523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.031099+0000","last_change":"2024-03-07T07:31:12.997602+0000","last_active":"2024-03-07T07:31:14.031099+0000","last_peered":"2024-03-07T07:31:14.031099+0000","last_clean":"2024-03-07T07:31:14.031099+0000","last_became_active":"2024-03-07T07:31:12.997204+0000","last_became_peered":"2024-03-07T07:31:12.997204+0000","last_unstale":"2024-03-07T07:31:14.031099+0000","last_undegraded":"2024-03-07T07:31:14.031099+0000","last_fullsized":"2024-03-07T07:31:14.031099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.032451+0000","last_change":"2024-03-07T07:31:14.028791+0000","last_active":"2024-03-07T07:31:14.032451+0000","last_peered":"2024-03-07T07:31:14.032451+0000","last_clean":"2024-03-07T07:31:14.032451+0000","last_became_active":"2024-03-07T07:31:14.028591+0000","last_became_peered":"2024-03-07T07:31:14.028591+0000","last_unstale":"2024-03-07T07:31:14.032451+0000","last_undegraded":"2024-03-07T07:31:14.032451+0000","last_fullsized":"2024-03-07T07:31:14.032451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.015380+0000","last_change":"2024-03-07T07:31:13.011937+0000","last_active":"2024-03-07T07:31:13.015380+0000","last_peered":"2024-03-07T07:31:13.015380+0000","last_clean":"2024-03-07T07:31:13.015380+0000","last_became_active":"2024-03-07T07:31:13.011577+0000","last_became_peered":"2024-03-07T07:31:13.011577+0000","last_unstale":"2024-03-07T07:31:13.015380+0000","last_undegraded":"2024-03-07T07:31:13.015380+0000","last_fullsized":"2024-03-07T07:31:13.015380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990977+0000","last_change":"2024-03-07T07:31:12.990977+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990977+0000","last_undegraded":"2024-03-07T07:31:12.990977+0000","last_fullsized":"2024-03-07T07:31:12.990977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004304+0000","last_change":"2024-03-07T07:31:13.000961+0000","last_active":"2024-03-07T07:31:14.004304+0000","last_peered":"2024-03-07T07:31:14.004304+0000","last_clean":"2024-03-07T07:31:14.004304+0000","last_became_active":"2024-03-07T07:31:13.000129+0000","last_became_peered":"2024-03-07T07:31:13.000129+0000","last_unstale":"2024-03-07T07:31:14.004304+0000","last_undegraded":"2024-03-07T07:31:14.004304+0000","last_fullsized":"2024-03-07T07:31:14.004304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:58.045352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028425+0000","last_change":"2024-03-07T07:31:14.022537+0000","last_active":"2024-03-07T07:31:14.028425+0000","last_peered":"2024-03-07T07:31:14.028425+0000","last_clean":"2024-03-07T07:31:14.028425+0000","last_became_active":"2024-03-07T07:31:14.022221+0000","last_became_peered":"2024-03-07T07:31:14.022221+0000","last_unstale":"2024-03-07T07:31:14.028425+0000","last_undegraded":"2024-03-07T07:31:14.028425+0000","last_fullsized":"2024-03-07T07:31:14.028425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.986705+0000","last_change":"2024-03-07T07:31:13.009533+0000","last_active":"2024-03-07T07:31:13.986705+0000","last_peered":"2024-03-07T07:31:13.986705+0000","last_clean":"2024-03-07T07:31:13.986705+0000","last_became_active":"2024-03-07T07:31:13.009224+0000","last_became_peered":"2024-03-07T07:31:13.009224+0000","last_unstale":"2024-03-07T07:31:13.986705+0000","last_undegraded":"2024-03-07T07:31:13.986705+0000","last_fullsized":"2024-03-07T07:31:13.986705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:40.675440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.019222+0000","last_change":"2024-03-07T07:31:14.015133+0000","last_active":"2024-03-07T07:31:14.019222+0000","last_peered":"2024-03-07T07:31:14.019222+0000","last_clean":"2024-03-07T07:31:14.019222+0000","last_became_active":"2024-03-07T07:31:14.014859+0000","last_became_peered":"2024-03-07T07:31:14.014859+0000","last_unstale":"2024-03-07T07:31:14.019222+0000","last_undegraded":"2024-03-07T07:31:14.019222+0000","last_fullsized":"2024-03-07T07:31:14.019222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:41.682431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011044+0000","last_change":"2024-03-07T07:31:13.000976+0000","last_active":"2024-03-07T07:31:13.011044+0000","last_peered":"2024-03-07T07:31:13.011044+0000","last_clean":"2024-03-07T07:31:13.011044+0000","last_became_active":"2024-03-07T07:31:13.000624+0000","last_became_peered":"2024-03-07T07:31:13.000624+0000","last_unstale":"2024-03-07T07:31:13.011044+0000","last_undegraded":"2024-03-07T07:31:13.011044+0000","last_fullsized":"2024-03-07T07:31:13.011044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:36:06.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025488+0000","last_change":"2024-03-07T07:31:14.008321+0000","last_active":"2024-03-07T07:31:14.025488+0000","last_peered":"2024-03-07T07:31:14.025488+0000","last_clean":"2024-03-07T07:31:14.025488+0000","last_became_active":"2024-03-07T07:31:14.008039+0000","last_became_peered":"2024-03-07T07:31:14.008039+0000","last_unstale":"2024-03-07T07:31:14.025488+0000","last_undegraded":"2024-03-07T07:31:14.025488+0000","last_fullsized":"2024-03-07T07:31:14.025488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.023370+0000","last_change":"2024-03-07T07:31:13.008580+0000","last_active":"2024-03-07T07:31:14.023370+0000","last_peered":"2024-03-07T07:31:14.023370+0000","last_clean":"2024-03-07T07:31:14.023370+0000","last_became_active":"2024-03-07T07:31:13.008276+0000","last_became_peered":"2024-03-07T07:31:13.008276+0000","last_unstale":"2024-03-07T07:31:14.023370+0000","last_undegraded":"2024-03-07T07:31:14.023370+0000","last_fullsized":"2024-03-07T07:31:14.023370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.008377+0000","last_change":"2024-03-07T07:31:14.003764+0000","last_active":"2024-03-07T07:31:14.008377+0000","last_peered":"2024-03-07T07:31:14.008377+0000","last_clean":"2024-03-07T07:31:14.008377+0000","last_became_active":"2024-03-07T07:31:14.002976+0000","last_became_peered":"2024-03-07T07:31:14.002976+0000","last_unstale":"2024-03-07T07:31:14.008377+0000","last_undegraded":"2024-03-07T07:31:14.008377+0000","last_fullsized":"2024-03-07T07:31:14.008377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:51.219777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013778+0000","last_change":"2024-03-07T07:31:13.010016+0000","last_active":"2024-03-07T07:31:13.013778+0000","last_peered":"2024-03-07T07:31:13.013778+0000","last_clean":"2024-03-07T07:31:13.013778+0000","last_became_active":"2024-03-07T07:31:13.009751+0000","last_became_peered":"2024-03-07T07:31:13.009751+0000","last_unstale":"2024-03-07T07:31:13.013778+0000","last_undegraded":"2024-03-07T07:31:13.013778+0000","last_fullsized":"2024-03-07T07:31:13.013778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:45:09.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025474+0000","last_change":"2024-03-07T07:31:14.013078+0000","last_active":"2024-03-07T07:31:14.025474+0000","last_peered":"2024-03-07T07:31:14.025474+0000","last_clean":"2024-03-07T07:31:14.025474+0000","last_became_active":"2024-03-07T07:31:14.012816+0000","last_became_peered":"2024-03-07T07:31:14.012816+0000","last_unstale":"2024-03-07T07:31:14.025474+0000","last_undegraded":"2024-03-07T07:31:14.025474+0000","last_fullsized":"2024-03-07T07:31:14.025474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:18.111128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.020779+0000","last_change":"2024-03-07T07:31:13.016042+0000","last_active":"2024-03-07T07:31:13.020779+0000","last_peered":"2024-03-07T07:31:13.020779+0000","last_clean":"2024-03-07T07:31:13.020779+0000","last_became_active":"2024-03-07T07:31:13.015749+0000","last_became_peered":"2024-03-07T07:31:13.015749+0000","last_unstale":"2024-03-07T07:31:13.020779+0000","last_undegraded":"2024-03-07T07:31:13.020779+0000","last_fullsized":"2024-03-07T07:31:13.020779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025934+0000","last_change":"2024-03-07T07:31:14.015090+0000","last_active":"2024-03-07T07:31:14.025934+0000","last_peered":"2024-03-07T07:31:14.025934+0000","last_clean":"2024-03-07T07:31:14.025934+0000","last_became_active":"2024-03-07T07:31:14.014806+0000","last_became_peered":"2024-03-07T07:31:14.014806+0000","last_unstale":"2024-03-07T07:31:14.025934+0000","last_undegraded":"2024-03-07T07:31:14.025934+0000","last_fullsized":"2024-03-07T07:31:14.025934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:37.677717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010244+0000","last_change":"2024-03-07T07:31:13.002882+0000","last_active":"2024-03-07T07:31:13.010244+0000","last_peered":"2024-03-07T07:31:13.010244+0000","last_clean":"2024-03-07T07:31:13.010244+0000","last_became_active":"2024-03-07T07:31:13.002570+0000","last_became_peered":"2024-03-07T07:31:13.002570+0000","last_unstale":"2024-03-07T07:31:13.010244+0000","last_undegraded":"2024-03-07T07:31:13.010244+0000","last_fullsized":"2024-03-07T07:31:13.010244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:47:07.277106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025420+0000","last_change":"2024-03-07T07:31:14.008276+0000","last_active":"2024-03-07T07:31:14.025420+0000","last_peered":"2024-03-07T07:31:14.025420+0000","last_clean":"2024-03-07T07:31:14.025420+0000","last_became_active":"2024-03-07T07:31:14.007776+0000","last_became_peered":"2024-03-07T07:31:14.007776+0000","last_unstale":"2024-03-07T07:31:14.025420+0000","last_undegraded":"2024-03-07T07:31:14.025420+0000","last_fullsized":"2024-03-07T07:31:14.025420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.995173+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:31:13.995173+0000","last_peered":"2024-03-07T07:31:13.995173+0000","last_clean":"2024-03-07T07:31:13.995173+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:31:13.995173+0000","last_undegraded":"2024-03-07T07:31:13.995173+0000","last_fullsized":"2024-03-07T07:31:13.995173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004578+0000","last_change":"2024-03-07T07:31:13.008377+0000","last_active":"2024-03-07T07:31:14.004578+0000","last_peered":"2024-03-07T07:31:14.004578+0000","last_clean":"2024-03-07T07:31:14.004578+0000","last_became_active":"2024-03-07T07:31:13.007831+0000","last_became_peered":"2024-03-07T07:31:13.007831+0000","last_unstale":"2024-03-07T07:31:14.004578+0000","last_undegraded":"2024-03-07T07:31:14.004578+0000","last_fullsized":"2024-03-07T07:31:14.004578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:04.756437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986419+0000","last_change":"2024-03-07T07:31:12.986419+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986419+0000","last_undegraded":"2024-03-07T07:31:12.986419+0000","last_fullsized":"2024-03-07T07:31:12.986419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.003599+0000","last_change":"2024-03-07T07:31:13.008418+0000","last_active":"2024-03-07T07:31:14.003599+0000","last_peered":"2024-03-07T07:31:14.003599+0000","last_clean":"2024-03-07T07:31:14.003599+0000","last_became_active":"2024-03-07T07:31:13.008022+0000","last_became_peered":"2024-03-07T07:31:13.008022+0000","last_unstale":"2024-03-07T07:31:14.003599+0000","last_undegraded":"2024-03-07T07:31:14.003599+0000","last_fullsized":"2024-03-07T07:31:14.003599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990303+0000","last_change":"2024-03-07T07:31:12.990303+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990303+0000","last_undegraded":"2024-03-07T07:31:12.990303+0000","last_fullsized":"2024-03-07T07:31:12.990303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.020519+0000","last_change":"2024-03-07T07:31:13.012807+0000","last_active":"2024-03-07T07:31:13.020519+0000","last_peered":"2024-03-07T07:31:13.020519+0000","last_clean":"2024-03-07T07:31:13.020519+0000","last_became_active":"2024-03-07T07:31:13.011968+0000","last_became_peered":"2024-03-07T07:31:13.011968+0000","last_unstale":"2024-03-07T07:31:13.020519+0000","last_undegraded":"2024-03-07T07:31:13.020519+0000","last_fullsized":"2024-03-07T07:31:13.020519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:50.212787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.005761+0000","last_change":"2024-03-07T07:31:13.005761+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.005761+0000","last_undegraded":"2024-03-07T07:31:13.005761+0000","last_fullsized":"2024-03-07T07:31:13.005761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004381+0000","last_change":"2024-03-07T07:31:13.004811+0000","last_active":"2024-03-07T07:31:14.004381+0000","last_peered":"2024-03-07T07:31:14.004381+0000","last_clean":"2024-03-07T07:31:14.004381+0000","last_became_active":"2024-03-07T07:31:13.001378+0000","last_became_peered":"2024-03-07T07:31:13.001378+0000","last_unstale":"2024-03-07T07:31:14.004381+0000","last_undegraded":"2024-03-07T07:31:14.004381+0000","last_fullsized":"2024-03-07T07:31:14.004381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:30.900538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.020685+0000","last_change":"2024-03-07T07:31:14.001567+0000","last_active":"2024-03-07T07:31:14.020685+0000","last_peered":"2024-03-07T07:31:14.020685+0000","last_clean":"2024-03-07T07:31:14.020685+0000","last_became_active":"2024-03-07T07:31:14.001209+0000","last_became_peered":"2024-03-07T07:31:14.001209+0000","last_unstale":"2024-03-07T07:31:14.020685+0000","last_undegraded":"2024-03-07T07:31:14.020685+0000","last_fullsized":"2024-03-07T07:31:14.020685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011322+0000","last_change":"2024-03-07T07:31:13.009741+0000","last_active":"2024-03-07T07:31:13.011322+0000","last_peered":"2024-03-07T07:31:13.011322+0000","last_clean":"2024-03-07T07:31:13.011322+0000","last_became_active":"2024-03-07T07:31:13.009377+0000","last_became_peered":"2024-03-07T07:31:13.009377+0000","last_unstale":"2024-03-07T07:31:13.011322+0000","last_undegraded":"2024-03-07T07:31:13.011322+0000","last_fullsized":"2024-03-07T07:31:13.011322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:46:14.381163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.032452+0000","last_change":"2024-03-07T07:31:14.029593+0000","last_active":"2024-03-07T07:31:14.032452+0000","last_peered":"2024-03-07T07:31:14.032452+0000","last_clean":"2024-03-07T07:31:14.032452+0000","last_became_active":"2024-03-07T07:31:14.029271+0000","last_became_peered":"2024-03-07T07:31:14.029271+0000","last_unstale":"2024-03-07T07:31:14.032452+0000","last_undegraded":"2024-03-07T07:31:14.032452+0000","last_fullsized":"2024-03-07T07:31:14.032452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:41.682431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004972+0000","last_change":"2024-03-07T07:31:12.999335+0000","last_active":"2024-03-07T07:31:14.004972+0000","last_peered":"2024-03-07T07:31:14.004972+0000","last_clean":"2024-03-07T07:31:14.004972+0000","last_became_active":"2024-03-07T07:31:12.998960+0000","last_became_peered":"2024-03-07T07:31:12.998960+0000","last_unstale":"2024-03-07T07:31:14.004972+0000","last_undegraded":"2024-03-07T07:31:14.004972+0000","last_fullsized":"2024-03-07T07:31:14.004972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:36.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990933+0000","last_change":"2024-03-07T07:31:12.990933+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990933+0000","last_undegraded":"2024-03-07T07:31:12.990933+0000","last_fullsized":"2024-03-07T07:31:12.990933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013696+0000","last_change":"2024-03-07T07:31:13.004776+0000","last_active":"2024-03-07T07:31:13.013696+0000","last_peered":"2024-03-07T07:31:13.013696+0000","last_clean":"2024-03-07T07:31:13.013696+0000","last_became_active":"2024-03-07T07:31:13.004179+0000","last_became_peered":"2024-03-07T07:31:13.004179+0000","last_unstale":"2024-03-07T07:31:13.013696+0000","last_undegraded":"2024-03-07T07:31:13.013696+0000","last_fullsized":"2024-03-07T07:31:13.013696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:45.950345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986414+0000","last_change":"2024-03-07T07:31:12.986414+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986414+0000","last_undegraded":"2024-03-07T07:31:12.986414+0000","last_fullsized":"2024-03-07T07:31:12.986414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026653+0000","last_change":"2024-03-07T07:31:13.014574+0000","last_active":"2024-03-07T07:31:14.026653+0000","last_peered":"2024-03-07T07:31:14.026653+0000","last_clean":"2024-03-07T07:31:14.026653+0000","last_became_active":"2024-03-07T07:31:13.014264+0000","last_became_peered":"2024-03-07T07:31:13.014264+0000","last_unstale":"2024-03-07T07:31:14.026653+0000","last_undegraded":"2024-03-07T07:31:14.026653+0000","last_fullsized":"2024-03-07T07:31:14.026653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.987092+0000","last_change":"2024-03-07T07:31:12.987092+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.987092+0000","last_undegraded":"2024-03-07T07:31:12.987092+0000","last_fullsized":"2024-03-07T07:31:12.987092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.986217+0000","last_change":"2024-03-07T07:31:13.010611+0000","last_active":"2024-03-07T07:31:13.986217+0000","last_peered":"2024-03-07T07:31:13.986217+0000","last_clean":"2024-03-07T07:31:13.986217+0000","last_became_active":"2024-03-07T07:31:13.005305+0000","last_became_peered":"2024-03-07T07:31:13.005305+0000","last_unstale":"2024-03-07T07:31:13.986217+0000","last_undegraded":"2024-03-07T07:31:13.986217+0000","last_fullsized":"2024-03-07T07:31:13.986217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:10.661050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028674+0000","last_change":"2024-03-07T07:31:14.021524+0000","last_active":"2024-03-07T07:31:14.028674+0000","last_peered":"2024-03-07T07:31:14.028674+0000","last_clean":"2024-03-07T07:31:14.028674+0000","last_became_active":"2024-03-07T07:31:14.021248+0000","last_became_peered":"2024-03-07T07:31:14.021248+0000","last_unstale":"2024-03-07T07:31:14.028674+0000","last_undegraded":"2024-03-07T07:31:14.028674+0000","last_fullsized":"2024-03-07T07:31:14.028674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013629+0000","last_change":"2024-03-07T07:31:13.002330+0000","last_active":"2024-03-07T07:31:13.013629+0000","last_peered":"2024-03-07T07:31:13.013629+0000","last_clean":"2024-03-07T07:31:13.013629+0000","last_became_active":"2024-03-07T07:31:13.002030+0000","last_became_peered":"2024-03-07T07:31:13.002030+0000","last_unstale":"2024-03-07T07:31:13.013629+0000","last_undegraded":"2024-03-07T07:31:13.013629+0000","last_fullsized":"2024-03-07T07:31:13.013629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:08:44.860696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.987514+0000","last_change":"2024-03-07T07:31:12.987514+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.987514+0000","last_undegraded":"2024-03-07T07:31:12.987514+0000","last_fullsized":"2024-03-07T07:31:12.987514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011105+0000","last_change":"2024-03-07T07:31:13.008737+0000","last_active":"2024-03-07T07:31:13.011105+0000","last_peered":"2024-03-07T07:31:13.011105+0000","last_clean":"2024-03-07T07:31:13.011105+0000","last_became_active":"2024-03-07T07:31:13.008485+0000","last_became_peered":"2024-03-07T07:31:13.008485+0000","last_unstale":"2024-03-07T07:31:13.011105+0000","last_undegraded":"2024-03-07T07:31:13.011105+0000","last_fullsized":"2024-03-07T07:31:13.011105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:08:44.860696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991966+0000","last_change":"2024-03-07T07:31:12.991966+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991966+0000","last_undegraded":"2024-03-07T07:31:12.991966+0000","last_fullsized":"2024-03-07T07:31:12.991966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025664+0000","last_change":"2024-03-07T07:31:13.008117+0000","last_active":"2024-03-07T07:31:14.025664+0000","last_peered":"2024-03-07T07:31:14.025664+0000","last_clean":"2024-03-07T07:31:14.025664+0000","last_became_active":"2024-03-07T07:31:13.006517+0000","last_became_peered":"2024-03-07T07:31:13.006517+0000","last_unstale":"2024-03-07T07:31:14.025664+0000","last_undegraded":"2024-03-07T07:31:14.025664+0000","last_fullsized":"2024-03-07T07:31:14.025664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:17.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025684+0000","last_change":"2024-03-07T07:31:14.011780+0000","last_active":"2024-03-07T07:31:14.025684+0000","last_peered":"2024-03-07T07:31:14.025684+0000","last_clean":"2024-03-07T07:31:14.025684+0000","last_became_active":"2024-03-07T07:31:14.011509+0000","last_became_peered":"2024-03-07T07:31:14.011509+0000","last_unstale":"2024-03-07T07:31:14.025684+0000","last_undegraded":"2024-03-07T07:31:14.025684+0000","last_fullsized":"2024-03-07T07:31:14.025684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028411+0000","last_change":"2024-03-07T07:31:14.024307+0000","last_active":"2024-03-07T07:31:14.028411+0000","last_peered":"2024-03-07T07:31:14.028411+0000","last_clean":"2024-03-07T07:31:14.028411+0000","last_became_active":"2024-03-07T07:31:14.024003+0000","last_became_peered":"2024-03-07T07:31:14.024003+0000","last_unstale":"2024-03-07T07:31:14.028411+0000","last_undegraded":"2024-03-07T07:31:14.028411+0000","last_fullsized":"2024-03-07T07:31:14.028411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014498+0000","last_change":"2024-03-07T07:31:13.017220+0000","last_active":"2024-03-07T07:31:14.014498+0000","last_peered":"2024-03-07T07:31:14.014498+0000","last_clean":"2024-03-07T07:31:14.014498+0000","last_became_active":"2024-03-07T07:31:13.016766+0000","last_became_peered":"2024-03-07T07:31:13.016766+0000","last_unstale":"2024-03-07T07:31:14.014498+0000","last_undegraded":"2024-03-07T07:31:14.014498+0000","last_fullsized":"2024-03-07T07:31:14.014498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.010263+0000","last_change":"2024-03-07T07:31:14.008305+0000","last_active":"2024-03-07T07:31:14.010263+0000","last_peered":"2024-03-07T07:31:14.010263+0000","last_clean":"2024-03-07T07:31:14.010263+0000","last_became_active":"2024-03-07T07:31:14.006803+0000","last_became_peered":"2024-03-07T07:31:14.006803+0000","last_unstale":"2024-03-07T07:31:14.010263+0000","last_undegraded":"2024-03-07T07:31:14.010263+0000","last_fullsized":"2024-03-07T07:31:14.010263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:24.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014088+0000","last_change":"2024-03-07T07:31:13.016945+0000","last_active":"2024-03-07T07:31:14.014088+0000","last_peered":"2024-03-07T07:31:14.014088+0000","last_clean":"2024-03-07T07:31:14.014088+0000","last_became_active":"2024-03-07T07:31:13.016362+0000","last_became_peered":"2024-03-07T07:31:13.016362+0000","last_unstale":"2024-03-07T07:31:14.014088+0000","last_undegraded":"2024-03-07T07:31:14.014088+0000","last_fullsized":"2024-03-07T07:31:14.014088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001103+0000","last_change":"2024-03-07T07:31:13.001103+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001103+0000","last_undegraded":"2024-03-07T07:31:13.001103+0000","last_fullsized":"2024-03-07T07:31:13.001103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013451+0000","last_change":"2024-03-07T07:31:13.011989+0000","last_active":"2024-03-07T07:31:13.013451+0000","last_peered":"2024-03-07T07:31:13.013451+0000","last_clean":"2024-03-07T07:31:13.013451+0000","last_became_active":"2024-03-07T07:31:13.011663+0000","last_became_peered":"2024-03-07T07:31:13.011663+0000","last_unstale":"2024-03-07T07:31:13.013451+0000","last_undegraded":"2024-03-07T07:31:13.013451+0000","last_fullsized":"2024-03-07T07:31:13.013451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:37.603421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.003631+0000","last_change":"2024-03-07T07:31:13.003631+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.003631+0000","last_undegraded":"2024-03-07T07:31:13.003631+0000","last_fullsized":"2024-03-07T07:31:13.003631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.002561+0000","last_change":"2024-03-07T07:31:12.997330+0000","last_active":"2024-03-07T07:31:13.002561+0000","last_peered":"2024-03-07T07:31:13.002561+0000","last_clean":"2024-03-07T07:31:13.002561+0000","last_became_active":"2024-03-07T07:31:12.997026+0000","last_became_peered":"2024-03-07T07:31:12.997026+0000","last_unstale":"2024-03-07T07:31:13.002561+0000","last_undegraded":"2024-03-07T07:31:13.002561+0000","last_fullsized":"2024-03-07T07:31:13.002561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:47:07.277106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":66809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":656665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":649820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:31:18.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:31:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddb0e00640 1 Processor -- start 2024-03-07T07:31:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddb0e00640 1 -- start start 2024-03-07T07:31:18.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddb0e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac145a30 0x7fddac0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddb0e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddac06d230 0x7fddac072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddb0e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac06d780 con 0x7fddac0a9540 2024-03-07T07:31:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddb0e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac06da60 con 0x7fddac06d230 2024-03-07T07:31:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddb0e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac06dd40 con 0x7fddac145a30 2024-03-07T07:31:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddaa800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddac06d230 0x7fddac072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fdda9e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac145a30 0x7fddac0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fdda1400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fddac0a9540 0x7fddac0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:57616/0 (socket says 172.21.15.84:57616) 2024-03-07T07:31:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fddaa800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddac06d230 0x7fddac072f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38776/0 (socket says 172.21.15.84:38776) 2024-03-07T07:31:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.615+0000 7fdda1400640 1 -- 172.21.15.84:0/2450479779 learned_addr learned my addr 172.21.15.84:0/2450479779 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddaa800640 1 -- 172.21.15.84:0/2450479779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac145a30 msgr2=0x7fddac0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fdda9400640 1 -- 172.21.15.84:0/2450479779 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706008566 0 0) 0x7fddac06d780 con 0x7fddac0a9540 2024-03-07T07:31:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddaa800640 1 --2- 172.21.15.84:0/2450479779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac145a30 0x7fddac0729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddaa800640 1 -- 172.21.15.84:0/2450479779 >> v1:172.21.15.161:6789/0 conn(0x7fddac0a9540 legacy=0x7fddac0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddaa800640 1 -- 172.21.15.84:0/2450479779 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac06e020 con 0x7fddac06d230 2024-03-07T07:31:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddaa800640 1 --2- 172.21.15.84:0/2450479779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac06d230 0x7fddac072f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdda40097c0 tx=0x7fdda401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c2f105e1b23248 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fdda9400640 1 -- 172.21.15.84:0/2450479779 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40b0070 con 0x7fddac06d230 2024-03-07T07:31:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fdda9400640 1 -- 172.21.15.84:0/2450479779 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40ab600 con 0x7fddac06d230 2024-03-07T07:31:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fdda9400640 1 -- 172.21.15.84:0/2450479779 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40ab9d0 con 0x7fddac06d230 2024-03-07T07:31:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddb0e00640 1 -- 172.21.15.84:0/2450479779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac06d230 msgr2=0x7fddac072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddb0e00640 1 --2- 172.21.15.84:0/2450479779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac06d230 0x7fddac072f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdda40097c0 tx=0x7fdda401c380 comp rx=0 tx=0).stop 2024-03-07T07:31:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddb0e00640 1 -- 172.21.15.84:0/2450479779 shutdown_connections 2024-03-07T07:31:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddb0e00640 1 --2- 172.21.15.84:0/2450479779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac06d230 0x7fddac072f10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddb0e00640 1 --2- 172.21.15.84:0/2450479779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac145a30 0x7fddac0729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddb0e00640 1 -- 172.21.15.84:0/2450479779 >> 172.21.15.84:0/2450479779 conn(0x7fddac0704b0 msgr2=0x7fddac0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddb0e00640 1 -- 172.21.15.84:0/2450479779 shutdown_connections 2024-03-07T07:31:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.619+0000 7fddb0e00640 1 -- 172.21.15.84:0/2450479779 wait complete. 2024-03-07T07:31:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 Processor -- start 2024-03-07T07:31:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 -- start start 2024-03-07T07:31:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac06d230 0x7fddac162610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac145a30 0x7fddac13ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddac0ae9d0 0x7fddac0ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac168d60 con 0x7fddac145a30 2024-03-07T07:31:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac168be0 con 0x7fddac0ae9d0 2024-03-07T07:31:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac168ee0 con 0x7fddac06d230 2024-03-07T07:31:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac145a30 0x7fddac13ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda9e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac06d230 0x7fddac162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddaa800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddac0ae9d0 0x7fddac0ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda9e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac06d230 0x7fddac162610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:58246/0 (socket says 172.21.15.84:58246) 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda9e00640 1 -- 172.21.15.84:0/832484062 learned_addr learned my addr 172.21.15.84:0/832484062 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda1400640 1 -- 172.21.15.84:0/832484062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac06d230 msgr2=0x7fddac162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda1400640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac06d230 0x7fddac162610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda1400640 1 -- 172.21.15.84:0/832484062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddac0ae9d0 msgr2=0x7fddac0ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda1400640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddac0ae9d0 0x7fddac0ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda1400640 1 -- 172.21.15.84:0/832484062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0ad930 con 0x7fddac145a30 2024-03-07T07:31:18.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddaa800640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddac0ae9d0 0x7fddac0ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda1400640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac145a30 0x7fddac13ec10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c430 tx=0x7fdd9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda2a00640 1 -- 172.21.15.84:0/832484062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd940074e0 con 0x7fddac145a30 2024-03-07T07:31:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda2a00640 1 -- 172.21.15.84:0/832484062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd940047f0 con 0x7fddac145a30 2024-03-07T07:31:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fdda2a00640 1 -- 172.21.15.84:0/832484062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94004be0 con 0x7fddac145a30 2024-03-07T07:31:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.623+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac0adc10 con 0x7fddac145a30 2024-03-07T07:31:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.627+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac0ae1d0 con 0x7fddac145a30 2024-03-07T07:31:18.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.627+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac0ae6b0 con 0x7fddac145a30 2024-03-07T07:31:18.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.627+0000 7fdda2a00640 1 -- 172.21.15.84:0/832484062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fdd94011070 con 0x7fddac145a30 2024-03-07T07:31:18.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.627+0000 7fdda2a00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.627+0000 7fdda2a00640 1 -- 172.21.15.84:0/832484062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd94084c00 con 0x7fddac145a30 2024-03-07T07:31:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.627+0000 7fdda9e00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.627+0000 7fdda9e00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0094c0 tx=0x7fdd9c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:18.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.631+0000 7fdda2a00640 1 -- 172.21.15.84:0/832484062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fddac0ae6b0 con 0x7fddac145a30 2024-03-07T07:31:18.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.783+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddac062d40 con 0x7fdd88066f60 2024-03-07T07:31:18.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fdda2a00640 1 -- 172.21.15.84:0/832484062 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249498 (secure 0 0 0) 0x7fddac062d40 con 0x7fdd88066f60 2024-03-07T07:31:18.794 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:18.796 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:31:18.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 msgr2=0x7fdd88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0094c0 tx=0x7fdd9c00b040 comp rx=0 tx=0).stop 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac145a30 msgr2=0x7fddac13ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac145a30 0x7fddac13ec10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c430 tx=0x7fdd9400c8f0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 shutdown_connections 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddac0ae9d0 0x7fddac0ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddac145a30 0x7fddac13ec10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 --2- 172.21.15.84:0/832484062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddac06d230 0x7fddac162610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 >> 172.21.15.84:0/832484062 conn(0x7fddac0704b0 msgr2=0x7fddac13f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 shutdown_connections 2024-03-07T07:31:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.791+0000 7fddb0e00640 1 -- 172.21.15.84:0/832484062 wait complete. 2024-03-07T07:31:18.814 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-07T07:31:16.877576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218864,"kb_used_data":2676,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755856,"statfs":{"total":773094113280,"available":772869996544,"internally_reserved":0,"allocated":2740224,"data_stored":1685772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.903119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027771+0000","last_change":"2024-03-07T07:31:14.022667+0000","last_active":"2024-03-07T07:31:14.027771+0000","last_peered":"2024-03-07T07:31:14.027771+0000","last_clean":"2024-03-07T07:31:14.027771+0000","last_became_active":"2024-03-07T07:31:14.021747+0000","last_became_peered":"2024-03-07T07:31:14.021747+0000","last_unstale":"2024-03-07T07:31:14.027771+0000","last_undegraded":"2024-03-07T07:31:14.027771+0000","last_fullsized":"2024-03-07T07:31:14.027771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.004120+0000","last_change":"2024-03-07T07:31:13.004120+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.004120+0000","last_undegraded":"2024-03-07T07:31:13.004120+0000","last_fullsized":"2024-03-07T07:31:13.004120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001187+0000","last_change":"2024-03-07T07:31:13.001187+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001187+0000","last_undegraded":"2024-03-07T07:31:13.001187+0000","last_fullsized":"2024-03-07T07:31:13.001187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016604+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:14.016604+0000","last_peered":"2024-03-07T07:31:14.016604+0000","last_clean":"2024-03-07T07:31:14.016604+0000","last_became_active":"2024-03-07T07:31:14.014792+0000","last_became_peered":"2024-03-07T07:31:14.014792+0000","last_unstale":"2024-03-07T07:31:14.016604+0000","last_undegraded":"2024-03-07T07:31:14.016604+0000","last_fullsized":"2024-03-07T07:31:14.016604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:45.587377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026125+0000","last_change":"2024-03-07T07:31:14.020574+0000","last_active":"2024-03-07T07:31:14.026125+0000","last_peered":"2024-03-07T07:31:14.026125+0000","last_clean":"2024-03-07T07:31:14.026125+0000","last_became_active":"2024-03-07T07:31:14.020305+0000","last_became_peered":"2024-03-07T07:31:14.020305+0000","last_unstale":"2024-03-07T07:31:14.026125+0000","last_undegraded":"2024-03-07T07:31:14.026125+0000","last_fullsized":"2024-03-07T07:31:14.026125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016723+0000","last_change":"2024-03-07T07:31:14.014335+0000","last_active":"2024-03-07T07:31:14.016723+0000","last_peered":"2024-03-07T07:31:14.016723+0000","last_clean":"2024-03-07T07:31:14.016723+0000","last_became_active":"2024-03-07T07:31:14.013975+0000","last_became_peered":"2024-03-07T07:31:14.013975+0000","last_unstale":"2024-03-07T07:31:14.016723+0000","last_undegraded":"2024-03-07T07:31:14.016723+0000","last_fullsized":"2024-03-07T07:31:14.016723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:37:22.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026231+0000","last_change":"2024-03-07T07:31:14.021322+0000","last_active":"2024-03-07T07:31:14.026231+0000","last_peered":"2024-03-07T07:31:14.026231+0000","last_clean":"2024-03-07T07:31:14.026231+0000","last_became_active":"2024-03-07T07:31:14.021007+0000","last_became_peered":"2024-03-07T07:31:14.021007+0000","last_unstale":"2024-03-07T07:31:14.026231+0000","last_undegraded":"2024-03-07T07:31:14.026231+0000","last_fullsized":"2024-03-07T07:31:14.026231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.006273+0000","last_change":"2024-03-07T07:31:13.006273+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.006273+0000","last_undegraded":"2024-03-07T07:31:13.006273+0000","last_fullsized":"2024-03-07T07:31:13.006273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016995+0000","last_change":"2024-03-07T07:31:14.011155+0000","last_active":"2024-03-07T07:31:14.016995+0000","last_peered":"2024-03-07T07:31:14.016995+0000","last_clean":"2024-03-07T07:31:14.016995+0000","last_became_active":"2024-03-07T07:31:14.010799+0000","last_became_peered":"2024-03-07T07:31:14.010799+0000","last_unstale":"2024-03-07T07:31:14.016995+0000","last_undegraded":"2024-03-07T07:31:14.016995+0000","last_fullsized":"2024-03-07T07:31:14.016995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:11.668041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014425+0000","last_change":"2024-03-07T07:31:14.002815+0000","last_active":"2024-03-07T07:31:14.014425+0000","last_peered":"2024-03-07T07:31:14.014425+0000","last_clean":"2024-03-07T07:31:14.014425+0000","last_became_active":"2024-03-07T07:31:14.002600+0000","last_became_peered":"2024-03-07T07:31:14.002600+0000","last_unstale":"2024-03-07T07:31:14.014425+0000","last_undegraded":"2024-03-07T07:31:14.014425+0000","last_fullsized":"2024-03-07T07:31:14.014425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026157+0000","last_change":"2024-03-07T07:31:14.020556+0000","last_active":"2024-03-07T07:31:14.026157+0000","last_peered":"2024-03-07T07:31:14.026157+0000","last_clean":"2024-03-07T07:31:14.026157+0000","last_became_active":"2024-03-07T07:31:14.020256+0000","last_became_peered":"2024-03-07T07:31:14.020256+0000","last_unstale":"2024-03-07T07:31:14.026157+0000","last_undegraded":"2024-03-07T07:31:14.026157+0000","last_fullsized":"2024-03-07T07:31:14.026157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025902+0000","last_change":"2024-03-07T07:31:14.014180+0000","last_active":"2024-03-07T07:31:14.025902+0000","last_peered":"2024-03-07T07:31:14.025902+0000","last_clean":"2024-03-07T07:31:14.025902+0000","last_became_active":"2024-03-07T07:31:14.013845+0000","last_became_peered":"2024-03-07T07:31:14.013845+0000","last_unstale":"2024-03-07T07:31:14.025902+0000","last_undegraded":"2024-03-07T07:31:14.025902+0000","last_fullsized":"2024-03-07T07:31:14.025902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:05.763428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991054+0000","last_change":"2024-03-07T07:31:12.991054+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991054+0000","last_undegraded":"2024-03-07T07:31:12.991054+0000","last_fullsized":"2024-03-07T07:31:12.991054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.993627+0000","last_change":"2024-03-07T07:31:12.993627+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.993627+0000","last_undegraded":"2024-03-07T07:31:12.993627+0000","last_fullsized":"2024-03-07T07:31:12.993627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.003021+0000","last_change":"2024-03-07T07:31:13.003021+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.003021+0000","last_undegraded":"2024-03-07T07:31:13.003021+0000","last_fullsized":"2024-03-07T07:31:13.003021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.019786+0000","last_change":"2024-03-07T07:31:14.004296+0000","last_active":"2024-03-07T07:31:14.019786+0000","last_peered":"2024-03-07T07:31:14.019786+0000","last_clean":"2024-03-07T07:31:14.019786+0000","last_became_active":"2024-03-07T07:31:14.003978+0000","last_became_peered":"2024-03-07T07:31:14.003978+0000","last_unstale":"2024-03-07T07:31:14.019786+0000","last_undegraded":"2024-03-07T07:31:14.019786+0000","last_fullsized":"2024-03-07T07:31:14.019786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.029918+0000","last_change":"2024-03-07T07:31:14.026782+0000","last_active":"2024-03-07T07:31:14.029918+0000","last_peered":"2024-03-07T07:31:14.029918+0000","last_clean":"2024-03-07T07:31:14.029918+0000","last_became_active":"2024-03-07T07:31:14.026435+0000","last_became_peered":"2024-03-07T07:31:14.026435+0000","last_unstale":"2024-03-07T07:31:14.029918+0000","last_undegraded":"2024-03-07T07:31:14.029918+0000","last_fullsized":"2024-03-07T07:31:14.029918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992656+0000","last_change":"2024-03-07T07:31:12.992656+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992656+0000","last_undegraded":"2024-03-07T07:31:12.992656+0000","last_fullsized":"2024-03-07T07:31:12.992656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028130+0000","last_change":"2024-03-07T07:31:14.018840+0000","last_active":"2024-03-07T07:31:14.028130+0000","last_peered":"2024-03-07T07:31:14.028130+0000","last_clean":"2024-03-07T07:31:14.028130+0000","last_became_active":"2024-03-07T07:31:14.015465+0000","last_became_peered":"2024-03-07T07:31:14.015465+0000","last_unstale":"2024-03-07T07:31:14.028130+0000","last_undegraded":"2024-03-07T07:31:14.028130+0000","last_fullsized":"2024-03-07T07:31:14.028130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016418+0000","last_change":"2024-03-07T07:31:14.003946+0000","last_active":"2024-03-07T07:31:14.016418+0000","last_peered":"2024-03-07T07:31:14.016418+0000","last_clean":"2024-03-07T07:31:14.016418+0000","last_became_active":"2024-03-07T07:31:14.003724+0000","last_became_peered":"2024-03-07T07:31:14.003724+0000","last_unstale":"2024-03-07T07:31:14.016418+0000","last_undegraded":"2024-03-07T07:31:14.016418+0000","last_fullsized":"2024-03-07T07:31:14.016418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:31.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.988516+0000","last_change":"2024-03-07T07:31:12.988516+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.988516+0000","last_undegraded":"2024-03-07T07:31:12.988516+0000","last_fullsized":"2024-03-07T07:31:12.988516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.023700+0000","last_change":"2024-03-07T07:31:14.019962+0000","last_active":"2024-03-07T07:31:14.023700+0000","last_peered":"2024-03-07T07:31:14.023700+0000","last_clean":"2024-03-07T07:31:14.023700+0000","last_became_active":"2024-03-07T07:31:14.019664+0000","last_became_peered":"2024-03-07T07:31:14.019664+0000","last_unstale":"2024-03-07T07:31:14.023700+0000","last_undegraded":"2024-03-07T07:31:14.023700+0000","last_fullsized":"2024-03-07T07:31:14.023700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:56.429772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.994230+0000","last_change":"2024-03-07T07:31:12.994230+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.994230+0000","last_undegraded":"2024-03-07T07:31:12.994230+0000","last_fullsized":"2024-03-07T07:31:12.994230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027861+0000","last_change":"2024-03-07T07:31:14.019616+0000","last_active":"2024-03-07T07:31:14.027861+0000","last_peered":"2024-03-07T07:31:14.027861+0000","last_clean":"2024-03-07T07:31:14.027861+0000","last_became_active":"2024-03-07T07:31:14.019246+0000","last_became_peered":"2024-03-07T07:31:14.019246+0000","last_unstale":"2024-03-07T07:31:14.027861+0000","last_undegraded":"2024-03-07T07:31:14.027861+0000","last_fullsized":"2024-03-07T07:31:14.027861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001690+0000","last_change":"2024-03-07T07:31:13.001690+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001690+0000","last_undegraded":"2024-03-07T07:31:13.001690+0000","last_fullsized":"2024-03-07T07:31:13.001690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.018316+0000","last_change":"2024-03-07T07:31:14.017123+0000","last_active":"2024-03-07T07:31:14.018316+0000","last_peered":"2024-03-07T07:31:14.018316+0000","last_clean":"2024-03-07T07:31:14.018316+0000","last_became_active":"2024-03-07T07:31:14.016071+0000","last_became_peered":"2024-03-07T07:31:14.016071+0000","last_unstale":"2024-03-07T07:31:14.018316+0000","last_undegraded":"2024-03-07T07:31:14.018316+0000","last_fullsized":"2024-03-07T07:31:14.018316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:46.926372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991173+0000","last_change":"2024-03-07T07:31:12.991173+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991173+0000","last_undegraded":"2024-03-07T07:31:12.991173+0000","last_fullsized":"2024-03-07T07:31:12.991173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992584+0000","last_change":"2024-03-07T07:31:12.992584+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992584+0000","last_undegraded":"2024-03-07T07:31:12.992584+0000","last_fullsized":"2024-03-07T07:31:12.992584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.998641+0000","last_change":"2024-03-07T07:31:12.998641+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.998641+0000","last_undegraded":"2024-03-07T07:31:12.998641+0000","last_fullsized":"2024-03-07T07:31:12.998641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025797+0000","last_change":"2024-03-07T07:31:14.018277+0000","last_active":"2024-03-07T07:31:14.025797+0000","last_peered":"2024-03-07T07:31:14.025797+0000","last_clean":"2024-03-07T07:31:14.025797+0000","last_became_active":"2024-03-07T07:31:14.017969+0000","last_became_peered":"2024-03-07T07:31:14.017969+0000","last_unstale":"2024-03-07T07:31:14.025797+0000","last_undegraded":"2024-03-07T07:31:14.025797+0000","last_fullsized":"2024-03-07T07:31:14.025797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992343+0000","last_change":"2024-03-07T07:31:12.992343+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992343+0000","last_undegraded":"2024-03-07T07:31:12.992343+0000","last_fullsized":"2024-03-07T07:31:12.992343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.030095+0000","last_change":"2024-03-07T07:31:14.025073+0000","last_active":"2024-03-07T07:31:14.030095+0000","last_peered":"2024-03-07T07:31:14.030095+0000","last_clean":"2024-03-07T07:31:14.030095+0000","last_became_active":"2024-03-07T07:31:14.024374+0000","last_became_peered":"2024-03-07T07:31:14.024374+0000","last_unstale":"2024-03-07T07:31:14.030095+0000","last_undegraded":"2024-03-07T07:31:14.030095+0000","last_fullsized":"2024-03-07T07:31:14.030095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:11.668041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.011254+0000","last_change":"2024-03-07T07:31:14.009391+0000","last_active":"2024-03-07T07:31:14.011254+0000","last_peered":"2024-03-07T07:31:14.011254+0000","last_clean":"2024-03-07T07:31:14.011254+0000","last_became_active":"2024-03-07T07:31:14.009148+0000","last_became_peered":"2024-03-07T07:31:14.009148+0000","last_unstale":"2024-03-07T07:31:14.011254+0000","last_undegraded":"2024-03-07T07:31:14.011254+0000","last_fullsized":"2024-03-07T07:31:14.011254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:46.926372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.012693+0000","last_change":"2024-03-07T07:31:13.010423+0000","last_active":"2024-03-07T07:31:13.012693+0000","last_peered":"2024-03-07T07:31:13.012693+0000","last_clean":"2024-03-07T07:31:13.012693+0000","last_became_active":"2024-03-07T07:31:13.010096+0000","last_became_peered":"2024-03-07T07:31:13.010096+0000","last_unstale":"2024-03-07T07:31:13.012693+0000","last_undegraded":"2024-03-07T07:31:13.012693+0000","last_fullsized":"2024-03-07T07:31:13.012693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:24.512582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986402+0000","last_change":"2024-03-07T07:31:12.986402+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986402+0000","last_undegraded":"2024-03-07T07:31:12.986402+0000","last_fullsized":"2024-03-07T07:31:12.986402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027850+0000","last_change":"2024-03-07T07:31:13.006659+0000","last_active":"2024-03-07T07:31:14.027850+0000","last_peered":"2024-03-07T07:31:14.027850+0000","last_clean":"2024-03-07T07:31:14.027850+0000","last_became_active":"2024-03-07T07:31:13.005927+0000","last_became_peered":"2024-03-07T07:31:13.005927+0000","last_unstale":"2024-03-07T07:31:14.027850+0000","last_undegraded":"2024-03-07T07:31:14.027850+0000","last_fullsized":"2024-03-07T07:31:14.027850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010196+0000","last_change":"2024-03-07T07:31:13.003135+0000","last_active":"2024-03-07T07:31:13.010196+0000","last_peered":"2024-03-07T07:31:13.010196+0000","last_clean":"2024-03-07T07:31:13.010196+0000","last_became_active":"2024-03-07T07:31:13.002843+0000","last_became_peered":"2024-03-07T07:31:13.002843+0000","last_unstale":"2024-03-07T07:31:13.010196+0000","last_undegraded":"2024-03-07T07:31:13.010196+0000","last_fullsized":"2024-03-07T07:31:13.010196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:36:06.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.997002+0000","last_change":"2024-03-07T07:31:12.997002+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.997002+0000","last_undegraded":"2024-03-07T07:31:12.997002+0000","last_fullsized":"2024-03-07T07:31:12.997002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.997483+0000","last_change":"2024-03-07T07:31:13.006518+0000","last_active":"2024-03-07T07:31:13.997483+0000","last_peered":"2024-03-07T07:31:13.997483+0000","last_clean":"2024-03-07T07:31:13.997483+0000","last_became_active":"2024-03-07T07:31:13.005662+0000","last_became_peered":"2024-03-07T07:31:13.005662+0000","last_unstale":"2024-03-07T07:31:13.997483+0000","last_undegraded":"2024-03-07T07:31:13.997483+0000","last_fullsized":"2024-03-07T07:31:13.997483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986679+0000","last_change":"2024-03-07T07:31:12.986679+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986679+0000","last_undegraded":"2024-03-07T07:31:12.986679+0000","last_fullsized":"2024-03-07T07:31:12.986679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.997623+0000","last_change":"2024-03-07T07:31:13.014357+0000","last_active":"2024-03-07T07:31:13.997623+0000","last_peered":"2024-03-07T07:31:13.997623+0000","last_clean":"2024-03-07T07:31:13.997623+0000","last_became_active":"2024-03-07T07:31:13.014065+0000","last_became_peered":"2024-03-07T07:31:13.014065+0000","last_unstale":"2024-03-07T07:31:13.997623+0000","last_undegraded":"2024-03-07T07:31:13.997623+0000","last_fullsized":"2024-03-07T07:31:13.997623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.018298+0000","last_change":"2024-03-07T07:31:14.016928+0000","last_active":"2024-03-07T07:31:14.018298+0000","last_peered":"2024-03-07T07:31:14.018298+0000","last_clean":"2024-03-07T07:31:14.018298+0000","last_became_active":"2024-03-07T07:31:14.016029+0000","last_became_peered":"2024-03-07T07:31:14.016029+0000","last_unstale":"2024-03-07T07:31:14.018298+0000","last_undegraded":"2024-03-07T07:31:14.018298+0000","last_fullsized":"2024-03-07T07:31:14.018298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:24.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.987853+0000","last_change":"2024-03-07T07:31:13.017045+0000","last_active":"2024-03-07T07:31:13.987853+0000","last_peered":"2024-03-07T07:31:13.987853+0000","last_clean":"2024-03-07T07:31:13.987853+0000","last_became_active":"2024-03-07T07:31:13.016712+0000","last_became_peered":"2024-03-07T07:31:13.016712+0000","last_unstale":"2024-03-07T07:31:13.987853+0000","last_undegraded":"2024-03-07T07:31:13.987853+0000","last_fullsized":"2024-03-07T07:31:13.987853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.000461+0000","last_change":"2024-03-07T07:31:13.000461+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.000461+0000","last_undegraded":"2024-03-07T07:31:13.000461+0000","last_fullsized":"2024-03-07T07:31:13.000461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010890+0000","last_change":"2024-03-07T07:31:13.004264+0000","last_active":"2024-03-07T07:31:13.010890+0000","last_peered":"2024-03-07T07:31:13.010890+0000","last_clean":"2024-03-07T07:31:13.010890+0000","last_became_active":"2024-03-07T07:31:13.003883+0000","last_became_peered":"2024-03-07T07:31:13.003883+0000","last_unstale":"2024-03-07T07:31:13.010890+0000","last_undegraded":"2024-03-07T07:31:13.010890+0000","last_fullsized":"2024-03-07T07:31:13.010890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:37.603421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025523+0000","last_change":"2024-03-07T07:31:14.007051+0000","last_active":"2024-03-07T07:31:14.025523+0000","last_peered":"2024-03-07T07:31:14.025523+0000","last_clean":"2024-03-07T07:31:14.025523+0000","last_became_active":"2024-03-07T07:31:14.005904+0000","last_became_peered":"2024-03-07T07:31:14.005904+0000","last_unstale":"2024-03-07T07:31:14.025523+0000","last_undegraded":"2024-03-07T07:31:14.025523+0000","last_fullsized":"2024-03-07T07:31:14.025523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.031099+0000","last_change":"2024-03-07T07:31:12.997602+0000","last_active":"2024-03-07T07:31:14.031099+0000","last_peered":"2024-03-07T07:31:14.031099+0000","last_clean":"2024-03-07T07:31:14.031099+0000","last_became_active":"2024-03-07T07:31:12.997204+0000","last_became_peered":"2024-03-07T07:31:12.997204+0000","last_unstale":"2024-03-07T07:31:14.031099+0000","last_undegraded":"2024-03-07T07:31:14.031099+0000","last_fullsized":"2024-03-07T07:31:14.031099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.032451+0000","last_change":"2024-03-07T07:31:14.028791+0000","last_active":"2024-03-07T07:31:14.032451+0000","last_peered":"2024-03-07T07:31:14.032451+0000","last_clean":"2024-03-07T07:31:14.032451+0000","last_became_active":"2024-03-07T07:31:14.028591+0000","last_became_peered":"2024-03-07T07:31:14.028591+0000","last_unstale":"2024-03-07T07:31:14.032451+0000","last_undegraded":"2024-03-07T07:31:14.032451+0000","last_fullsized":"2024-03-07T07:31:14.032451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.015380+0000","last_change":"2024-03-07T07:31:13.011937+0000","last_active":"2024-03-07T07:31:13.015380+0000","last_peered":"2024-03-07T07:31:13.015380+0000","last_clean":"2024-03-07T07:31:13.015380+0000","last_became_active":"2024-03-07T07:31:13.011577+0000","last_became_peered":"2024-03-07T07:31:13.011577+0000","last_unstale":"2024-03-07T07:31:13.015380+0000","last_undegraded":"2024-03-07T07:31:13.015380+0000","last_fullsized":"2024-03-07T07:31:13.015380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990977+0000","last_change":"2024-03-07T07:31:12.990977+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990977+0000","last_undegraded":"2024-03-07T07:31:12.990977+0000","last_fullsized":"2024-03-07T07:31:12.990977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004304+0000","last_change":"2024-03-07T07:31:13.000961+0000","last_active":"2024-03-07T07:31:14.004304+0000","last_peered":"2024-03-07T07:31:14.004304+0000","last_clean":"2024-03-07T07:31:14.004304+0000","last_became_active":"2024-03-07T07:31:13.000129+0000","last_became_peered":"2024-03-07T07:31:13.000129+0000","last_unstale":"2024-03-07T07:31:14.004304+0000","last_undegraded":"2024-03-07T07:31:14.004304+0000","last_fullsized":"2024-03-07T07:31:14.004304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:58.045352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028425+0000","last_change":"2024-03-07T07:31:14.022537+0000","last_active":"2024-03-07T07:31:14.028425+0000","last_peered":"2024-03-07T07:31:14.028425+0000","last_clean":"2024-03-07T07:31:14.028425+0000","last_became_active":"2024-03-07T07:31:14.022221+0000","last_became_peered":"2024-03-07T07:31:14.022221+0000","last_unstale":"2024-03-07T07:31:14.028425+0000","last_undegraded":"2024-03-07T07:31:14.028425+0000","last_fullsized":"2024-03-07T07:31:14.028425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.986705+0000","last_change":"2024-03-07T07:31:13.009533+0000","last_active":"2024-03-07T07:31:13.986705+0000","last_peered":"2024-03-07T07:31:13.986705+0000","last_clean":"2024-03-07T07:31:13.986705+0000","last_became_active":"2024-03-07T07:31:13.009224+0000","last_became_peered":"2024-03-07T07:31:13.009224+0000","last_unstale":"2024-03-07T07:31:13.986705+0000","last_undegraded":"2024-03-07T07:31:13.986705+0000","last_fullsized":"2024-03-07T07:31:13.986705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:40.675440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.019222+0000","last_change":"2024-03-07T07:31:14.015133+0000","last_active":"2024-03-07T07:31:14.019222+0000","last_peered":"2024-03-07T07:31:14.019222+0000","last_clean":"2024-03-07T07:31:14.019222+0000","last_became_active":"2024-03-07T07:31:14.014859+0000","last_became_peered":"2024-03-07T07:31:14.014859+0000","last_unstale":"2024-03-07T07:31:14.019222+0000","last_undegraded":"2024-03-07T07:31:14.019222+0000","last_fullsized":"2024-03-07T07:31:14.019222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:41.682431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011044+0000","last_change":"2024-03-07T07:31:13.000976+0000","last_active":"2024-03-07T07:31:13.011044+0000","last_peered":"2024-03-07T07:31:13.011044+0000","last_clean":"2024-03-07T07:31:13.011044+0000","last_became_active":"2024-03-07T07:31:13.000624+0000","last_became_peered":"2024-03-07T07:31:13.000624+0000","last_unstale":"2024-03-07T07:31:13.011044+0000","last_undegraded":"2024-03-07T07:31:13.011044+0000","last_fullsized":"2024-03-07T07:31:13.011044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:36:06.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025488+0000","last_change":"2024-03-07T07:31:14.008321+0000","last_active":"2024-03-07T07:31:14.025488+0000","last_peered":"2024-03-07T07:31:14.025488+0000","last_clean":"2024-03-07T07:31:14.025488+0000","last_became_active":"2024-03-07T07:31:14.008039+0000","last_became_peered":"2024-03-07T07:31:14.008039+0000","last_unstale":"2024-03-07T07:31:14.025488+0000","last_undegraded":"2024-03-07T07:31:14.025488+0000","last_fullsized":"2024-03-07T07:31:14.025488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.023370+0000","last_change":"2024-03-07T07:31:13.008580+0000","last_active":"2024-03-07T07:31:14.023370+0000","last_peered":"2024-03-07T07:31:14.023370+0000","last_clean":"2024-03-07T07:31:14.023370+0000","last_became_active":"2024-03-07T07:31:13.008276+0000","last_became_peered":"2024-03-07T07:31:13.008276+0000","last_unstale":"2024-03-07T07:31:14.023370+0000","last_undegraded":"2024-03-07T07:31:14.023370+0000","last_fullsized":"2024-03-07T07:31:14.023370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.008377+0000","last_change":"2024-03-07T07:31:14.003764+0000","last_active":"2024-03-07T07:31:14.008377+0000","last_peered":"2024-03-07T07:31:14.008377+0000","last_clean":"2024-03-07T07:31:14.008377+0000","last_became_active":"2024-03-07T07:31:14.002976+0000","last_became_peered":"2024-03-07T07:31:14.002976+0000","last_unstale":"2024-03-07T07:31:14.008377+0000","last_undegraded":"2024-03-07T07:31:14.008377+0000","last_fullsized":"2024-03-07T07:31:14.008377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:51.219777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013778+0000","last_change":"2024-03-07T07:31:13.010016+0000","last_active":"2024-03-07T07:31:13.013778+0000","last_peered":"2024-03-07T07:31:13.013778+0000","last_clean":"2024-03-07T07:31:13.013778+0000","last_became_active":"2024-03-07T07:31:13.009751+0000","last_became_peered":"2024-03-07T07:31:13.009751+0000","last_unstale":"2024-03-07T07:31:13.013778+0000","last_undegraded":"2024-03-07T07:31:13.013778+0000","last_fullsized":"2024-03-07T07:31:13.013778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:45:09.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025474+0000","last_change":"2024-03-07T07:31:14.013078+0000","last_active":"2024-03-07T07:31:14.025474+0000","last_peered":"2024-03-07T07:31:14.025474+0000","last_clean":"2024-03-07T07:31:14.025474+0000","last_became_active":"2024-03-07T07:31:14.012816+0000","last_became_peered":"2024-03-07T07:31:14.012816+0000","last_unstale":"2024-03-07T07:31:14.025474+0000","last_undegraded":"2024-03-07T07:31:14.025474+0000","last_fullsized":"2024-03-07T07:31:14.025474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:18.111128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.020779+0000","last_change":"2024-03-07T07:31:13.016042+0000","last_active":"2024-03-07T07:31:13.020779+0000","last_peered":"2024-03-07T07:31:13.020779+0000","last_clean":"2024-03-07T07:31:13.020779+0000","last_became_active":"2024-03-07T07:31:13.015749+0000","last_became_peered":"2024-03-07T07:31:13.015749+0000","last_unstale":"2024-03-07T07:31:13.020779+0000","last_undegraded":"2024-03-07T07:31:13.020779+0000","last_fullsized":"2024-03-07T07:31:13.020779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025934+0000","last_change":"2024-03-07T07:31:14.015090+0000","last_active":"2024-03-07T07:31:14.025934+0000","last_peered":"2024-03-07T07:31:14.025934+0000","last_clean":"2024-03-07T07:31:14.025934+0000","last_became_active":"2024-03-07T07:31:14.014806+0000","last_became_peered":"2024-03-07T07:31:14.014806+0000","last_unstale":"2024-03-07T07:31:14.025934+0000","last_undegraded":"2024-03-07T07:31:14.025934+0000","last_fullsized":"2024-03-07T07:31:14.025934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:37.677717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010244+0000","last_change":"2024-03-07T07:31:13.002882+0000","last_active":"2024-03-07T07:31:13.010244+0000","last_peered":"2024-03-07T07:31:13.010244+0000","last_clean":"2024-03-07T07:31:13.010244+0000","last_became_active":"2024-03-07T07:31:13.002570+0000","last_became_peered":"2024-03-07T07:31:13.002570+0000","last_unstale":"2024-03-07T07:31:13.010244+0000","last_undegraded":"2024-03-07T07:31:13.010244+0000","last_fullsized":"2024-03-07T07:31:13.010244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:47:07.277106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025420+0000","last_change":"2024-03-07T07:31:14.008276+0000","last_active":"2024-03-07T07:31:14.025420+0000","last_peered":"2024-03-07T07:31:14.025420+0000","last_clean":"2024-03-07T07:31:14.025420+0000","last_became_active":"2024-03-07T07:31:14.007776+0000","last_became_peered":"2024-03-07T07:31:14.007776+0000","last_unstale":"2024-03-07T07:31:14.025420+0000","last_undegraded":"2024-03-07T07:31:14.025420+0000","last_fullsized":"2024-03-07T07:31:14.025420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.995173+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:31:13.995173+0000","last_peered":"2024-03-07T07:31:13.995173+0000","last_clean":"2024-03-07T07:31:13.995173+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:31:13.995173+0000","last_undegraded":"2024-03-07T07:31:13.995173+0000","last_fullsized":"2024-03-07T07:31:13.995173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004578+0000","last_change":"2024-03-07T07:31:13.008377+0000","last_active":"2024-03-07T07:31:14.004578+0000","last_peered":"2024-03-07T07:31:14.004578+0000","last_clean":"2024-03-07T07:31:14.004578+0000","last_became_active":"2024-03-07T07:31:13.007831+0000","last_became_peered":"2024-03-07T07:31:13.007831+0000","last_unstale":"2024-03-07T07:31:14.004578+0000","last_undegraded":"2024-03-07T07:31:14.004578+0000","last_fullsized":"2024-03-07T07:31:14.004578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:04.756437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986419+0000","last_change":"2024-03-07T07:31:12.986419+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986419+0000","last_undegraded":"2024-03-07T07:31:12.986419+0000","last_fullsized":"2024-03-07T07:31:12.986419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.003599+0000","last_change":"2024-03-07T07:31:13.008418+0000","last_active":"2024-03-07T07:31:14.003599+0000","last_peered":"2024-03-07T07:31:14.003599+0000","last_clean":"2024-03-07T07:31:14.003599+0000","last_became_active":"2024-03-07T07:31:13.008022+0000","last_became_peered":"2024-03-07T07:31:13.008022+0000","last_unstale":"2024-03-07T07:31:14.003599+0000","last_undegraded":"2024-03-07T07:31:14.003599+0000","last_fullsized":"2024-03-07T07:31:14.003599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990303+0000","last_change":"2024-03-07T07:31:12.990303+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990303+0000","last_undegraded":"2024-03-07T07:31:12.990303+0000","last_fullsized":"2024-03-07T07:31:12.990303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.020519+0000","last_change":"2024-03-07T07:31:13.012807+0000","last_active":"2024-03-07T07:31:13.020519+0000","last_peered":"2024-03-07T07:31:13.020519+0000","last_clean":"2024-03-07T07:31:13.020519+0000","last_became_active":"2024-03-07T07:31:13.011968+0000","last_became_peered":"2024-03-07T07:31:13.011968+0000","last_unstale":"2024-03-07T07:31:13.020519+0000","last_undegraded":"2024-03-07T07:31:13.020519+0000","last_fullsized":"2024-03-07T07:31:13.020519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:50.212787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.005761+0000","last_change":"2024-03-07T07:31:13.005761+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.005761+0000","last_undegraded":"2024-03-07T07:31:13.005761+0000","last_fullsized":"2024-03-07T07:31:13.005761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004381+0000","last_change":"2024-03-07T07:31:13.004811+0000","last_active":"2024-03-07T07:31:14.004381+0000","last_peered":"2024-03-07T07:31:14.004381+0000","last_clean":"2024-03-07T07:31:14.004381+0000","last_became_active":"2024-03-07T07:31:13.001378+0000","last_became_peered":"2024-03-07T07:31:13.001378+0000","last_unstale":"2024-03-07T07:31:14.004381+0000","last_undegraded":"2024-03-07T07:31:14.004381+0000","last_fullsized":"2024-03-07T07:31:14.004381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:30.900538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.020685+0000","last_change":"2024-03-07T07:31:14.001567+0000","last_active":"2024-03-07T07:31:14.020685+0000","last_peered":"2024-03-07T07:31:14.020685+0000","last_clean":"2024-03-07T07:31:14.020685+0000","last_became_active":"2024-03-07T07:31:14.001209+0000","last_became_peered":"2024-03-07T07:31:14.001209+0000","last_unstale":"2024-03-07T07:31:14.020685+0000","last_undegraded":"2024-03-07T07:31:14.020685+0000","last_fullsized":"2024-03-07T07:31:14.020685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011322+0000","last_change":"2024-03-07T07:31:13.009741+0000","last_active":"2024-03-07T07:31:13.011322+0000","last_peered":"2024-03-07T07:31:13.011322+0000","last_clean":"2024-03-07T07:31:13.011322+0000","last_became_active":"2024-03-07T07:31:13.009377+0000","last_became_peered":"2024-03-07T07:31:13.009377+0000","last_unstale":"2024-03-07T07:31:13.011322+0000","last_undegraded":"2024-03-07T07:31:13.011322+0000","last_fullsized":"2024-03-07T07:31:13.011322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:46:14.381163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.032452+0000","last_change":"2024-03-07T07:31:14.029593+0000","last_active":"2024-03-07T07:31:14.032452+0000","last_peered":"2024-03-07T07:31:14.032452+0000","last_clean":"2024-03-07T07:31:14.032452+0000","last_became_active":"2024-03-07T07:31:14.029271+0000","last_became_peered":"2024-03-07T07:31:14.029271+0000","last_unstale":"2024-03-07T07:31:14.032452+0000","last_undegraded":"2024-03-07T07:31:14.032452+0000","last_fullsized":"2024-03-07T07:31:14.032452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:41.682431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004972+0000","last_change":"2024-03-07T07:31:12.999335+0000","last_active":"2024-03-07T07:31:14.004972+0000","last_peered":"2024-03-07T07:31:14.004972+0000","last_clean":"2024-03-07T07:31:14.004972+0000","last_became_active":"2024-03-07T07:31:12.998960+0000","last_became_peered":"2024-03-07T07:31:12.998960+0000","last_unstale":"2024-03-07T07:31:14.004972+0000","last_undegraded":"2024-03-07T07:31:14.004972+0000","last_fullsized":"2024-03-07T07:31:14.004972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:36.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990933+0000","last_change":"2024-03-07T07:31:12.990933+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990933+0000","last_undegraded":"2024-03-07T07:31:12.990933+0000","last_fullsized":"2024-03-07T07:31:12.990933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013696+0000","last_change":"2024-03-07T07:31:13.004776+0000","last_active":"2024-03-07T07:31:13.013696+0000","last_peered":"2024-03-07T07:31:13.013696+0000","last_clean":"2024-03-07T07:31:13.013696+0000","last_became_active":"2024-03-07T07:31:13.004179+0000","last_became_peered":"2024-03-07T07:31:13.004179+0000","last_unstale":"2024-03-07T07:31:13.013696+0000","last_undegraded":"2024-03-07T07:31:13.013696+0000","last_fullsized":"2024-03-07T07:31:13.013696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:45.950345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986414+0000","last_change":"2024-03-07T07:31:12.986414+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986414+0000","last_undegraded":"2024-03-07T07:31:12.986414+0000","last_fullsized":"2024-03-07T07:31:12.986414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026653+0000","last_change":"2024-03-07T07:31:13.014574+0000","last_active":"2024-03-07T07:31:14.026653+0000","last_peered":"2024-03-07T07:31:14.026653+0000","last_clean":"2024-03-07T07:31:14.026653+0000","last_became_active":"2024-03-07T07:31:13.014264+0000","last_became_peered":"2024-03-07T07:31:13.014264+0000","last_unstale":"2024-03-07T07:31:14.026653+0000","last_undegraded":"2024-03-07T07:31:14.026653+0000","last_fullsized":"2024-03-07T07:31:14.026653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.987092+0000","last_change":"2024-03-07T07:31:12.987092+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.987092+0000","last_undegraded":"2024-03-07T07:31:12.987092+0000","last_fullsized":"2024-03-07T07:31:12.987092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.986217+0000","last_change":"2024-03-07T07:31:13.010611+0000","last_active":"2024-03-07T07:31:13.986217+0000","last_peered":"2024-03-07T07:31:13.986217+0000","last_clean":"2024-03-07T07:31:13.986217+0000","last_became_active":"2024-03-07T07:31:13.005305+0000","last_became_peered":"2024-03-07T07:31:13.005305+0000","last_unstale":"2024-03-07T07:31:13.986217+0000","last_undegraded":"2024-03-07T07:31:13.986217+0000","last_fullsized":"2024-03-07T07:31:13.986217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:10.661050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028674+0000","last_change":"2024-03-07T07:31:14.021524+0000","last_active":"2024-03-07T07:31:14.028674+0000","last_peered":"2024-03-07T07:31:14.028674+0000","last_clean":"2024-03-07T07:31:14.028674+0000","last_became_active":"2024-03-07T07:31:14.021248+0000","last_became_peered":"2024-03-07T07:31:14.021248+0000","last_unstale":"2024-03-07T07:31:14.028674+0000","last_undegraded":"2024-03-07T07:31:14.028674+0000","last_fullsized":"2024-03-07T07:31:14.028674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013629+0000","last_change":"2024-03-07T07:31:13.002330+0000","last_active":"2024-03-07T07:31:13.013629+0000","last_peered":"2024-03-07T07:31:13.013629+0000","last_clean":"2024-03-07T07:31:13.013629+0000","last_became_active":"2024-03-07T07:31:13.002030+0000","last_became_peered":"2024-03-07T07:31:13.002030+0000","last_unstale":"2024-03-07T07:31:13.013629+0000","last_undegraded":"2024-03-07T07:31:13.013629+0000","last_fullsized":"2024-03-07T07:31:13.013629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:08:44.860696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.987514+0000","last_change":"2024-03-07T07:31:12.987514+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.987514+0000","last_undegraded":"2024-03-07T07:31:12.987514+0000","last_fullsized":"2024-03-07T07:31:12.987514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011105+0000","last_change":"2024-03-07T07:31:13.008737+0000","last_active":"2024-03-07T07:31:13.011105+0000","last_peered":"2024-03-07T07:31:13.011105+0000","last_clean":"2024-03-07T07:31:13.011105+0000","last_became_active":"2024-03-07T07:31:13.008485+0000","last_became_peered":"2024-03-07T07:31:13.008485+0000","last_unstale":"2024-03-07T07:31:13.011105+0000","last_undegraded":"2024-03-07T07:31:13.011105+0000","last_fullsized":"2024-03-07T07:31:13.011105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:08:44.860696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991966+0000","last_change":"2024-03-07T07:31:12.991966+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991966+0000","last_undegraded":"2024-03-07T07:31:12.991966+0000","last_fullsized":"2024-03-07T07:31:12.991966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025664+0000","last_change":"2024-03-07T07:31:13.008117+0000","last_active":"2024-03-07T07:31:14.025664+0000","last_peered":"2024-03-07T07:31:14.025664+0000","last_clean":"2024-03-07T07:31:14.025664+0000","last_became_active":"2024-03-07T07:31:13.006517+0000","last_became_peered":"2024-03-07T07:31:13.006517+0000","last_unstale":"2024-03-07T07:31:14.025664+0000","last_undegraded":"2024-03-07T07:31:14.025664+0000","last_fullsized":"2024-03-07T07:31:14.025664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:17.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025684+0000","last_change":"2024-03-07T07:31:14.011780+0000","last_active":"2024-03-07T07:31:14.025684+0000","last_peered":"2024-03-07T07:31:14.025684+0000","last_clean":"2024-03-07T07:31:14.025684+0000","last_became_active":"2024-03-07T07:31:14.011509+0000","last_became_peered":"2024-03-07T07:31:14.011509+0000","last_unstale":"2024-03-07T07:31:14.025684+0000","last_undegraded":"2024-03-07T07:31:14.025684+0000","last_fullsized":"2024-03-07T07:31:14.025684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028411+0000","last_change":"2024-03-07T07:31:14.024307+0000","last_active":"2024-03-07T07:31:14.028411+0000","last_peered":"2024-03-07T07:31:14.028411+0000","last_clean":"2024-03-07T07:31:14.028411+0000","last_became_active":"2024-03-07T07:31:14.024003+0000","last_became_peered":"2024-03-07T07:31:14.024003+0000","last_unstale":"2024-03-07T07:31:14.028411+0000","last_undegraded":"2024-03-07T07:31:14.028411+0000","last_fullsized":"2024-03-07T07:31:14.028411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014498+0000","last_change":"2024-03-07T07:31:13.017220+0000","last_active":"2024-03-07T07:31:14.014498+0000","last_peered":"2024-03-07T07:31:14.014498+0000","last_clean":"2024-03-07T07:31:14.014498+0000","last_became_active":"2024-03-07T07:31:13.016766+0000","last_became_peered":"2024-03-07T07:31:13.016766+0000","last_unstale":"2024-03-07T07:31:14.014498+0000","last_undegraded":"2024-03-07T07:31:14.014498+0000","last_fullsized":"2024-03-07T07:31:14.014498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.010263+0000","last_change":"2024-03-07T07:31:14.008305+0000","last_active":"2024-03-07T07:31:14.010263+0000","last_peered":"2024-03-07T07:31:14.010263+0000","last_clean":"2024-03-07T07:31:14.010263+0000","last_became_active":"2024-03-07T07:31:14.006803+0000","last_became_peered":"2024-03-07T07:31:14.006803+0000","last_unstale":"2024-03-07T07:31:14.010263+0000","last_undegraded":"2024-03-07T07:31:14.010263+0000","last_fullsized":"2024-03-07T07:31:14.010263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:24.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014088+0000","last_change":"2024-03-07T07:31:13.016945+0000","last_active":"2024-03-07T07:31:14.014088+0000","last_peered":"2024-03-07T07:31:14.014088+0000","last_clean":"2024-03-07T07:31:14.014088+0000","last_became_active":"2024-03-07T07:31:13.016362+0000","last_became_peered":"2024-03-07T07:31:13.016362+0000","last_unstale":"2024-03-07T07:31:14.014088+0000","last_undegraded":"2024-03-07T07:31:14.014088+0000","last_fullsized":"2024-03-07T07:31:14.014088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001103+0000","last_change":"2024-03-07T07:31:13.001103+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001103+0000","last_undegraded":"2024-03-07T07:31:13.001103+0000","last_fullsized":"2024-03-07T07:31:13.001103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013451+0000","last_change":"2024-03-07T07:31:13.011989+0000","last_active":"2024-03-07T07:31:13.013451+0000","last_peered":"2024-03-07T07:31:13.013451+0000","last_clean":"2024-03-07T07:31:13.013451+0000","last_became_active":"2024-03-07T07:31:13.011663+0000","last_became_peered":"2024-03-07T07:31:13.011663+0000","last_unstale":"2024-03-07T07:31:13.013451+0000","last_undegraded":"2024-03-07T07:31:13.013451+0000","last_fullsized":"2024-03-07T07:31:13.013451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:37.603421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.003631+0000","last_change":"2024-03-07T07:31:13.003631+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.003631+0000","last_undegraded":"2024-03-07T07:31:13.003631+0000","last_fullsized":"2024-03-07T07:31:13.003631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.002561+0000","last_change":"2024-03-07T07:31:12.997330+0000","last_active":"2024-03-07T07:31:13.002561+0000","last_peered":"2024-03-07T07:31:13.002561+0000","last_clean":"2024-03-07T07:31:13.002561+0000","last_became_active":"2024-03-07T07:31:12.997026+0000","last_became_peered":"2024-03-07T07:31:12.997026+0000","last_unstale":"2024-03-07T07:31:13.002561+0000","last_undegraded":"2024-03-07T07:31:13.002561+0000","last_fullsized":"2024-03-07T07:31:13.002561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:47:07.277106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":66809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":656665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":649820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:31:18.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-03-07T07:31:18.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.004120+0000', 'last_change': '2024-03-07T07:31:13.004120+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.004120+0000', 'last_undegraded': '2024-03-07T07:31:13.004120+0000', 'last_fullsized': '2024-03-07T07:31:13.004120+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.001187+0000', 'last_change': '2024-03-07T07:31:13.001187+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.001187+0000', 'last_undegraded': '2024-03-07T07:31:13.001187+0000', 'last_fullsized': '2024-03-07T07:31:13.001187+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.006273+0000', 'last_change': '2024-03-07T07:31:13.006273+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.006273+0000', 'last_undegraded': '2024-03-07T07:31:13.006273+0000', 'last_fullsized': '2024-03-07T07:31:13.006273+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.991054+0000', 'last_change': '2024-03-07T07:31:12.991054+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.991054+0000', 'last_undegraded': '2024-03-07T07:31:12.991054+0000', 'last_fullsized': '2024-03-07T07:31:12.991054+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.993627+0000', 'last_change': '2024-03-07T07:31:12.993627+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.993627+0000', 'last_undegraded': '2024-03-07T07:31:12.993627+0000', 'last_fullsized': '2024-03-07T07:31:12.993627+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.003021+0000', 'last_change': '2024-03-07T07:31:13.003021+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.003021+0000', 'last_undegraded': '2024-03-07T07:31:13.003021+0000', 'last_fullsized': '2024-03-07T07:31:13.003021+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.992656+0000', 'last_change': '2024-03-07T07:31:12.992656+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.992656+0000', 'last_undegraded': '2024-03-07T07:31:12.992656+0000', 'last_fullsized': '2024-03-07T07:31:12.992656+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.988516+0000', 'last_change': '2024-03-07T07:31:12.988516+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.988516+0000', 'last_undegraded': '2024-03-07T07:31:12.988516+0000', 'last_fullsized': '2024-03-07T07:31:12.988516+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.994230+0000', 'last_change': '2024-03-07T07:31:12.994230+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.994230+0000', 'last_undegraded': '2024-03-07T07:31:12.994230+0000', 'last_fullsized': '2024-03-07T07:31:12.994230+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.001690+0000', 'last_change': '2024-03-07T07:31:13.001690+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.001690+0000', 'last_undegraded': '2024-03-07T07:31:13.001690+0000', 'last_fullsized': '2024-03-07T07:31:13.001690+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.991173+0000', 'last_change': '2024-03-07T07:31:12.991173+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.991173+0000', 'last_undegraded': '2024-03-07T07:31:12.991173+0000', 'last_fullsized': '2024-03-07T07:31:12.991173+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:31:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.992584+0000', 'last_change': '2024-03-07T07:31:12.992584+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.992584+0000', 'last_undegraded': '2024-03-07T07:31:12.992584+0000', 'last_fullsized': '2024-03-07T07:31:12.992584+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.998641+0000', 'last_change': '2024-03-07T07:31:12.998641+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.998641+0000', 'last_undegraded': '2024-03-07T07:31:12.998641+0000', 'last_fullsized': '2024-03-07T07:31:12.998641+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.992343+0000', 'last_change': '2024-03-07T07:31:12.992343+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.992343+0000', 'last_undegraded': '2024-03-07T07:31:12.992343+0000', 'last_fullsized': '2024-03-07T07:31:12.992343+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.986402+0000', 'last_change': '2024-03-07T07:31:12.986402+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.986402+0000', 'last_undegraded': '2024-03-07T07:31:12.986402+0000', 'last_fullsized': '2024-03-07T07:31:12.986402+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.997002+0000', 'last_change': '2024-03-07T07:31:12.997002+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.997002+0000', 'last_undegraded': '2024-03-07T07:31:12.997002+0000', 'last_fullsized': '2024-03-07T07:31:12.997002+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-03-07T07:31:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.986679+0000', 'last_change': '2024-03-07T07:31:12.986679+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.986679+0000', 'last_undegraded': '2024-03-07T07:31:12.986679+0000', 'last_fullsized': '2024-03-07T07:31:12.986679+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.000461+0000', 'last_change': '2024-03-07T07:31:13.000461+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.000461+0000', 'last_undegraded': '2024-03-07T07:31:13.000461+0000', 'last_fullsized': '2024-03-07T07:31:13.000461+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.990977+0000', 'last_change': '2024-03-07T07:31:12.990977+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.990977+0000', 'last_undegraded': '2024-03-07T07:31:12.990977+0000', 'last_fullsized': '2024-03-07T07:31:12.990977+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.986419+0000', 'last_change': '2024-03-07T07:31:12.986419+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.986419+0000', 'last_undegraded': '2024-03-07T07:31:12.986419+0000', 'last_fullsized': '2024-03-07T07:31:12.986419+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.990303+0000', 'last_change': '2024-03-07T07:31:12.990303+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.990303+0000', 'last_undegraded': '2024-03-07T07:31:12.990303+0000', 'last_fullsized': '2024-03-07T07:31:12.990303+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-03-07T07:31:18.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.005761+0000', 'last_change': '2024-03-07T07:31:13.005761+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.005761+0000', 'last_undegraded': '2024-03-07T07:31:13.005761+0000', 'last_fullsized': '2024-03-07T07:31:13.005761+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.990933+0000', 'last_change': '2024-03-07T07:31:12.990933+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.990933+0000', 'last_undegraded': '2024-03-07T07:31:12.990933+0000', 'last_fullsized': '2024-03-07T07:31:12.990933+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.986414+0000', 'last_change': '2024-03-07T07:31:12.986414+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.986414+0000', 'last_undegraded': '2024-03-07T07:31:12.986414+0000', 'last_fullsized': '2024-03-07T07:31:12.986414+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.987092+0000', 'last_change': '2024-03-07T07:31:12.987092+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.987092+0000', 'last_undegraded': '2024-03-07T07:31:12.987092+0000', 'last_fullsized': '2024-03-07T07:31:12.987092+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.987514+0000', 'last_change': '2024-03-07T07:31:12.987514+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.987514+0000', 'last_undegraded': '2024-03-07T07:31:12.987514+0000', 'last_fullsized': '2024-03-07T07:31:12.987514+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:12.991966+0000', 'last_change': '2024-03-07T07:31:12.991966+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:12.991966+0000', 'last_undegraded': '2024-03-07T07:31:12.991966+0000', 'last_fullsized': '2024-03-07T07:31:12.991966+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:31:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-03-07T07:31:18.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.001103+0000', 'last_change': '2024-03-07T07:31:13.001103+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.001103+0000', 'last_undegraded': '2024-03-07T07:31:13.001103+0000', 'last_fullsized': '2024-03-07T07:31:13.001103+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-03-07T07:31:18.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:31:13.003631+0000', 'last_change': '2024-03-07T07:31:13.003631+0000', 'last_active': '2024-03-07T07:31:12.974214+0000', 'last_peered': '2024-03-07T07:31:12.974214+0000', 'last_clean': '2024-03-07T07:31:12.974214+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:31:13.003631+0000', 'last_undegraded': '2024-03-07T07:31:13.003631+0000', 'last_fullsized': '2024-03-07T07:31:13.003631+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'last_clean_scrub_stamp': '2024-03-07T07:31:12.974214+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:31:18.824 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-07T07:31:18.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.987+0000 7fa8a4c00640 1 Processor -- start 2024-03-07T07:31:18.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.987+0000 7fa8a4c00640 1 -- start start 2024-03-07T07:31:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.987+0000 7fa8a4c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8a00cef30 0x7fa8a00a9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.987+0000 7fa8a4c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a01412e0 0x7fa8a015cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.987+0000 7fa8a4c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00d0d40 con 0x7fa8a00cf310 2024-03-07T07:31:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.987+0000 7fa8a4c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00aac40 con 0x7fa8a00cef30 2024-03-07T07:31:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.987+0000 7fa8a4c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00cf7a0 con 0x7fa8a01412e0 2024-03-07T07:31:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a01412e0 0x7fa8a015cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a01412e0 0x7fa8a015cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:58250/0 (socket says 172.21.15.84:58250) 2024-03-07T07:31:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89ea00640 1 -- 172.21.15.84:0/1862280923 learned_addr learned my addr 172.21.15.84:0/1862280923 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89fe00640 1 --1- 172.21.15.84:0/1862280923 >> v1:172.21.15.161:6789/0 conn(0x7fa8a00cf310 0x7fa8a006bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:57630/0 (socket says 172.21.15.84:57630) 2024-03-07T07:31:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89f400640 1 --2- 172.21.15.84:0/1862280923 >> v2:172.21.15.161:3300/0 conn(0x7fa8a00cef30 0x7fa8a00a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89ea00640 1 -- 172.21.15.84:0/1862280923 >> v2:172.21.15.161:3300/0 conn(0x7fa8a00cef30 msgr2=0x7fa8a00a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89ea00640 1 --2- 172.21.15.84:0/1862280923 >> v2:172.21.15.161:3300/0 conn(0x7fa8a00cef30 0x7fa8a00a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89ea00640 1 -- 172.21.15.84:0/1862280923 >> v1:172.21.15.161:6789/0 conn(0x7fa8a00cf310 legacy=0x7fa8a006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89ea00640 1 -- 172.21.15.84:0/1862280923 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0141830 con 0x7fa8a01412e0 2024-03-07T07:31:18.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89f400640 1 --2- 172.21.15.84:0/1862280923 >> v2:172.21.15.161:3300/0 conn(0x7fa8a00cef30 0x7fa8a00a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:18.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89ea00640 1 --2- 172.21.15.84:0/1862280923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a01412e0 0x7fa8a015cc20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa88c006fd0 tx=0x7fa88c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73110c28fc283d20 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:18.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89e000640 1 -- 172.21.15.84:0/1862280923 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0b1070 con 0x7fa8a01412e0 2024-03-07T07:31:18.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89e000640 1 -- 172.21.15.84:0/1862280923 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c0ac600 con 0x7fa8a01412e0 2024-03-07T07:31:18.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.991+0000 7fa89e000640 1 -- 172.21.15.84:0/1862280923 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0ac9d0 con 0x7fa8a01412e0 2024-03-07T07:31:18.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- 172.21.15.84:0/1862280923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a01412e0 msgr2=0x7fa8a015cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:18.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/1862280923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a01412e0 0x7fa8a015cc20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa88c006fd0 tx=0x7fa88c01c4b0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- 172.21.15.84:0/1862280923 shutdown_connections 2024-03-07T07:31:18.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/1862280923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a01412e0 0x7fa8a015cc20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/1862280923 >> v2:172.21.15.161:3300/0 conn(0x7fa8a00cef30 0x7fa8a00a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:18.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- 172.21.15.84:0/1862280923 >> 172.21.15.84:0/1862280923 conn(0x7fa8a006f260 msgr2=0x7fa8a006f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:18.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- 172.21.15.84:0/1862280923 shutdown_connections 2024-03-07T07:31:18.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- 172.21.15.84:0/1862280923 wait complete. 2024-03-07T07:31:18.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 Processor -- start 2024-03-07T07:31:18.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- start start 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00cef30 0x7fa8a01f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00cf310 0x7fa8a014f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a01412e0 0x7fa8a013c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00d1a50 con 0x7fa8a01412e0 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00a9a70 con 0x7fa8a00cf310 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa8a4c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00d1bd0 con 0x7fa8a00cef30 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00cef30 0x7fa8a01f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89ea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00cf310 0x7fa8a014f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a01412e0 0x7fa8a013c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89f400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00cef30 0x7fa8a01f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:58262/0 (socket says 172.21.15.84:58262) 2024-03-07T07:31:19.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89f400640 1 -- 172.21.15.84:0/2855870257 learned_addr learned my addr 172.21.15.84:0/2855870257 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:19.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89f400640 1 -- 172.21.15.84:0/2855870257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00cf310 msgr2=0x7fa8a014f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89f400640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00cf310 0x7fa8a014f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89f400640 1 -- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a01412e0 msgr2=0x7fa8a013c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89f400640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a01412e0 0x7fa8a013c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.995+0000 7fa89f400640 1 -- 172.21.15.84:0/2855870257 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0152960 con 0x7fa8a00cef30 2024-03-07T07:31:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa89f400640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00cef30 0x7fa8a01f57a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa890009ec0 tx=0x7fa89000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa897400640 1 -- 172.21.15.84:0/2855870257 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890018020 con 0x7fa8a00cef30 2024-03-07T07:31:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa897400640 1 -- 172.21.15.84:0/2855870257 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890014680 con 0x7fa8a00cef30 2024-03-07T07:31:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa897400640 1 -- 172.21.15.84:0/2855870257 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890014a50 con 0x7fa8a00cef30 2024-03-07T07:31:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a013d560 con 0x7fa8a00cef30 2024-03-07T07:31:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a01f4fa0 con 0x7fa8a00cef30 2024-03-07T07:31:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a0062d40 con 0x7fa8a00cef30 2024-03-07T07:31:19.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa897400640 1 -- 172.21.15.84:0/2855870257 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa89001b020 con 0x7fa8a00cef30 2024-03-07T07:31:19.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa897400640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa880066f60 0x7fa880069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa897400640 1 -- 172.21.15.84:0/2855870257 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa890085c20 con 0x7fa8a00cef30 2024-03-07T07:31:19.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:18.999+0000 7fa89ea00640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa880066f60 0x7fa880069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.003+0000 7fa89ea00640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa880066f60 0x7fa880069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0ae000 tx=0x7fa88c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:19.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.007+0000 7fa897400640 1 -- 172.21.15.84:0/2855870257 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa890022030 con 0x7fa8a00cef30 2024-03-07T07:31:19.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.215+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa8a00d0b20 con 0x7fa8a00cef30 2024-03-07T07:31:19.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa897400640 1 -- 172.21.15.84:0/2855870257 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1096 (secure 0 0 0) 0x7fa890010040 con 0x7fa8a00cef30 2024-03-07T07:31:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":31,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1709796659,"num_in_osds":8,"osd_in_since":1709796650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":68},{"state_name":"creating+peering","count":29}],"num_pgs":97,"num_pools":3,"num_objects":11,"data_bytes":592002,"bytes_used":224116736,"bytes_avail":772869996544,"bytes_total":773094113280,"inactive_pgs_ratio":0.29896906018257141,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4315}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-07T07:30:47.878653+0000","services":{}},"progress_events":{}} 2024-03-07T07:31:19.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa880066f60 msgr2=0x7fa880069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa880066f60 0x7fa880069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0ae000 tx=0x7fa88c0a7000 comp rx=0 tx=0).stop 2024-03-07T07:31:19.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00cef30 msgr2=0x7fa8a01f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00cef30 0x7fa8a01f57a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa890009ec0 tx=0x7fa89000c490 comp rx=0 tx=0).stop 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 shutdown_connections 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa880066f60 0x7fa880069420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a01412e0 0x7fa8a013c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00cf310 0x7fa8a014f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 --2- 172.21.15.84:0/2855870257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00cef30 0x7fa8a01f57a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 >> 172.21.15.84:0/2855870257 conn(0x7fa8a006f260 msgr2=0x7fa8a013f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 shutdown_connections 2024-03-07T07:31:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.219+0000 7fa8a4c00640 1 -- 172.21.15.84:0/2855870257 wait complete. 2024-03-07T07:31:19.240 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-07T07:31:19.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:31:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.371+0000 7f041c200640 1 Processor -- start 2024-03-07T07:31:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.371+0000 7f041c200640 1 -- start start 2024-03-07T07:31:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.371+0000 7f041c200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0414143dd0 0x7f04140cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f041c200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04140cc880 con 0x7f04140730e0 2024-03-07T07:31:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f041c200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04140ccb60 con 0x7f0414144360 2024-03-07T07:31:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f041c200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04141441b0 con 0x7f0414143dd0 2024-03-07T07:31:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f041a200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f04140730e0 0x7f041415b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35040/0 (socket says 172.21.15.84:35040) 2024-03-07T07:31:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f041a200640 1 -- 172.21.15.84:0/1453067972 learned_addr learned my addr 172.21.15.84:0/1453067972 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0419800640 1 --2- 172.21.15.84:0/1453067972 >> v2:172.21.15.161:3300/0 conn(0x7f0414143dd0 0x7f04140cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0413e00640 1 -- 172.21.15.84:0/1453067972 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243488688 0 0) 0x7f04140cc880 con 0x7f04140730e0 2024-03-07T07:31:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0413e00640 1 -- 172.21.15.84:0/1453067972 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03fc003530 con 0x7f04140730e0 2024-03-07T07:31:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0413e00640 1 -- 172.21.15.84:0/1453067972 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896521566 0 0) 0x7f04140ccb60 con 0x7f0414144360 2024-03-07T07:31:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0413e00640 1 -- 172.21.15.84:0/1453067972 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04140cc880 con 0x7f0414144360 2024-03-07T07:31:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0419800640 1 -- 172.21.15.84:0/1453067972 >> v1:172.21.15.161:6789/0 conn(0x7f0414144360 legacy=0x7f04140729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0419800640 1 -- 172.21.15.84:0/1453067972 >> v1:172.21.15.84:6789/0 conn(0x7f04140730e0 legacy=0x7f041415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0419800640 1 -- 172.21.15.84:0/1453067972 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04140cce40 con 0x7f0414143dd0 2024-03-07T07:31:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.375+0000 7f0419800640 1 --2- 172.21.15.84:0/1453067972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0414143dd0 0x7f04140cdc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04080097c0 tx=0x7f040801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=258d449a24f3dce server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f0413e00640 1 -- 172.21.15.84:0/1453067972 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080b0070 con 0x7f0414143dd0 2024-03-07T07:31:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f0413e00640 1 -- 172.21.15.84:0/1453067972 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080ab600 con 0x7f0414143dd0 2024-03-07T07:31:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f0413e00640 1 -- 172.21.15.84:0/1453067972 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080ab9d0 con 0x7f0414143dd0 2024-03-07T07:31:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- 172.21.15.84:0/1453067972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0414143dd0 msgr2=0x7f04140cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 --2- 172.21.15.84:0/1453067972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0414143dd0 0x7f04140cdc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04080097c0 tx=0x7f040801c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- 172.21.15.84:0/1453067972 shutdown_connections 2024-03-07T07:31:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 --2- 172.21.15.84:0/1453067972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0414143dd0 0x7f04140cdc00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- 172.21.15.84:0/1453067972 >> 172.21.15.84:0/1453067972 conn(0x7f04140704b0 msgr2=0x7f04140708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- 172.21.15.84:0/1453067972 shutdown_connections 2024-03-07T07:31:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- 172.21.15.84:0/1453067972 wait complete. 2024-03-07T07:31:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 Processor -- start 2024-03-07T07:31:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- start start 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04140730e0 0x7f0414140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0414143dd0 0x7f0414142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414144360 0x7f0414155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041415c0b0 con 0x7f0414144360 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041415bf30 con 0x7f04140730e0 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041c200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041406da40 con 0x7f0414143dd0 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414144360 0x7f0414155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414144360 0x7f0414155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38818/0 (socket says 172.21.15.84:38818) 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f041a200640 1 -- 172.21.15.84:0/3432302294 learned_addr learned my addr 172.21.15.84:0/3432302294 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f0418e00640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0414143dd0 0x7f0414142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.379+0000 7f0419800640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04140730e0 0x7f0414140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041a200640 1 -- 172.21.15.84:0/3432302294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0414143dd0 msgr2=0x7f0414142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041a200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0414143dd0 0x7f0414142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041a200640 1 -- 172.21.15.84:0/3432302294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04140730e0 msgr2=0x7f0414140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041a200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04140730e0 0x7f0414140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041a200640 1 -- 172.21.15.84:0/3432302294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0414142ef0 con 0x7f0414144360 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041a200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414144360 0x7f0414155020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f040c00cb70 tx=0x7f040c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f0411600640 1 -- 172.21.15.84:0/3432302294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c017070 con 0x7f0414144360 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f0411600640 1 -- 172.21.15.84:0/3432302294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c00ad60 con 0x7f0414144360 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f0411600640 1 -- 172.21.15.84:0/3432302294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c012640 con 0x7f0414144360 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04141431d0 con 0x7f0414144360 2024-03-07T07:31:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0414140920 con 0x7f0414144360 2024-03-07T07:31:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0414140b20 con 0x7f0414144360 2024-03-07T07:31:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f0411600640 1 -- 172.21.15.84:0/3432302294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f040c01a070 con 0x7f0414144360 2024-03-07T07:31:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f0411600640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f03f4066f90 0x7f03f4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f0411600640 1 -- 172.21.15.84:0/3432302294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f040c084db0 con 0x7f0414144360 2024-03-07T07:31:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.383+0000 7f0419800640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f03f4066f90 0x7f03f4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.387+0000 7f0419800640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f03f4066f90 0x7f03f4069450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04080ad000 tx=0x7f0408008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.387+0000 7f0411600640 1 -- 172.21.15.84:0/3432302294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f0414140b20 con 0x7f0414144360 2024-03-07T07:31:19.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.539+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0414062d40 con 0x7f03f4066f90 2024-03-07T07:31:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.543+0000 7f0411600640 1 -- 172.21.15.84:0/3432302294 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249498 (secure 0 0 0) 0x7f0414062d40 con 0x7f03f4066f90 2024-03-07T07:31:19.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:19.551 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:31:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f03f4066f90 msgr2=0x7f03f4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f03f4066f90 0x7f03f4069450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04080ad000 tx=0x7f0408008040 comp rx=0 tx=0).stop 2024-03-07T07:31:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414144360 msgr2=0x7f0414155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414144360 0x7f0414155020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f040c00cb70 tx=0x7f040c00a430 comp rx=0 tx=0).stop 2024-03-07T07:31:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 shutdown_connections 2024-03-07T07:31:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f03f4066f90 0x7f03f4069450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414144360 0x7f0414155020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0414143dd0 0x7f0414142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 --2- 172.21.15.84:0/3432302294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04140730e0 0x7f0414140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 >> 172.21.15.84:0/3432302294 conn(0x7f04140704b0 msgr2=0x7f04140b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 shutdown_connections 2024-03-07T07:31:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:19.547+0000 7f041c200640 1 -- 172.21.15.84:0/3432302294 wait complete. 2024-03-07T07:31:19.569 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-07T07:31:18.877903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218864,"kb_used_data":2676,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755856,"statfs":{"total":773094113280,"available":772869996544,"internally_reserved":0,"allocated":2740224,"data_stored":1685772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000985"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027771+0000","last_change":"2024-03-07T07:31:14.022667+0000","last_active":"2024-03-07T07:31:14.027771+0000","last_peered":"2024-03-07T07:31:14.027771+0000","last_clean":"2024-03-07T07:31:14.027771+0000","last_became_active":"2024-03-07T07:31:14.021747+0000","last_became_peered":"2024-03-07T07:31:14.021747+0000","last_unstale":"2024-03-07T07:31:14.027771+0000","last_undegraded":"2024-03-07T07:31:14.027771+0000","last_fullsized":"2024-03-07T07:31:14.027771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.004120+0000","last_change":"2024-03-07T07:31:13.004120+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.004120+0000","last_undegraded":"2024-03-07T07:31:13.004120+0000","last_fullsized":"2024-03-07T07:31:13.004120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001187+0000","last_change":"2024-03-07T07:31:13.001187+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001187+0000","last_undegraded":"2024-03-07T07:31:13.001187+0000","last_fullsized":"2024-03-07T07:31:13.001187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016604+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:14.016604+0000","last_peered":"2024-03-07T07:31:14.016604+0000","last_clean":"2024-03-07T07:31:14.016604+0000","last_became_active":"2024-03-07T07:31:14.014792+0000","last_became_peered":"2024-03-07T07:31:14.014792+0000","last_unstale":"2024-03-07T07:31:14.016604+0000","last_undegraded":"2024-03-07T07:31:14.016604+0000","last_fullsized":"2024-03-07T07:31:14.016604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:45.587377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026125+0000","last_change":"2024-03-07T07:31:14.020574+0000","last_active":"2024-03-07T07:31:14.026125+0000","last_peered":"2024-03-07T07:31:14.026125+0000","last_clean":"2024-03-07T07:31:14.026125+0000","last_became_active":"2024-03-07T07:31:14.020305+0000","last_became_peered":"2024-03-07T07:31:14.020305+0000","last_unstale":"2024-03-07T07:31:14.026125+0000","last_undegraded":"2024-03-07T07:31:14.026125+0000","last_fullsized":"2024-03-07T07:31:14.026125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016723+0000","last_change":"2024-03-07T07:31:14.014335+0000","last_active":"2024-03-07T07:31:14.016723+0000","last_peered":"2024-03-07T07:31:14.016723+0000","last_clean":"2024-03-07T07:31:14.016723+0000","last_became_active":"2024-03-07T07:31:14.013975+0000","last_became_peered":"2024-03-07T07:31:14.013975+0000","last_unstale":"2024-03-07T07:31:14.016723+0000","last_undegraded":"2024-03-07T07:31:14.016723+0000","last_fullsized":"2024-03-07T07:31:14.016723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:37:22.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026231+0000","last_change":"2024-03-07T07:31:14.021322+0000","last_active":"2024-03-07T07:31:14.026231+0000","last_peered":"2024-03-07T07:31:14.026231+0000","last_clean":"2024-03-07T07:31:14.026231+0000","last_became_active":"2024-03-07T07:31:14.021007+0000","last_became_peered":"2024-03-07T07:31:14.021007+0000","last_unstale":"2024-03-07T07:31:14.026231+0000","last_undegraded":"2024-03-07T07:31:14.026231+0000","last_fullsized":"2024-03-07T07:31:14.026231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.006273+0000","last_change":"2024-03-07T07:31:13.006273+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.006273+0000","last_undegraded":"2024-03-07T07:31:13.006273+0000","last_fullsized":"2024-03-07T07:31:13.006273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016995+0000","last_change":"2024-03-07T07:31:14.011155+0000","last_active":"2024-03-07T07:31:14.016995+0000","last_peered":"2024-03-07T07:31:14.016995+0000","last_clean":"2024-03-07T07:31:14.016995+0000","last_became_active":"2024-03-07T07:31:14.010799+0000","last_became_peered":"2024-03-07T07:31:14.010799+0000","last_unstale":"2024-03-07T07:31:14.016995+0000","last_undegraded":"2024-03-07T07:31:14.016995+0000","last_fullsized":"2024-03-07T07:31:14.016995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:11.668041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014425+0000","last_change":"2024-03-07T07:31:14.002815+0000","last_active":"2024-03-07T07:31:14.014425+0000","last_peered":"2024-03-07T07:31:14.014425+0000","last_clean":"2024-03-07T07:31:14.014425+0000","last_became_active":"2024-03-07T07:31:14.002600+0000","last_became_peered":"2024-03-07T07:31:14.002600+0000","last_unstale":"2024-03-07T07:31:14.014425+0000","last_undegraded":"2024-03-07T07:31:14.014425+0000","last_fullsized":"2024-03-07T07:31:14.014425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026157+0000","last_change":"2024-03-07T07:31:14.020556+0000","last_active":"2024-03-07T07:31:14.026157+0000","last_peered":"2024-03-07T07:31:14.026157+0000","last_clean":"2024-03-07T07:31:14.026157+0000","last_became_active":"2024-03-07T07:31:14.020256+0000","last_became_peered":"2024-03-07T07:31:14.020256+0000","last_unstale":"2024-03-07T07:31:14.026157+0000","last_undegraded":"2024-03-07T07:31:14.026157+0000","last_fullsized":"2024-03-07T07:31:14.026157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025902+0000","last_change":"2024-03-07T07:31:14.014180+0000","last_active":"2024-03-07T07:31:14.025902+0000","last_peered":"2024-03-07T07:31:14.025902+0000","last_clean":"2024-03-07T07:31:14.025902+0000","last_became_active":"2024-03-07T07:31:14.013845+0000","last_became_peered":"2024-03-07T07:31:14.013845+0000","last_unstale":"2024-03-07T07:31:14.025902+0000","last_undegraded":"2024-03-07T07:31:14.025902+0000","last_fullsized":"2024-03-07T07:31:14.025902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:05.763428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991054+0000","last_change":"2024-03-07T07:31:12.991054+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991054+0000","last_undegraded":"2024-03-07T07:31:12.991054+0000","last_fullsized":"2024-03-07T07:31:12.991054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.993627+0000","last_change":"2024-03-07T07:31:12.993627+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.993627+0000","last_undegraded":"2024-03-07T07:31:12.993627+0000","last_fullsized":"2024-03-07T07:31:12.993627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.003021+0000","last_change":"2024-03-07T07:31:13.003021+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.003021+0000","last_undegraded":"2024-03-07T07:31:13.003021+0000","last_fullsized":"2024-03-07T07:31:13.003021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.019786+0000","last_change":"2024-03-07T07:31:14.004296+0000","last_active":"2024-03-07T07:31:14.019786+0000","last_peered":"2024-03-07T07:31:14.019786+0000","last_clean":"2024-03-07T07:31:14.019786+0000","last_became_active":"2024-03-07T07:31:14.003978+0000","last_became_peered":"2024-03-07T07:31:14.003978+0000","last_unstale":"2024-03-07T07:31:14.019786+0000","last_undegraded":"2024-03-07T07:31:14.019786+0000","last_fullsized":"2024-03-07T07:31:14.019786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.029918+0000","last_change":"2024-03-07T07:31:14.026782+0000","last_active":"2024-03-07T07:31:14.029918+0000","last_peered":"2024-03-07T07:31:14.029918+0000","last_clean":"2024-03-07T07:31:14.029918+0000","last_became_active":"2024-03-07T07:31:14.026435+0000","last_became_peered":"2024-03-07T07:31:14.026435+0000","last_unstale":"2024-03-07T07:31:14.029918+0000","last_undegraded":"2024-03-07T07:31:14.029918+0000","last_fullsized":"2024-03-07T07:31:14.029918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992656+0000","last_change":"2024-03-07T07:31:12.992656+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992656+0000","last_undegraded":"2024-03-07T07:31:12.992656+0000","last_fullsized":"2024-03-07T07:31:12.992656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028130+0000","last_change":"2024-03-07T07:31:14.018840+0000","last_active":"2024-03-07T07:31:14.028130+0000","last_peered":"2024-03-07T07:31:14.028130+0000","last_clean":"2024-03-07T07:31:14.028130+0000","last_became_active":"2024-03-07T07:31:14.015465+0000","last_became_peered":"2024-03-07T07:31:14.015465+0000","last_unstale":"2024-03-07T07:31:14.028130+0000","last_undegraded":"2024-03-07T07:31:14.028130+0000","last_fullsized":"2024-03-07T07:31:14.028130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.016418+0000","last_change":"2024-03-07T07:31:14.003946+0000","last_active":"2024-03-07T07:31:14.016418+0000","last_peered":"2024-03-07T07:31:14.016418+0000","last_clean":"2024-03-07T07:31:14.016418+0000","last_became_active":"2024-03-07T07:31:14.003724+0000","last_became_peered":"2024-03-07T07:31:14.003724+0000","last_unstale":"2024-03-07T07:31:14.016418+0000","last_undegraded":"2024-03-07T07:31:14.016418+0000","last_fullsized":"2024-03-07T07:31:14.016418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:31.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.988516+0000","last_change":"2024-03-07T07:31:12.988516+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.988516+0000","last_undegraded":"2024-03-07T07:31:12.988516+0000","last_fullsized":"2024-03-07T07:31:12.988516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.023700+0000","last_change":"2024-03-07T07:31:14.019962+0000","last_active":"2024-03-07T07:31:14.023700+0000","last_peered":"2024-03-07T07:31:14.023700+0000","last_clean":"2024-03-07T07:31:14.023700+0000","last_became_active":"2024-03-07T07:31:14.019664+0000","last_became_peered":"2024-03-07T07:31:14.019664+0000","last_unstale":"2024-03-07T07:31:14.023700+0000","last_undegraded":"2024-03-07T07:31:14.023700+0000","last_fullsized":"2024-03-07T07:31:14.023700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:56.429772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.994230+0000","last_change":"2024-03-07T07:31:12.994230+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.994230+0000","last_undegraded":"2024-03-07T07:31:12.994230+0000","last_fullsized":"2024-03-07T07:31:12.994230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027861+0000","last_change":"2024-03-07T07:31:14.019616+0000","last_active":"2024-03-07T07:31:14.027861+0000","last_peered":"2024-03-07T07:31:14.027861+0000","last_clean":"2024-03-07T07:31:14.027861+0000","last_became_active":"2024-03-07T07:31:14.019246+0000","last_became_peered":"2024-03-07T07:31:14.019246+0000","last_unstale":"2024-03-07T07:31:14.027861+0000","last_undegraded":"2024-03-07T07:31:14.027861+0000","last_fullsized":"2024-03-07T07:31:14.027861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001690+0000","last_change":"2024-03-07T07:31:13.001690+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001690+0000","last_undegraded":"2024-03-07T07:31:13.001690+0000","last_fullsized":"2024-03-07T07:31:13.001690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.018316+0000","last_change":"2024-03-07T07:31:14.017123+0000","last_active":"2024-03-07T07:31:14.018316+0000","last_peered":"2024-03-07T07:31:14.018316+0000","last_clean":"2024-03-07T07:31:14.018316+0000","last_became_active":"2024-03-07T07:31:14.016071+0000","last_became_peered":"2024-03-07T07:31:14.016071+0000","last_unstale":"2024-03-07T07:31:14.018316+0000","last_undegraded":"2024-03-07T07:31:14.018316+0000","last_fullsized":"2024-03-07T07:31:14.018316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:46.926372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991173+0000","last_change":"2024-03-07T07:31:12.991173+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991173+0000","last_undegraded":"2024-03-07T07:31:12.991173+0000","last_fullsized":"2024-03-07T07:31:12.991173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992584+0000","last_change":"2024-03-07T07:31:12.992584+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992584+0000","last_undegraded":"2024-03-07T07:31:12.992584+0000","last_fullsized":"2024-03-07T07:31:12.992584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.998641+0000","last_change":"2024-03-07T07:31:12.998641+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.998641+0000","last_undegraded":"2024-03-07T07:31:12.998641+0000","last_fullsized":"2024-03-07T07:31:12.998641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025797+0000","last_change":"2024-03-07T07:31:14.018277+0000","last_active":"2024-03-07T07:31:14.025797+0000","last_peered":"2024-03-07T07:31:14.025797+0000","last_clean":"2024-03-07T07:31:14.025797+0000","last_became_active":"2024-03-07T07:31:14.017969+0000","last_became_peered":"2024-03-07T07:31:14.017969+0000","last_unstale":"2024-03-07T07:31:14.025797+0000","last_undegraded":"2024-03-07T07:31:14.025797+0000","last_fullsized":"2024-03-07T07:31:14.025797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.992343+0000","last_change":"2024-03-07T07:31:12.992343+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.992343+0000","last_undegraded":"2024-03-07T07:31:12.992343+0000","last_fullsized":"2024-03-07T07:31:12.992343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.030095+0000","last_change":"2024-03-07T07:31:14.025073+0000","last_active":"2024-03-07T07:31:14.030095+0000","last_peered":"2024-03-07T07:31:14.030095+0000","last_clean":"2024-03-07T07:31:14.030095+0000","last_became_active":"2024-03-07T07:31:14.024374+0000","last_became_peered":"2024-03-07T07:31:14.024374+0000","last_unstale":"2024-03-07T07:31:14.030095+0000","last_undegraded":"2024-03-07T07:31:14.030095+0000","last_fullsized":"2024-03-07T07:31:14.030095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:11.668041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.011254+0000","last_change":"2024-03-07T07:31:14.009391+0000","last_active":"2024-03-07T07:31:14.011254+0000","last_peered":"2024-03-07T07:31:14.011254+0000","last_clean":"2024-03-07T07:31:14.011254+0000","last_became_active":"2024-03-07T07:31:14.009148+0000","last_became_peered":"2024-03-07T07:31:14.009148+0000","last_unstale":"2024-03-07T07:31:14.011254+0000","last_undegraded":"2024-03-07T07:31:14.011254+0000","last_fullsized":"2024-03-07T07:31:14.011254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:46.926372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.012693+0000","last_change":"2024-03-07T07:31:13.010423+0000","last_active":"2024-03-07T07:31:13.012693+0000","last_peered":"2024-03-07T07:31:13.012693+0000","last_clean":"2024-03-07T07:31:13.012693+0000","last_became_active":"2024-03-07T07:31:13.010096+0000","last_became_peered":"2024-03-07T07:31:13.010096+0000","last_unstale":"2024-03-07T07:31:13.012693+0000","last_undegraded":"2024-03-07T07:31:13.012693+0000","last_fullsized":"2024-03-07T07:31:13.012693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:24.512582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986402+0000","last_change":"2024-03-07T07:31:12.986402+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986402+0000","last_undegraded":"2024-03-07T07:31:12.986402+0000","last_fullsized":"2024-03-07T07:31:12.986402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.027850+0000","last_change":"2024-03-07T07:31:13.006659+0000","last_active":"2024-03-07T07:31:14.027850+0000","last_peered":"2024-03-07T07:31:14.027850+0000","last_clean":"2024-03-07T07:31:14.027850+0000","last_became_active":"2024-03-07T07:31:13.005927+0000","last_became_peered":"2024-03-07T07:31:13.005927+0000","last_unstale":"2024-03-07T07:31:14.027850+0000","last_undegraded":"2024-03-07T07:31:14.027850+0000","last_fullsized":"2024-03-07T07:31:14.027850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010196+0000","last_change":"2024-03-07T07:31:13.003135+0000","last_active":"2024-03-07T07:31:13.010196+0000","last_peered":"2024-03-07T07:31:13.010196+0000","last_clean":"2024-03-07T07:31:13.010196+0000","last_became_active":"2024-03-07T07:31:13.002843+0000","last_became_peered":"2024-03-07T07:31:13.002843+0000","last_unstale":"2024-03-07T07:31:13.010196+0000","last_undegraded":"2024-03-07T07:31:13.010196+0000","last_fullsized":"2024-03-07T07:31:13.010196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:36:06.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.997002+0000","last_change":"2024-03-07T07:31:12.997002+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.997002+0000","last_undegraded":"2024-03-07T07:31:12.997002+0000","last_fullsized":"2024-03-07T07:31:12.997002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.997483+0000","last_change":"2024-03-07T07:31:13.006518+0000","last_active":"2024-03-07T07:31:13.997483+0000","last_peered":"2024-03-07T07:31:13.997483+0000","last_clean":"2024-03-07T07:31:13.997483+0000","last_became_active":"2024-03-07T07:31:13.005662+0000","last_became_peered":"2024-03-07T07:31:13.005662+0000","last_unstale":"2024-03-07T07:31:13.997483+0000","last_undegraded":"2024-03-07T07:31:13.997483+0000","last_fullsized":"2024-03-07T07:31:13.997483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986679+0000","last_change":"2024-03-07T07:31:12.986679+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986679+0000","last_undegraded":"2024-03-07T07:31:12.986679+0000","last_fullsized":"2024-03-07T07:31:12.986679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.997623+0000","last_change":"2024-03-07T07:31:13.014357+0000","last_active":"2024-03-07T07:31:13.997623+0000","last_peered":"2024-03-07T07:31:13.997623+0000","last_clean":"2024-03-07T07:31:13.997623+0000","last_became_active":"2024-03-07T07:31:13.014065+0000","last_became_peered":"2024-03-07T07:31:13.014065+0000","last_unstale":"2024-03-07T07:31:13.997623+0000","last_undegraded":"2024-03-07T07:31:13.997623+0000","last_fullsized":"2024-03-07T07:31:13.997623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.018298+0000","last_change":"2024-03-07T07:31:14.016928+0000","last_active":"2024-03-07T07:31:14.018298+0000","last_peered":"2024-03-07T07:31:14.018298+0000","last_clean":"2024-03-07T07:31:14.018298+0000","last_became_active":"2024-03-07T07:31:14.016029+0000","last_became_peered":"2024-03-07T07:31:14.016029+0000","last_unstale":"2024-03-07T07:31:14.018298+0000","last_undegraded":"2024-03-07T07:31:14.018298+0000","last_fullsized":"2024-03-07T07:31:14.018298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:24.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.987853+0000","last_change":"2024-03-07T07:31:13.017045+0000","last_active":"2024-03-07T07:31:13.987853+0000","last_peered":"2024-03-07T07:31:13.987853+0000","last_clean":"2024-03-07T07:31:13.987853+0000","last_became_active":"2024-03-07T07:31:13.016712+0000","last_became_peered":"2024-03-07T07:31:13.016712+0000","last_unstale":"2024-03-07T07:31:13.987853+0000","last_undegraded":"2024-03-07T07:31:13.987853+0000","last_fullsized":"2024-03-07T07:31:13.987853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.000461+0000","last_change":"2024-03-07T07:31:13.000461+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.000461+0000","last_undegraded":"2024-03-07T07:31:13.000461+0000","last_fullsized":"2024-03-07T07:31:13.000461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010890+0000","last_change":"2024-03-07T07:31:13.004264+0000","last_active":"2024-03-07T07:31:13.010890+0000","last_peered":"2024-03-07T07:31:13.010890+0000","last_clean":"2024-03-07T07:31:13.010890+0000","last_became_active":"2024-03-07T07:31:13.003883+0000","last_became_peered":"2024-03-07T07:31:13.003883+0000","last_unstale":"2024-03-07T07:31:13.010890+0000","last_undegraded":"2024-03-07T07:31:13.010890+0000","last_fullsized":"2024-03-07T07:31:13.010890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:37.603421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025523+0000","last_change":"2024-03-07T07:31:14.007051+0000","last_active":"2024-03-07T07:31:14.025523+0000","last_peered":"2024-03-07T07:31:14.025523+0000","last_clean":"2024-03-07T07:31:14.025523+0000","last_became_active":"2024-03-07T07:31:14.005904+0000","last_became_peered":"2024-03-07T07:31:14.005904+0000","last_unstale":"2024-03-07T07:31:14.025523+0000","last_undegraded":"2024-03-07T07:31:14.025523+0000","last_fullsized":"2024-03-07T07:31:14.025523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.031099+0000","last_change":"2024-03-07T07:31:12.997602+0000","last_active":"2024-03-07T07:31:14.031099+0000","last_peered":"2024-03-07T07:31:14.031099+0000","last_clean":"2024-03-07T07:31:14.031099+0000","last_became_active":"2024-03-07T07:31:12.997204+0000","last_became_peered":"2024-03-07T07:31:12.997204+0000","last_unstale":"2024-03-07T07:31:14.031099+0000","last_undegraded":"2024-03-07T07:31:14.031099+0000","last_fullsized":"2024-03-07T07:31:14.031099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.032451+0000","last_change":"2024-03-07T07:31:14.028791+0000","last_active":"2024-03-07T07:31:14.032451+0000","last_peered":"2024-03-07T07:31:14.032451+0000","last_clean":"2024-03-07T07:31:14.032451+0000","last_became_active":"2024-03-07T07:31:14.028591+0000","last_became_peered":"2024-03-07T07:31:14.028591+0000","last_unstale":"2024-03-07T07:31:14.032451+0000","last_undegraded":"2024-03-07T07:31:14.032451+0000","last_fullsized":"2024-03-07T07:31:14.032451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.015380+0000","last_change":"2024-03-07T07:31:13.011937+0000","last_active":"2024-03-07T07:31:13.015380+0000","last_peered":"2024-03-07T07:31:13.015380+0000","last_clean":"2024-03-07T07:31:13.015380+0000","last_became_active":"2024-03-07T07:31:13.011577+0000","last_became_peered":"2024-03-07T07:31:13.011577+0000","last_unstale":"2024-03-07T07:31:13.015380+0000","last_undegraded":"2024-03-07T07:31:13.015380+0000","last_fullsized":"2024-03-07T07:31:13.015380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990977+0000","last_change":"2024-03-07T07:31:12.990977+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990977+0000","last_undegraded":"2024-03-07T07:31:12.990977+0000","last_fullsized":"2024-03-07T07:31:12.990977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004304+0000","last_change":"2024-03-07T07:31:13.000961+0000","last_active":"2024-03-07T07:31:14.004304+0000","last_peered":"2024-03-07T07:31:14.004304+0000","last_clean":"2024-03-07T07:31:14.004304+0000","last_became_active":"2024-03-07T07:31:13.000129+0000","last_became_peered":"2024-03-07T07:31:13.000129+0000","last_unstale":"2024-03-07T07:31:14.004304+0000","last_undegraded":"2024-03-07T07:31:14.004304+0000","last_fullsized":"2024-03-07T07:31:14.004304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:58.045352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028425+0000","last_change":"2024-03-07T07:31:14.022537+0000","last_active":"2024-03-07T07:31:14.028425+0000","last_peered":"2024-03-07T07:31:14.028425+0000","last_clean":"2024-03-07T07:31:14.028425+0000","last_became_active":"2024-03-07T07:31:14.022221+0000","last_became_peered":"2024-03-07T07:31:14.022221+0000","last_unstale":"2024-03-07T07:31:14.028425+0000","last_undegraded":"2024-03-07T07:31:14.028425+0000","last_fullsized":"2024-03-07T07:31:14.028425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.986705+0000","last_change":"2024-03-07T07:31:13.009533+0000","last_active":"2024-03-07T07:31:13.986705+0000","last_peered":"2024-03-07T07:31:13.986705+0000","last_clean":"2024-03-07T07:31:13.986705+0000","last_became_active":"2024-03-07T07:31:13.009224+0000","last_became_peered":"2024-03-07T07:31:13.009224+0000","last_unstale":"2024-03-07T07:31:13.986705+0000","last_undegraded":"2024-03-07T07:31:13.986705+0000","last_fullsized":"2024-03-07T07:31:13.986705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:40.675440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.019222+0000","last_change":"2024-03-07T07:31:14.015133+0000","last_active":"2024-03-07T07:31:14.019222+0000","last_peered":"2024-03-07T07:31:14.019222+0000","last_clean":"2024-03-07T07:31:14.019222+0000","last_became_active":"2024-03-07T07:31:14.014859+0000","last_became_peered":"2024-03-07T07:31:14.014859+0000","last_unstale":"2024-03-07T07:31:14.019222+0000","last_undegraded":"2024-03-07T07:31:14.019222+0000","last_fullsized":"2024-03-07T07:31:14.019222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:41.682431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011044+0000","last_change":"2024-03-07T07:31:13.000976+0000","last_active":"2024-03-07T07:31:13.011044+0000","last_peered":"2024-03-07T07:31:13.011044+0000","last_clean":"2024-03-07T07:31:13.011044+0000","last_became_active":"2024-03-07T07:31:13.000624+0000","last_became_peered":"2024-03-07T07:31:13.000624+0000","last_unstale":"2024-03-07T07:31:13.011044+0000","last_undegraded":"2024-03-07T07:31:13.011044+0000","last_fullsized":"2024-03-07T07:31:13.011044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:36:06.859855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025488+0000","last_change":"2024-03-07T07:31:14.008321+0000","last_active":"2024-03-07T07:31:14.025488+0000","last_peered":"2024-03-07T07:31:14.025488+0000","last_clean":"2024-03-07T07:31:14.025488+0000","last_became_active":"2024-03-07T07:31:14.008039+0000","last_became_peered":"2024-03-07T07:31:14.008039+0000","last_unstale":"2024-03-07T07:31:14.025488+0000","last_undegraded":"2024-03-07T07:31:14.025488+0000","last_fullsized":"2024-03-07T07:31:14.025488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.023370+0000","last_change":"2024-03-07T07:31:13.008580+0000","last_active":"2024-03-07T07:31:14.023370+0000","last_peered":"2024-03-07T07:31:14.023370+0000","last_clean":"2024-03-07T07:31:14.023370+0000","last_became_active":"2024-03-07T07:31:13.008276+0000","last_became_peered":"2024-03-07T07:31:13.008276+0000","last_unstale":"2024-03-07T07:31:14.023370+0000","last_undegraded":"2024-03-07T07:31:14.023370+0000","last_fullsized":"2024-03-07T07:31:14.023370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.008377+0000","last_change":"2024-03-07T07:31:14.003764+0000","last_active":"2024-03-07T07:31:14.008377+0000","last_peered":"2024-03-07T07:31:14.008377+0000","last_clean":"2024-03-07T07:31:14.008377+0000","last_became_active":"2024-03-07T07:31:14.002976+0000","last_became_peered":"2024-03-07T07:31:14.002976+0000","last_unstale":"2024-03-07T07:31:14.008377+0000","last_undegraded":"2024-03-07T07:31:14.008377+0000","last_fullsized":"2024-03-07T07:31:14.008377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:51.219777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013778+0000","last_change":"2024-03-07T07:31:13.010016+0000","last_active":"2024-03-07T07:31:13.013778+0000","last_peered":"2024-03-07T07:31:13.013778+0000","last_clean":"2024-03-07T07:31:13.013778+0000","last_became_active":"2024-03-07T07:31:13.009751+0000","last_became_peered":"2024-03-07T07:31:13.009751+0000","last_unstale":"2024-03-07T07:31:13.013778+0000","last_undegraded":"2024-03-07T07:31:13.013778+0000","last_fullsized":"2024-03-07T07:31:13.013778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:45:09.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025474+0000","last_change":"2024-03-07T07:31:14.013078+0000","last_active":"2024-03-07T07:31:14.025474+0000","last_peered":"2024-03-07T07:31:14.025474+0000","last_clean":"2024-03-07T07:31:14.025474+0000","last_became_active":"2024-03-07T07:31:14.012816+0000","last_became_peered":"2024-03-07T07:31:14.012816+0000","last_unstale":"2024-03-07T07:31:14.025474+0000","last_undegraded":"2024-03-07T07:31:14.025474+0000","last_fullsized":"2024-03-07T07:31:14.025474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:18.111128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.020779+0000","last_change":"2024-03-07T07:31:13.016042+0000","last_active":"2024-03-07T07:31:13.020779+0000","last_peered":"2024-03-07T07:31:13.020779+0000","last_clean":"2024-03-07T07:31:13.020779+0000","last_became_active":"2024-03-07T07:31:13.015749+0000","last_became_peered":"2024-03-07T07:31:13.015749+0000","last_unstale":"2024-03-07T07:31:13.020779+0000","last_undegraded":"2024-03-07T07:31:13.020779+0000","last_fullsized":"2024-03-07T07:31:13.020779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025934+0000","last_change":"2024-03-07T07:31:14.015090+0000","last_active":"2024-03-07T07:31:14.025934+0000","last_peered":"2024-03-07T07:31:14.025934+0000","last_clean":"2024-03-07T07:31:14.025934+0000","last_became_active":"2024-03-07T07:31:14.014806+0000","last_became_peered":"2024-03-07T07:31:14.014806+0000","last_unstale":"2024-03-07T07:31:14.025934+0000","last_undegraded":"2024-03-07T07:31:14.025934+0000","last_fullsized":"2024-03-07T07:31:14.025934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:37.677717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.010244+0000","last_change":"2024-03-07T07:31:13.002882+0000","last_active":"2024-03-07T07:31:13.010244+0000","last_peered":"2024-03-07T07:31:13.010244+0000","last_clean":"2024-03-07T07:31:13.010244+0000","last_became_active":"2024-03-07T07:31:13.002570+0000","last_became_peered":"2024-03-07T07:31:13.002570+0000","last_unstale":"2024-03-07T07:31:13.010244+0000","last_undegraded":"2024-03-07T07:31:13.010244+0000","last_fullsized":"2024-03-07T07:31:13.010244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:47:07.277106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025420+0000","last_change":"2024-03-07T07:31:14.008276+0000","last_active":"2024-03-07T07:31:14.025420+0000","last_peered":"2024-03-07T07:31:14.025420+0000","last_clean":"2024-03-07T07:31:14.025420+0000","last_became_active":"2024-03-07T07:31:14.007776+0000","last_became_peered":"2024-03-07T07:31:14.007776+0000","last_unstale":"2024-03-07T07:31:14.025420+0000","last_undegraded":"2024-03-07T07:31:14.025420+0000","last_fullsized":"2024-03-07T07:31:14.025420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.995173+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:31:13.995173+0000","last_peered":"2024-03-07T07:31:13.995173+0000","last_clean":"2024-03-07T07:31:13.995173+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:31:13.995173+0000","last_undegraded":"2024-03-07T07:31:13.995173+0000","last_fullsized":"2024-03-07T07:31:13.995173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004578+0000","last_change":"2024-03-07T07:31:13.008377+0000","last_active":"2024-03-07T07:31:14.004578+0000","last_peered":"2024-03-07T07:31:14.004578+0000","last_clean":"2024-03-07T07:31:14.004578+0000","last_became_active":"2024-03-07T07:31:13.007831+0000","last_became_peered":"2024-03-07T07:31:13.007831+0000","last_unstale":"2024-03-07T07:31:14.004578+0000","last_undegraded":"2024-03-07T07:31:14.004578+0000","last_fullsized":"2024-03-07T07:31:14.004578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:04.756437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986419+0000","last_change":"2024-03-07T07:31:12.986419+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986419+0000","last_undegraded":"2024-03-07T07:31:12.986419+0000","last_fullsized":"2024-03-07T07:31:12.986419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.003599+0000","last_change":"2024-03-07T07:31:13.008418+0000","last_active":"2024-03-07T07:31:14.003599+0000","last_peered":"2024-03-07T07:31:14.003599+0000","last_clean":"2024-03-07T07:31:14.003599+0000","last_became_active":"2024-03-07T07:31:13.008022+0000","last_became_peered":"2024-03-07T07:31:13.008022+0000","last_unstale":"2024-03-07T07:31:14.003599+0000","last_undegraded":"2024-03-07T07:31:14.003599+0000","last_fullsized":"2024-03-07T07:31:14.003599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990303+0000","last_change":"2024-03-07T07:31:12.990303+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990303+0000","last_undegraded":"2024-03-07T07:31:12.990303+0000","last_fullsized":"2024-03-07T07:31:12.990303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.020519+0000","last_change":"2024-03-07T07:31:13.012807+0000","last_active":"2024-03-07T07:31:13.020519+0000","last_peered":"2024-03-07T07:31:13.020519+0000","last_clean":"2024-03-07T07:31:13.020519+0000","last_became_active":"2024-03-07T07:31:13.011968+0000","last_became_peered":"2024-03-07T07:31:13.011968+0000","last_unstale":"2024-03-07T07:31:13.020519+0000","last_undegraded":"2024-03-07T07:31:13.020519+0000","last_fullsized":"2024-03-07T07:31:13.020519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:50.212787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.005761+0000","last_change":"2024-03-07T07:31:13.005761+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.005761+0000","last_undegraded":"2024-03-07T07:31:13.005761+0000","last_fullsized":"2024-03-07T07:31:13.005761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004381+0000","last_change":"2024-03-07T07:31:13.004811+0000","last_active":"2024-03-07T07:31:14.004381+0000","last_peered":"2024-03-07T07:31:14.004381+0000","last_clean":"2024-03-07T07:31:14.004381+0000","last_became_active":"2024-03-07T07:31:13.001378+0000","last_became_peered":"2024-03-07T07:31:13.001378+0000","last_unstale":"2024-03-07T07:31:14.004381+0000","last_undegraded":"2024-03-07T07:31:14.004381+0000","last_fullsized":"2024-03-07T07:31:14.004381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:30.900538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.020685+0000","last_change":"2024-03-07T07:31:14.001567+0000","last_active":"2024-03-07T07:31:14.020685+0000","last_peered":"2024-03-07T07:31:14.020685+0000","last_clean":"2024-03-07T07:31:14.020685+0000","last_became_active":"2024-03-07T07:31:14.001209+0000","last_became_peered":"2024-03-07T07:31:14.001209+0000","last_unstale":"2024-03-07T07:31:14.020685+0000","last_undegraded":"2024-03-07T07:31:14.020685+0000","last_fullsized":"2024-03-07T07:31:14.020685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011322+0000","last_change":"2024-03-07T07:31:13.009741+0000","last_active":"2024-03-07T07:31:13.011322+0000","last_peered":"2024-03-07T07:31:13.011322+0000","last_clean":"2024-03-07T07:31:13.011322+0000","last_became_active":"2024-03-07T07:31:13.009377+0000","last_became_peered":"2024-03-07T07:31:13.009377+0000","last_unstale":"2024-03-07T07:31:13.011322+0000","last_undegraded":"2024-03-07T07:31:13.011322+0000","last_fullsized":"2024-03-07T07:31:13.011322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:46:14.381163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.032452+0000","last_change":"2024-03-07T07:31:14.029593+0000","last_active":"2024-03-07T07:31:14.032452+0000","last_peered":"2024-03-07T07:31:14.032452+0000","last_clean":"2024-03-07T07:31:14.032452+0000","last_became_active":"2024-03-07T07:31:14.029271+0000","last_became_peered":"2024-03-07T07:31:14.029271+0000","last_unstale":"2024-03-07T07:31:14.032452+0000","last_undegraded":"2024-03-07T07:31:14.032452+0000","last_fullsized":"2024-03-07T07:31:14.032452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:41.682431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.004972+0000","last_change":"2024-03-07T07:31:12.999335+0000","last_active":"2024-03-07T07:31:14.004972+0000","last_peered":"2024-03-07T07:31:14.004972+0000","last_clean":"2024-03-07T07:31:14.004972+0000","last_became_active":"2024-03-07T07:31:12.998960+0000","last_became_peered":"2024-03-07T07:31:12.998960+0000","last_unstale":"2024-03-07T07:31:14.004972+0000","last_undegraded":"2024-03-07T07:31:14.004972+0000","last_fullsized":"2024-03-07T07:31:14.004972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:36.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.990933+0000","last_change":"2024-03-07T07:31:12.990933+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.990933+0000","last_undegraded":"2024-03-07T07:31:12.990933+0000","last_fullsized":"2024-03-07T07:31:12.990933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013696+0000","last_change":"2024-03-07T07:31:13.004776+0000","last_active":"2024-03-07T07:31:13.013696+0000","last_peered":"2024-03-07T07:31:13.013696+0000","last_clean":"2024-03-07T07:31:13.013696+0000","last_became_active":"2024-03-07T07:31:13.004179+0000","last_became_peered":"2024-03-07T07:31:13.004179+0000","last_unstale":"2024-03-07T07:31:13.013696+0000","last_undegraded":"2024-03-07T07:31:13.013696+0000","last_fullsized":"2024-03-07T07:31:13.013696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:45.950345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.986414+0000","last_change":"2024-03-07T07:31:12.986414+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.986414+0000","last_undegraded":"2024-03-07T07:31:12.986414+0000","last_fullsized":"2024-03-07T07:31:12.986414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.026653+0000","last_change":"2024-03-07T07:31:13.014574+0000","last_active":"2024-03-07T07:31:14.026653+0000","last_peered":"2024-03-07T07:31:14.026653+0000","last_clean":"2024-03-07T07:31:14.026653+0000","last_became_active":"2024-03-07T07:31:13.014264+0000","last_became_peered":"2024-03-07T07:31:13.014264+0000","last_unstale":"2024-03-07T07:31:14.026653+0000","last_undegraded":"2024-03-07T07:31:14.026653+0000","last_fullsized":"2024-03-07T07:31:14.026653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.987092+0000","last_change":"2024-03-07T07:31:12.987092+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.987092+0000","last_undegraded":"2024-03-07T07:31:12.987092+0000","last_fullsized":"2024-03-07T07:31:12.987092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.986217+0000","last_change":"2024-03-07T07:31:13.010611+0000","last_active":"2024-03-07T07:31:13.986217+0000","last_peered":"2024-03-07T07:31:13.986217+0000","last_clean":"2024-03-07T07:31:13.986217+0000","last_became_active":"2024-03-07T07:31:13.005305+0000","last_became_peered":"2024-03-07T07:31:13.005305+0000","last_unstale":"2024-03-07T07:31:13.986217+0000","last_undegraded":"2024-03-07T07:31:13.986217+0000","last_fullsized":"2024-03-07T07:31:13.986217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:10.661050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028674+0000","last_change":"2024-03-07T07:31:14.021524+0000","last_active":"2024-03-07T07:31:14.028674+0000","last_peered":"2024-03-07T07:31:14.028674+0000","last_clean":"2024-03-07T07:31:14.028674+0000","last_became_active":"2024-03-07T07:31:14.021248+0000","last_became_peered":"2024-03-07T07:31:14.021248+0000","last_unstale":"2024-03-07T07:31:14.028674+0000","last_undegraded":"2024-03-07T07:31:14.028674+0000","last_fullsized":"2024-03-07T07:31:14.028674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013629+0000","last_change":"2024-03-07T07:31:13.002330+0000","last_active":"2024-03-07T07:31:13.013629+0000","last_peered":"2024-03-07T07:31:13.013629+0000","last_clean":"2024-03-07T07:31:13.013629+0000","last_became_active":"2024-03-07T07:31:13.002030+0000","last_became_peered":"2024-03-07T07:31:13.002030+0000","last_unstale":"2024-03-07T07:31:13.013629+0000","last_undegraded":"2024-03-07T07:31:13.013629+0000","last_fullsized":"2024-03-07T07:31:13.013629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:08:44.860696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.987514+0000","last_change":"2024-03-07T07:31:12.987514+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.987514+0000","last_undegraded":"2024-03-07T07:31:12.987514+0000","last_fullsized":"2024-03-07T07:31:12.987514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.011105+0000","last_change":"2024-03-07T07:31:13.008737+0000","last_active":"2024-03-07T07:31:13.011105+0000","last_peered":"2024-03-07T07:31:13.011105+0000","last_clean":"2024-03-07T07:31:13.011105+0000","last_became_active":"2024-03-07T07:31:13.008485+0000","last_became_peered":"2024-03-07T07:31:13.008485+0000","last_unstale":"2024-03-07T07:31:13.011105+0000","last_undegraded":"2024-03-07T07:31:13.011105+0000","last_fullsized":"2024-03-07T07:31:13.011105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:08:44.860696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:12.991966+0000","last_change":"2024-03-07T07:31:12.991966+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:12.991966+0000","last_undegraded":"2024-03-07T07:31:12.991966+0000","last_fullsized":"2024-03-07T07:31:12.991966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025664+0000","last_change":"2024-03-07T07:31:13.008117+0000","last_active":"2024-03-07T07:31:14.025664+0000","last_peered":"2024-03-07T07:31:14.025664+0000","last_clean":"2024-03-07T07:31:14.025664+0000","last_became_active":"2024-03-07T07:31:13.006517+0000","last_became_peered":"2024-03-07T07:31:13.006517+0000","last_unstale":"2024-03-07T07:31:14.025664+0000","last_undegraded":"2024-03-07T07:31:14.025664+0000","last_fullsized":"2024-03-07T07:31:14.025664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:17.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.025684+0000","last_change":"2024-03-07T07:31:14.011780+0000","last_active":"2024-03-07T07:31:14.025684+0000","last_peered":"2024-03-07T07:31:14.025684+0000","last_clean":"2024-03-07T07:31:14.025684+0000","last_became_active":"2024-03-07T07:31:14.011509+0000","last_became_peered":"2024-03-07T07:31:14.011509+0000","last_unstale":"2024-03-07T07:31:14.025684+0000","last_undegraded":"2024-03-07T07:31:14.025684+0000","last_fullsized":"2024-03-07T07:31:14.025684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.028411+0000","last_change":"2024-03-07T07:31:14.024307+0000","last_active":"2024-03-07T07:31:14.028411+0000","last_peered":"2024-03-07T07:31:14.028411+0000","last_clean":"2024-03-07T07:31:14.028411+0000","last_became_active":"2024-03-07T07:31:14.024003+0000","last_became_peered":"2024-03-07T07:31:14.024003+0000","last_unstale":"2024-03-07T07:31:14.028411+0000","last_undegraded":"2024-03-07T07:31:14.028411+0000","last_fullsized":"2024-03-07T07:31:14.028411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014498+0000","last_change":"2024-03-07T07:31:13.017220+0000","last_active":"2024-03-07T07:31:14.014498+0000","last_peered":"2024-03-07T07:31:14.014498+0000","last_clean":"2024-03-07T07:31:14.014498+0000","last_became_active":"2024-03-07T07:31:13.016766+0000","last_became_peered":"2024-03-07T07:31:13.016766+0000","last_unstale":"2024-03-07T07:31:14.014498+0000","last_undegraded":"2024-03-07T07:31:14.014498+0000","last_fullsized":"2024-03-07T07:31:14.014498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.010263+0000","last_change":"2024-03-07T07:31:14.008305+0000","last_active":"2024-03-07T07:31:14.010263+0000","last_peered":"2024-03-07T07:31:14.010263+0000","last_clean":"2024-03-07T07:31:14.010263+0000","last_became_active":"2024-03-07T07:31:14.006803+0000","last_became_peered":"2024-03-07T07:31:14.006803+0000","last_unstale":"2024-03-07T07:31:14.010263+0000","last_undegraded":"2024-03-07T07:31:14.010263+0000","last_fullsized":"2024-03-07T07:31:14.010263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:24.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T07:31:14.014088+0000","last_change":"2024-03-07T07:31:13.016945+0000","last_active":"2024-03-07T07:31:14.014088+0000","last_peered":"2024-03-07T07:31:14.014088+0000","last_clean":"2024-03-07T07:31:14.014088+0000","last_became_active":"2024-03-07T07:31:13.016362+0000","last_became_peered":"2024-03-07T07:31:13.016362+0000","last_unstale":"2024-03-07T07:31:14.014088+0000","last_undegraded":"2024-03-07T07:31:14.014088+0000","last_fullsized":"2024-03-07T07:31:14.014088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.001103+0000","last_change":"2024-03-07T07:31:13.001103+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.001103+0000","last_undegraded":"2024-03-07T07:31:13.001103+0000","last_fullsized":"2024-03-07T07:31:13.001103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.013451+0000","last_change":"2024-03-07T07:31:13.011989+0000","last_active":"2024-03-07T07:31:13.013451+0000","last_peered":"2024-03-07T07:31:13.013451+0000","last_clean":"2024-03-07T07:31:13.013451+0000","last_became_active":"2024-03-07T07:31:13.011663+0000","last_became_peered":"2024-03-07T07:31:13.011663+0000","last_unstale":"2024-03-07T07:31:13.013451+0000","last_undegraded":"2024-03-07T07:31:13.013451+0000","last_fullsized":"2024-03-07T07:31:13.013451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:37.603421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-03-07T07:31:13.003631+0000","last_change":"2024-03-07T07:31:13.003631+0000","last_active":"2024-03-07T07:31:12.974214+0000","last_peered":"2024-03-07T07:31:12.974214+0000","last_clean":"2024-03-07T07:31:12.974214+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:31:13.003631+0000","last_undegraded":"2024-03-07T07:31:13.003631+0000","last_fullsized":"2024-03-07T07:31:13.003631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-07T07:31:13.002561+0000","last_change":"2024-03-07T07:31:12.997330+0000","last_active":"2024-03-07T07:31:13.002561+0000","last_peered":"2024-03-07T07:31:13.002561+0000","last_clean":"2024-03-07T07:31:13.002561+0000","last_became_active":"2024-03-07T07:31:12.997026+0000","last_became_peered":"2024-03-07T07:31:12.997026+0000","last_unstale":"2024-03-07T07:31:13.002561+0000","last_undegraded":"2024-03-07T07:31:13.002561+0000","last_fullsized":"2024-03-07T07:31:13.002561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:47:07.277106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":66809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":656665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":649820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:31:22.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:31:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.714+0000 7f4199200640 1 Processor -- start 2024-03-07T07:31:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.714+0000 7f4199200640 1 -- start start 2024-03-07T07:31:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.714+0000 7f4199200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4194145a30 0x7f41940729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.714+0000 7f4199200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41940a9540 0x7f4194072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.714+0000 7f4199200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419406d780 con 0x7f419406d230 2024-03-07T07:31:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.714+0000 7f4199200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419406da60 con 0x7f41940a9540 2024-03-07T07:31:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.714+0000 7f4199200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419406dd40 con 0x7f4194145a30 2024-03-07T07:31:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.714+0000 7f4191400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41940a9540 0x7f4194072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4191e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4194145a30 0x7f41940729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4192800640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f419406d230 0x7f41940ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41272/0 (socket says 172.21.15.84:41272) 2024-03-07T07:31:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4192800640 1 -- 172.21.15.84:0/28370338 learned_addr learned my addr 172.21.15.84:0/28370338 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4191400640 1 -- 172.21.15.84:0/28370338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4194145a30 msgr2=0x7f41940729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4191400640 1 --2- 172.21.15.84:0/28370338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4194145a30 0x7f41940729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4191400640 1 -- 172.21.15.84:0/28370338 >> v1:172.21.15.161:6789/0 conn(0x7f419406d230 legacy=0x7f41940ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4191400640 1 -- 172.21.15.84:0/28370338 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419406e020 con 0x7f41940a9540 2024-03-07T07:31:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4191400640 1 --2- 172.21.15.84:0/28370338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41940a9540 0x7f4194072f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f41800097c0 tx=0x7f418001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b24c0c7675b141 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4190a00640 1 -- 172.21.15.84:0/28370338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800b0070 con 0x7f41940a9540 2024-03-07T07:31:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4190a00640 1 -- 172.21.15.84:0/28370338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41800ab600 con 0x7f41940a9540 2024-03-07T07:31:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.718+0000 7f4190a00640 1 -- 172.21.15.84:0/28370338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800ab9d0 con 0x7f41940a9540 2024-03-07T07:31:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- 172.21.15.84:0/28370338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41940a9540 msgr2=0x7f4194072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 --2- 172.21.15.84:0/28370338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41940a9540 0x7f4194072f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f41800097c0 tx=0x7f418001c380 comp rx=0 tx=0).stop 2024-03-07T07:31:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- 172.21.15.84:0/28370338 shutdown_connections 2024-03-07T07:31:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 --2- 172.21.15.84:0/28370338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41940a9540 0x7f4194072f10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 --2- 172.21.15.84:0/28370338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4194145a30 0x7f41940729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- 172.21.15.84:0/28370338 >> 172.21.15.84:0/28370338 conn(0x7f41940704b0 msgr2=0x7f41940708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- 172.21.15.84:0/28370338 shutdown_connections 2024-03-07T07:31:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- 172.21.15.84:0/28370338 wait complete. 2024-03-07T07:31:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 Processor -- start 2024-03-07T07:31:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- start start 2024-03-07T07:31:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f419406d230 0x7f4194159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4194145a30 0x7f4194141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41941405e0 0x7f419415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4194168d60 con 0x7f4194145a30 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4194168be0 con 0x7f419406d230 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4199200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4194168ee0 con 0x7f41941405e0 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4194145a30 0x7f4194141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4194145a30 0x7f4194141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49844/0 (socket says 172.21.15.84:49844) 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191400640 1 -- 172.21.15.84:0/2011920103 learned_addr learned my addr 172.21.15.84:0/2011920103 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191e00640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f419406d230 0x7f4194159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4192800640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41941405e0 0x7f419415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191400640 1 -- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41941405e0 msgr2=0x7f419415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191400640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41941405e0 0x7f419415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191400640 1 -- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f419406d230 msgr2=0x7f4194159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191400640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f419406d230 0x7f4194159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191400640 1 -- 172.21.15.84:0/2011920103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194143730 con 0x7f4194145a30 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.722+0000 7f4191e00640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f419406d230 0x7f4194159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f4191400640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4194145a30 0x7f4194141890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f41800ae040 tx=0x7f4180019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f418a000640 1 -- 172.21.15.84:0/2011920103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800b8020 con 0x7f4194145a30 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f418a000640 1 -- 172.21.15.84:0/2011920103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41800b4610 con 0x7f4194145a30 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4194143450 con 0x7f4194145a30 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f418a000640 1 -- 172.21.15.84:0/2011920103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800b0040 con 0x7f4194145a30 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4194141090 con 0x7f4194145a30 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4194062d40 con 0x7f4194145a30 2024-03-07T07:31:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f418a000640 1 -- 172.21.15.84:0/2011920103 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f41800bb020 con 0x7f4194145a30 2024-03-07T07:31:22.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f418a000640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4174066f60 0x7f4174069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:22.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f418a000640 1 -- 172.21.15.84:0/2011920103 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f418011ec10 con 0x7f4194145a30 2024-03-07T07:31:22.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f4191e00640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4174066f60 0x7f4174069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:22.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.726+0000 7f4191e00640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4174066f60 0x7f4174069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fd0 tx=0x7f418400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.730+0000 7f418a000640 1 -- 172.21.15.84:0/2011920103 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f41800c2030 con 0x7f4194145a30 2024-03-07T07:31:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.882+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41940682a0 con 0x7f4174066f60 2024-03-07T07:31:22.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.886+0000 7f418a000640 1 -- 172.21.15.84:0/2011920103 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251944 (secure 0 0 0) 0x7f41940682a0 con 0x7f4174066f60 2024-03-07T07:31:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:31:22.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4174066f60 msgr2=0x7f4174069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:22.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4174066f60 0x7f4174069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fd0 tx=0x7f418400b040 comp rx=0 tx=0).stop 2024-03-07T07:31:22.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4194145a30 msgr2=0x7f4194141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:22.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4194145a30 0x7f4194141890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f41800ae040 tx=0x7f4180019120 comp rx=0 tx=0).stop 2024-03-07T07:31:22.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 shutdown_connections 2024-03-07T07:31:22.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4174066f60 0x7f4174069420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41941405e0 0x7f419415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4194145a30 0x7f4194141890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 --2- 172.21.15.84:0/2011920103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f419406d230 0x7f4194159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:22.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 >> 172.21.15.84:0/2011920103 conn(0x7f41940704b0 msgr2=0x7f419413bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:22.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 shutdown_connections 2024-03-07T07:31:22.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:22.890+0000 7f4199200640 1 -- 172.21.15.84:0/2011920103 wait complete. 2024-03-07T07:31:22.914 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-03-07T07:31:22.878676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219036,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755684,"statfs":{"total":773094113280,"available":772869820416,"internally_reserved":0,"allocated":2924544,"data_stored":1765772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.894804"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507368+0000","last_change":"2024-03-07T07:31:14.022667+0000","last_active":"2024-03-07T07:31:15.507368+0000","last_peered":"2024-03-07T07:31:15.507368+0000","last_clean":"2024-03-07T07:31:15.507368+0000","last_became_active":"2024-03-07T07:31:14.021747+0000","last_became_peered":"2024-03-07T07:31:14.021747+0000","last_unstale":"2024-03-07T07:31:15.507368+0000","last_undegraded":"2024-03-07T07:31:15.507368+0000","last_fullsized":"2024-03-07T07:31:15.507368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:54:30.956919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507636+0000","last_change":"2024-03-07T07:31:14.025493+0000","last_active":"2024-03-07T07:31:15.507636+0000","last_peered":"2024-03-07T07:31:15.507636+0000","last_clean":"2024-03-07T07:31:15.507636+0000","last_became_active":"2024-03-07T07:31:14.025150+0000","last_became_peered":"2024-03-07T07:31:14.025150+0000","last_unstale":"2024-03-07T07:31:15.507636+0000","last_undegraded":"2024-03-07T07:31:15.507636+0000","last_fullsized":"2024-03-07T07:31:15.507636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507618+0000","last_change":"2024-03-07T07:31:14.020208+0000","last_active":"2024-03-07T07:31:15.507618+0000","last_peered":"2024-03-07T07:31:15.507618+0000","last_clean":"2024-03-07T07:31:15.507618+0000","last_became_active":"2024-03-07T07:31:14.019922+0000","last_became_peered":"2024-03-07T07:31:14.019922+0000","last_unstale":"2024-03-07T07:31:15.507618+0000","last_undegraded":"2024-03-07T07:31:15.507618+0000","last_fullsized":"2024-03-07T07:31:15.507618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004299+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:15.004299+0000","last_peered":"2024-03-07T07:31:15.004299+0000","last_clean":"2024-03-07T07:31:15.004299+0000","last_became_active":"2024-03-07T07:31:14.014792+0000","last_became_peered":"2024-03-07T07:31:14.014792+0000","last_unstale":"2024-03-07T07:31:15.004299+0000","last_undegraded":"2024-03-07T07:31:15.004299+0000","last_fullsized":"2024-03-07T07:31:15.004299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506999+0000","last_change":"2024-03-07T07:31:14.020574+0000","last_active":"2024-03-07T07:31:15.506999+0000","last_peered":"2024-03-07T07:31:15.506999+0000","last_clean":"2024-03-07T07:31:15.506999+0000","last_became_active":"2024-03-07T07:31:14.020305+0000","last_became_peered":"2024-03-07T07:31:14.020305+0000","last_unstale":"2024-03-07T07:31:15.506999+0000","last_undegraded":"2024-03-07T07:31:15.506999+0000","last_fullsized":"2024-03-07T07:31:15.506999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004168+0000","last_change":"2024-03-07T07:31:14.014335+0000","last_active":"2024-03-07T07:31:15.004168+0000","last_peered":"2024-03-07T07:31:15.004168+0000","last_clean":"2024-03-07T07:31:15.004168+0000","last_became_active":"2024-03-07T07:31:14.013975+0000","last_became_peered":"2024-03-07T07:31:14.013975+0000","last_unstale":"2024-03-07T07:31:15.004168+0000","last_undegraded":"2024-03-07T07:31:15.004168+0000","last_fullsized":"2024-03-07T07:31:15.004168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:56.429772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506827+0000","last_change":"2024-03-07T07:31:14.021322+0000","last_active":"2024-03-07T07:31:15.506827+0000","last_peered":"2024-03-07T07:31:15.506827+0000","last_clean":"2024-03-07T07:31:15.506827+0000","last_became_active":"2024-03-07T07:31:14.021007+0000","last_became_peered":"2024-03-07T07:31:14.021007+0000","last_unstale":"2024-03-07T07:31:15.506827+0000","last_undegraded":"2024-03-07T07:31:15.506827+0000","last_fullsized":"2024-03-07T07:31:15.506827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507184+0000","last_change":"2024-03-07T07:31:14.027374+0000","last_active":"2024-03-07T07:31:15.507184+0000","last_peered":"2024-03-07T07:31:15.507184+0000","last_clean":"2024-03-07T07:31:15.507184+0000","last_became_active":"2024-03-07T07:31:14.027198+0000","last_became_peered":"2024-03-07T07:31:14.027198+0000","last_unstale":"2024-03-07T07:31:15.507184+0000","last_undegraded":"2024-03-07T07:31:15.507184+0000","last_fullsized":"2024-03-07T07:31:15.507184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005832+0000","last_change":"2024-03-07T07:31:14.011155+0000","last_active":"2024-03-07T07:31:15.005832+0000","last_peered":"2024-03-07T07:31:15.005832+0000","last_clean":"2024-03-07T07:31:15.005832+0000","last_became_active":"2024-03-07T07:31:14.010799+0000","last_became_peered":"2024-03-07T07:31:14.010799+0000","last_unstale":"2024-03-07T07:31:15.005832+0000","last_undegraded":"2024-03-07T07:31:15.005832+0000","last_fullsized":"2024-03-07T07:31:15.005832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507307+0000","last_change":"2024-03-07T07:31:14.002815+0000","last_active":"2024-03-07T07:31:15.507307+0000","last_peered":"2024-03-07T07:31:15.507307+0000","last_clean":"2024-03-07T07:31:15.507307+0000","last_became_active":"2024-03-07T07:31:14.002600+0000","last_became_peered":"2024-03-07T07:31:14.002600+0000","last_unstale":"2024-03-07T07:31:15.507307+0000","last_undegraded":"2024-03-07T07:31:15.507307+0000","last_fullsized":"2024-03-07T07:31:15.507307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:16:51.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507108+0000","last_change":"2024-03-07T07:31:14.020556+0000","last_active":"2024-03-07T07:31:15.507108+0000","last_peered":"2024-03-07T07:31:15.507108+0000","last_clean":"2024-03-07T07:31:15.507108+0000","last_became_active":"2024-03-07T07:31:14.020256+0000","last_became_peered":"2024-03-07T07:31:14.020256+0000","last_unstale":"2024-03-07T07:31:15.507108+0000","last_undegraded":"2024-03-07T07:31:15.507108+0000","last_fullsized":"2024-03-07T07:31:15.507108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506985+0000","last_change":"2024-03-07T07:31:14.014180+0000","last_active":"2024-03-07T07:31:15.506985+0000","last_peered":"2024-03-07T07:31:15.506985+0000","last_clean":"2024-03-07T07:31:15.506985+0000","last_became_active":"2024-03-07T07:31:14.013845+0000","last_became_peered":"2024-03-07T07:31:14.013845+0000","last_unstale":"2024-03-07T07:31:15.506985+0000","last_undegraded":"2024-03-07T07:31:15.506985+0000","last_fullsized":"2024-03-07T07:31:15.506985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507185+0000","last_change":"2024-03-07T07:31:14.027721+0000","last_active":"2024-03-07T07:31:15.507185+0000","last_peered":"2024-03-07T07:31:15.507185+0000","last_clean":"2024-03-07T07:31:15.507185+0000","last_became_active":"2024-03-07T07:31:14.024529+0000","last_became_peered":"2024-03-07T07:31:14.024529+0000","last_unstale":"2024-03-07T07:31:15.507185+0000","last_undegraded":"2024-03-07T07:31:15.507185+0000","last_fullsized":"2024-03-07T07:31:15.507185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:16:31.787880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506638+0000","last_change":"2024-03-07T07:31:14.023955+0000","last_active":"2024-03-07T07:31:15.506638+0000","last_peered":"2024-03-07T07:31:15.506638+0000","last_clean":"2024-03-07T07:31:15.506638+0000","last_became_active":"2024-03-07T07:31:14.023578+0000","last_became_peered":"2024-03-07T07:31:14.023578+0000","last_unstale":"2024-03-07T07:31:15.506638+0000","last_undegraded":"2024-03-07T07:31:15.506638+0000","last_fullsized":"2024-03-07T07:31:15.506638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:10:18.829790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507161+0000","last_change":"2024-03-07T07:31:14.027411+0000","last_active":"2024-03-07T07:31:15.507161+0000","last_peered":"2024-03-07T07:31:15.507161+0000","last_clean":"2024-03-07T07:31:15.507161+0000","last_became_active":"2024-03-07T07:31:14.026679+0000","last_became_peered":"2024-03-07T07:31:14.026679+0000","last_unstale":"2024-03-07T07:31:15.507161+0000","last_undegraded":"2024-03-07T07:31:15.507161+0000","last_fullsized":"2024-03-07T07:31:15.507161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324002+0000","last_change":"2024-03-07T07:31:14.004296+0000","last_active":"2024-03-07T07:31:15.324002+0000","last_peered":"2024-03-07T07:31:15.324002+0000","last_clean":"2024-03-07T07:31:15.324002+0000","last_became_active":"2024-03-07T07:31:14.003978+0000","last_became_peered":"2024-03-07T07:31:14.003978+0000","last_unstale":"2024-03-07T07:31:15.324002+0000","last_undegraded":"2024-03-07T07:31:15.324002+0000","last_fullsized":"2024-03-07T07:31:15.324002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:16:51.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324577+0000","last_change":"2024-03-07T07:31:14.026782+0000","last_active":"2024-03-07T07:31:15.324577+0000","last_peered":"2024-03-07T07:31:15.324577+0000","last_clean":"2024-03-07T07:31:15.324577+0000","last_became_active":"2024-03-07T07:31:14.026435+0000","last_became_peered":"2024-03-07T07:31:14.026435+0000","last_unstale":"2024-03-07T07:31:15.324577+0000","last_undegraded":"2024-03-07T07:31:15.324577+0000","last_fullsized":"2024-03-07T07:31:15.324577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:00:18.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.508054+0000","last_change":"2024-03-07T07:31:14.022236+0000","last_active":"2024-03-07T07:31:15.508054+0000","last_peered":"2024-03-07T07:31:15.508054+0000","last_clean":"2024-03-07T07:31:15.508054+0000","last_became_active":"2024-03-07T07:31:14.021958+0000","last_became_peered":"2024-03-07T07:31:14.021958+0000","last_unstale":"2024-03-07T07:31:15.508054+0000","last_undegraded":"2024-03-07T07:31:15.508054+0000","last_fullsized":"2024-03-07T07:31:15.508054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324612+0000","last_change":"2024-03-07T07:31:14.018840+0000","last_active":"2024-03-07T07:31:15.324612+0000","last_peered":"2024-03-07T07:31:15.324612+0000","last_clean":"2024-03-07T07:31:15.324612+0000","last_became_active":"2024-03-07T07:31:14.015465+0000","last_became_peered":"2024-03-07T07:31:14.015465+0000","last_unstale":"2024-03-07T07:31:15.324612+0000","last_undegraded":"2024-03-07T07:31:15.324612+0000","last_fullsized":"2024-03-07T07:31:15.324612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:13:28.854524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507008+0000","last_change":"2024-03-07T07:31:14.003946+0000","last_active":"2024-03-07T07:31:15.507008+0000","last_peered":"2024-03-07T07:31:15.507008+0000","last_clean":"2024-03-07T07:31:15.507008+0000","last_became_active":"2024-03-07T07:31:14.003724+0000","last_became_peered":"2024-03-07T07:31:14.003724+0000","last_unstale":"2024-03-07T07:31:15.507008+0000","last_undegraded":"2024-03-07T07:31:15.507008+0000","last_fullsized":"2024-03-07T07:31:15.507008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004139+0000","last_change":"2024-03-07T07:31:14.001532+0000","last_active":"2024-03-07T07:31:15.004139+0000","last_peered":"2024-03-07T07:31:15.004139+0000","last_clean":"2024-03-07T07:31:15.004139+0000","last_became_active":"2024-03-07T07:31:14.001153+0000","last_became_peered":"2024-03-07T07:31:14.001153+0000","last_unstale":"2024-03-07T07:31:15.004139+0000","last_undegraded":"2024-03-07T07:31:15.004139+0000","last_fullsized":"2024-03-07T07:31:15.004139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:49:34.177805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005389+0000","last_change":"2024-03-07T07:31:14.019962+0000","last_active":"2024-03-07T07:31:15.005389+0000","last_peered":"2024-03-07T07:31:15.005389+0000","last_clean":"2024-03-07T07:31:15.005389+0000","last_became_active":"2024-03-07T07:31:14.019664+0000","last_became_peered":"2024-03-07T07:31:14.019664+0000","last_unstale":"2024-03-07T07:31:15.005389+0000","last_undegraded":"2024-03-07T07:31:15.005389+0000","last_fullsized":"2024-03-07T07:31:15.005389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507316+0000","last_change":"2024-03-07T07:31:14.010768+0000","last_active":"2024-03-07T07:31:15.507316+0000","last_peered":"2024-03-07T07:31:15.507316+0000","last_clean":"2024-03-07T07:31:15.507316+0000","last_became_active":"2024-03-07T07:31:14.010406+0000","last_became_peered":"2024-03-07T07:31:14.010406+0000","last_unstale":"2024-03-07T07:31:15.507316+0000","last_undegraded":"2024-03-07T07:31:15.507316+0000","last_fullsized":"2024-03-07T07:31:15.507316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324007+0000","last_change":"2024-03-07T07:31:14.019616+0000","last_active":"2024-03-07T07:31:15.324007+0000","last_peered":"2024-03-07T07:31:15.324007+0000","last_clean":"2024-03-07T07:31:15.324007+0000","last_became_active":"2024-03-07T07:31:14.019246+0000","last_became_peered":"2024-03-07T07:31:14.019246+0000","last_unstale":"2024-03-07T07:31:15.324007+0000","last_undegraded":"2024-03-07T07:31:15.324007+0000","last_fullsized":"2024-03-07T07:31:15.324007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:54:43.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507717+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:15.507717+0000","last_peered":"2024-03-07T07:31:15.507717+0000","last_clean":"2024-03-07T07:31:15.507717+0000","last_became_active":"2024-03-07T07:31:14.014755+0000","last_became_peered":"2024-03-07T07:31:14.014755+0000","last_unstale":"2024-03-07T07:31:15.507717+0000","last_undegraded":"2024-03-07T07:31:15.507717+0000","last_fullsized":"2024-03-07T07:31:15.507717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004465+0000","last_change":"2024-03-07T07:31:14.017123+0000","last_active":"2024-03-07T07:31:15.004465+0000","last_peered":"2024-03-07T07:31:15.004465+0000","last_clean":"2024-03-07T07:31:15.004465+0000","last_became_active":"2024-03-07T07:31:14.016071+0000","last_became_peered":"2024-03-07T07:31:14.016071+0000","last_unstale":"2024-03-07T07:31:15.004465+0000","last_undegraded":"2024-03-07T07:31:15.004465+0000","last_fullsized":"2024-03-07T07:31:15.004465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.508369+0000","last_change":"2024-03-07T07:31:14.024590+0000","last_active":"2024-03-07T07:31:15.508369+0000","last_peered":"2024-03-07T07:31:15.508369+0000","last_clean":"2024-03-07T07:31:15.508369+0000","last_became_active":"2024-03-07T07:31:14.024260+0000","last_became_peered":"2024-03-07T07:31:14.024260+0000","last_unstale":"2024-03-07T07:31:15.508369+0000","last_undegraded":"2024-03-07T07:31:15.508369+0000","last_fullsized":"2024-03-07T07:31:15.508369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:12:29.984408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507396+0000","last_change":"2024-03-07T07:31:14.029144+0000","last_active":"2024-03-07T07:31:15.507396+0000","last_peered":"2024-03-07T07:31:15.507396+0000","last_clean":"2024-03-07T07:31:15.507396+0000","last_became_active":"2024-03-07T07:31:14.027597+0000","last_became_peered":"2024-03-07T07:31:14.027597+0000","last_unstale":"2024-03-07T07:31:15.507396+0000","last_undegraded":"2024-03-07T07:31:15.507396+0000","last_fullsized":"2024-03-07T07:31:15.507396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:17:16.143558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507342+0000","last_change":"2024-03-07T07:31:14.025908+0000","last_active":"2024-03-07T07:31:15.507342+0000","last_peered":"2024-03-07T07:31:15.507342+0000","last_clean":"2024-03-07T07:31:15.507342+0000","last_became_active":"2024-03-07T07:31:14.025639+0000","last_became_peered":"2024-03-07T07:31:14.025639+0000","last_unstale":"2024-03-07T07:31:15.507342+0000","last_undegraded":"2024-03-07T07:31:15.507342+0000","last_fullsized":"2024-03-07T07:31:15.507342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324107+0000","last_change":"2024-03-07T07:31:14.018277+0000","last_active":"2024-03-07T07:31:15.324107+0000","last_peered":"2024-03-07T07:31:15.324107+0000","last_clean":"2024-03-07T07:31:15.324107+0000","last_became_active":"2024-03-07T07:31:14.017969+0000","last_became_peered":"2024-03-07T07:31:14.017969+0000","last_unstale":"2024-03-07T07:31:15.324107+0000","last_undegraded":"2024-03-07T07:31:15.324107+0000","last_fullsized":"2024-03-07T07:31:15.324107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:01.505914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506523+0000","last_change":"2024-03-07T07:31:14.009930+0000","last_active":"2024-03-07T07:31:15.506523+0000","last_peered":"2024-03-07T07:31:15.506523+0000","last_clean":"2024-03-07T07:31:15.506523+0000","last_became_active":"2024-03-07T07:31:14.009559+0000","last_became_peered":"2024-03-07T07:31:14.009559+0000","last_unstale":"2024-03-07T07:31:15.506523+0000","last_undegraded":"2024-03-07T07:31:15.506523+0000","last_fullsized":"2024-03-07T07:31:15.506523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004185+0000","last_change":"2024-03-07T07:31:14.025073+0000","last_active":"2024-03-07T07:31:15.004185+0000","last_peered":"2024-03-07T07:31:15.004185+0000","last_clean":"2024-03-07T07:31:15.004185+0000","last_became_active":"2024-03-07T07:31:14.024374+0000","last_became_peered":"2024-03-07T07:31:14.024374+0000","last_unstale":"2024-03-07T07:31:15.004185+0000","last_undegraded":"2024-03-07T07:31:15.004185+0000","last_fullsized":"2024-03-07T07:31:15.004185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005472+0000","last_change":"2024-03-07T07:31:14.009391+0000","last_active":"2024-03-07T07:31:15.005472+0000","last_peered":"2024-03-07T07:31:15.005472+0000","last_clean":"2024-03-07T07:31:15.005472+0000","last_became_active":"2024-03-07T07:31:14.009148+0000","last_became_peered":"2024-03-07T07:31:14.009148+0000","last_unstale":"2024-03-07T07:31:15.005472+0000","last_undegraded":"2024-03-07T07:31:15.005472+0000","last_fullsized":"2024-03-07T07:31:15.005472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507426+0000","last_change":"2024-03-07T07:31:13.010423+0000","last_active":"2024-03-07T07:31:15.507426+0000","last_peered":"2024-03-07T07:31:15.507426+0000","last_clean":"2024-03-07T07:31:15.507426+0000","last_became_active":"2024-03-07T07:31:13.010096+0000","last_became_peered":"2024-03-07T07:31:13.010096+0000","last_unstale":"2024-03-07T07:31:15.507426+0000","last_undegraded":"2024-03-07T07:31:15.507426+0000","last_fullsized":"2024-03-07T07:31:15.507426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004206+0000","last_change":"2024-03-07T07:31:14.008786+0000","last_active":"2024-03-07T07:31:15.004206+0000","last_peered":"2024-03-07T07:31:15.004206+0000","last_clean":"2024-03-07T07:31:15.004206+0000","last_became_active":"2024-03-07T07:31:14.007354+0000","last_became_peered":"2024-03-07T07:31:14.007354+0000","last_unstale":"2024-03-07T07:31:15.004206+0000","last_undegraded":"2024-03-07T07:31:15.004206+0000","last_fullsized":"2024-03-07T07:31:15.004206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:12:29.984408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324386+0000","last_change":"2024-03-07T07:31:13.006659+0000","last_active":"2024-03-07T07:31:15.324386+0000","last_peered":"2024-03-07T07:31:15.324386+0000","last_clean":"2024-03-07T07:31:15.324386+0000","last_became_active":"2024-03-07T07:31:13.005927+0000","last_became_peered":"2024-03-07T07:31:13.005927+0000","last_unstale":"2024-03-07T07:31:15.324386+0000","last_undegraded":"2024-03-07T07:31:15.324386+0000","last_fullsized":"2024-03-07T07:31:15.324386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506797+0000","last_change":"2024-03-07T07:31:13.003135+0000","last_active":"2024-03-07T07:31:15.506797+0000","last_peered":"2024-03-07T07:31:15.506797+0000","last_clean":"2024-03-07T07:31:15.506797+0000","last_became_active":"2024-03-07T07:31:13.002843+0000","last_became_peered":"2024-03-07T07:31:13.002843+0000","last_unstale":"2024-03-07T07:31:15.506797+0000","last_undegraded":"2024-03-07T07:31:15.506797+0000","last_fullsized":"2024-03-07T07:31:15.506797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:45.950345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507401+0000","last_change":"2024-03-07T07:31:14.031819+0000","last_active":"2024-03-07T07:31:15.507401+0000","last_peered":"2024-03-07T07:31:15.507401+0000","last_clean":"2024-03-07T07:31:15.507401+0000","last_became_active":"2024-03-07T07:31:14.031513+0000","last_became_peered":"2024-03-07T07:31:14.031513+0000","last_unstale":"2024-03-07T07:31:15.507401+0000","last_undegraded":"2024-03-07T07:31:15.507401+0000","last_fullsized":"2024-03-07T07:31:15.507401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324216+0000","last_change":"2024-03-07T07:31:13.006518+0000","last_active":"2024-03-07T07:31:15.324216+0000","last_peered":"2024-03-07T07:31:15.324216+0000","last_clean":"2024-03-07T07:31:15.324216+0000","last_became_active":"2024-03-07T07:31:13.005662+0000","last_became_peered":"2024-03-07T07:31:13.005662+0000","last_unstale":"2024-03-07T07:31:15.324216+0000","last_undegraded":"2024-03-07T07:31:15.324216+0000","last_fullsized":"2024-03-07T07:31:15.324216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004066+0000","last_change":"2024-03-07T07:31:14.006625+0000","last_active":"2024-03-07T07:31:15.004066+0000","last_peered":"2024-03-07T07:31:15.004066+0000","last_clean":"2024-03-07T07:31:15.004066+0000","last_became_active":"2024-03-07T07:31:14.006314+0000","last_became_peered":"2024-03-07T07:31:14.006314+0000","last_unstale":"2024-03-07T07:31:15.004066+0000","last_undegraded":"2024-03-07T07:31:15.004066+0000","last_fullsized":"2024-03-07T07:31:15.004066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:16:31.787880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005853+0000","last_change":"2024-03-07T07:31:13.014357+0000","last_active":"2024-03-07T07:31:15.005853+0000","last_peered":"2024-03-07T07:31:15.005853+0000","last_clean":"2024-03-07T07:31:15.005853+0000","last_became_active":"2024-03-07T07:31:13.014065+0000","last_became_peered":"2024-03-07T07:31:13.014065+0000","last_unstale":"2024-03-07T07:31:15.005853+0000","last_undegraded":"2024-03-07T07:31:15.005853+0000","last_fullsized":"2024-03-07T07:31:15.005853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004535+0000","last_change":"2024-03-07T07:31:14.016928+0000","last_active":"2024-03-07T07:31:15.004535+0000","last_peered":"2024-03-07T07:31:15.004535+0000","last_clean":"2024-03-07T07:31:15.004535+0000","last_became_active":"2024-03-07T07:31:14.016029+0000","last_became_peered":"2024-03-07T07:31:14.016029+0000","last_unstale":"2024-03-07T07:31:15.004535+0000","last_undegraded":"2024-03-07T07:31:15.004535+0000","last_fullsized":"2024-03-07T07:31:15.004535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507244+0000","last_change":"2024-03-07T07:31:13.017045+0000","last_active":"2024-03-07T07:31:15.507244+0000","last_peered":"2024-03-07T07:31:15.507244+0000","last_clean":"2024-03-07T07:31:15.507244+0000","last_became_active":"2024-03-07T07:31:13.016712+0000","last_became_peered":"2024-03-07T07:31:13.016712+0000","last_unstale":"2024-03-07T07:31:15.507244+0000","last_undegraded":"2024-03-07T07:31:15.507244+0000","last_fullsized":"2024-03-07T07:31:15.507244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507993+0000","last_change":"2024-03-07T07:31:14.011291+0000","last_active":"2024-03-07T07:31:15.507993+0000","last_peered":"2024-03-07T07:31:15.507993+0000","last_clean":"2024-03-07T07:31:15.507993+0000","last_became_active":"2024-03-07T07:31:14.010987+0000","last_became_peered":"2024-03-07T07:31:14.010987+0000","last_unstale":"2024-03-07T07:31:15.507993+0000","last_undegraded":"2024-03-07T07:31:15.507993+0000","last_fullsized":"2024-03-07T07:31:15.507993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:56:52.711355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507937+0000","last_change":"2024-03-07T07:31:13.004264+0000","last_active":"2024-03-07T07:31:15.507937+0000","last_peered":"2024-03-07T07:31:15.507937+0000","last_clean":"2024-03-07T07:31:15.507937+0000","last_became_active":"2024-03-07T07:31:13.003883+0000","last_became_peered":"2024-03-07T07:31:13.003883+0000","last_unstale":"2024-03-07T07:31:15.507937+0000","last_undegraded":"2024-03-07T07:31:15.507937+0000","last_fullsized":"2024-03-07T07:31:15.507937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:45.919382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324252+0000","last_change":"2024-03-07T07:31:14.007051+0000","last_active":"2024-03-07T07:31:15.324252+0000","last_peered":"2024-03-07T07:31:15.324252+0000","last_clean":"2024-03-07T07:31:15.324252+0000","last_became_active":"2024-03-07T07:31:14.005904+0000","last_became_peered":"2024-03-07T07:31:14.005904+0000","last_unstale":"2024-03-07T07:31:15.324252+0000","last_undegraded":"2024-03-07T07:31:15.324252+0000","last_fullsized":"2024-03-07T07:31:15.324252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:57:16.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004295+0000","last_change":"2024-03-07T07:31:12.997602+0000","last_active":"2024-03-07T07:31:15.004295+0000","last_peered":"2024-03-07T07:31:15.004295+0000","last_clean":"2024-03-07T07:31:15.004295+0000","last_became_active":"2024-03-07T07:31:12.997204+0000","last_became_peered":"2024-03-07T07:31:12.997204+0000","last_unstale":"2024-03-07T07:31:15.004295+0000","last_undegraded":"2024-03-07T07:31:15.004295+0000","last_fullsized":"2024-03-07T07:31:15.004295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507181+0000","last_change":"2024-03-07T07:31:14.028791+0000","last_active":"2024-03-07T07:31:15.507181+0000","last_peered":"2024-03-07T07:31:15.507181+0000","last_clean":"2024-03-07T07:31:15.507181+0000","last_became_active":"2024-03-07T07:31:14.028591+0000","last_became_peered":"2024-03-07T07:31:14.028591+0000","last_unstale":"2024-03-07T07:31:15.507181+0000","last_undegraded":"2024-03-07T07:31:15.507181+0000","last_fullsized":"2024-03-07T07:31:15.507181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:56:52.711355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506774+0000","last_change":"2024-03-07T07:31:13.011937+0000","last_active":"2024-03-07T07:31:15.506774+0000","last_peered":"2024-03-07T07:31:15.506774+0000","last_clean":"2024-03-07T07:31:15.506774+0000","last_became_active":"2024-03-07T07:31:13.011577+0000","last_became_peered":"2024-03-07T07:31:13.011577+0000","last_unstale":"2024-03-07T07:31:15.506774+0000","last_undegraded":"2024-03-07T07:31:15.506774+0000","last_fullsized":"2024-03-07T07:31:15.506774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506742+0000","last_change":"2024-03-07T07:31:14.028636+0000","last_active":"2024-03-07T07:31:15.506742+0000","last_peered":"2024-03-07T07:31:15.506742+0000","last_clean":"2024-03-07T07:31:15.506742+0000","last_became_active":"2024-03-07T07:31:14.024496+0000","last_became_peered":"2024-03-07T07:31:14.024496+0000","last_unstale":"2024-03-07T07:31:15.506742+0000","last_undegraded":"2024-03-07T07:31:15.506742+0000","last_fullsized":"2024-03-07T07:31:15.506742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:10:02.515660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324494+0000","last_change":"2024-03-07T07:31:13.000961+0000","last_active":"2024-03-07T07:31:15.324494+0000","last_peered":"2024-03-07T07:31:15.324494+0000","last_clean":"2024-03-07T07:31:15.324494+0000","last_became_active":"2024-03-07T07:31:13.000129+0000","last_became_peered":"2024-03-07T07:31:13.000129+0000","last_unstale":"2024-03-07T07:31:15.324494+0000","last_undegraded":"2024-03-07T07:31:15.324494+0000","last_fullsized":"2024-03-07T07:31:15.324494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:58.045352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324283+0000","last_change":"2024-03-07T07:31:14.022537+0000","last_active":"2024-03-07T07:31:15.324283+0000","last_peered":"2024-03-07T07:31:15.324283+0000","last_clean":"2024-03-07T07:31:15.324283+0000","last_became_active":"2024-03-07T07:31:14.022221+0000","last_became_peered":"2024-03-07T07:31:14.022221+0000","last_unstale":"2024-03-07T07:31:15.324283+0000","last_undegraded":"2024-03-07T07:31:15.324283+0000","last_fullsized":"2024-03-07T07:31:15.324283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:42.196434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506798+0000","last_change":"2024-03-07T07:31:13.009533+0000","last_active":"2024-03-07T07:31:15.506798+0000","last_peered":"2024-03-07T07:31:15.506798+0000","last_clean":"2024-03-07T07:31:15.506798+0000","last_became_active":"2024-03-07T07:31:13.009224+0000","last_became_peered":"2024-03-07T07:31:13.009224+0000","last_unstale":"2024-03-07T07:31:15.506798+0000","last_undegraded":"2024-03-07T07:31:15.506798+0000","last_fullsized":"2024-03-07T07:31:15.506798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:40.675440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005317+0000","last_change":"2024-03-07T07:31:14.015133+0000","last_active":"2024-03-07T07:31:15.005317+0000","last_peered":"2024-03-07T07:31:15.005317+0000","last_clean":"2024-03-07T07:31:15.005317+0000","last_became_active":"2024-03-07T07:31:14.014859+0000","last_became_peered":"2024-03-07T07:31:14.014859+0000","last_unstale":"2024-03-07T07:31:15.005317+0000","last_undegraded":"2024-03-07T07:31:15.005317+0000","last_fullsized":"2024-03-07T07:31:15.005317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.003867+0000","last_change":"2024-03-07T07:31:13.000976+0000","last_active":"2024-03-07T07:31:15.003867+0000","last_peered":"2024-03-07T07:31:15.003867+0000","last_clean":"2024-03-07T07:31:15.003867+0000","last_became_active":"2024-03-07T07:31:13.000624+0000","last_became_peered":"2024-03-07T07:31:13.000624+0000","last_unstale":"2024-03-07T07:31:15.003867+0000","last_undegraded":"2024-03-07T07:31:15.003867+0000","last_fullsized":"2024-03-07T07:31:15.003867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:34.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324076+0000","last_change":"2024-03-07T07:31:14.008321+0000","last_active":"2024-03-07T07:31:15.324076+0000","last_peered":"2024-03-07T07:31:15.324076+0000","last_clean":"2024-03-07T07:31:15.324076+0000","last_became_active":"2024-03-07T07:31:14.008039+0000","last_became_peered":"2024-03-07T07:31:14.008039+0000","last_unstale":"2024-03-07T07:31:15.324076+0000","last_undegraded":"2024-03-07T07:31:15.324076+0000","last_fullsized":"2024-03-07T07:31:15.324076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:54:30.956919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507471+0000","last_change":"2024-03-07T07:31:13.008580+0000","last_active":"2024-03-07T07:31:15.507471+0000","last_peered":"2024-03-07T07:31:15.507471+0000","last_clean":"2024-03-07T07:31:15.507471+0000","last_became_active":"2024-03-07T07:31:13.008276+0000","last_became_peered":"2024-03-07T07:31:13.008276+0000","last_unstale":"2024-03-07T07:31:15.507471+0000","last_undegraded":"2024-03-07T07:31:15.507471+0000","last_fullsized":"2024-03-07T07:31:15.507471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004627+0000","last_change":"2024-03-07T07:31:14.003764+0000","last_active":"2024-03-07T07:31:15.004627+0000","last_peered":"2024-03-07T07:31:15.004627+0000","last_clean":"2024-03-07T07:31:15.004627+0000","last_became_active":"2024-03-07T07:31:14.002976+0000","last_became_peered":"2024-03-07T07:31:14.002976+0000","last_unstale":"2024-03-07T07:31:15.004627+0000","last_undegraded":"2024-03-07T07:31:15.004627+0000","last_fullsized":"2024-03-07T07:31:15.004627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:31.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004481+0000","last_change":"2024-03-07T07:31:13.010016+0000","last_active":"2024-03-07T07:31:15.004481+0000","last_peered":"2024-03-07T07:31:15.004481+0000","last_clean":"2024-03-07T07:31:15.004481+0000","last_became_active":"2024-03-07T07:31:13.009751+0000","last_became_peered":"2024-03-07T07:31:13.009751+0000","last_unstale":"2024-03-07T07:31:15.004481+0000","last_undegraded":"2024-03-07T07:31:15.004481+0000","last_fullsized":"2024-03-07T07:31:15.004481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:48:10.630881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507467+0000","last_change":"2024-03-07T07:31:14.013078+0000","last_active":"2024-03-07T07:31:15.507467+0000","last_peered":"2024-03-07T07:31:15.507467+0000","last_clean":"2024-03-07T07:31:15.507467+0000","last_became_active":"2024-03-07T07:31:14.012816+0000","last_became_peered":"2024-03-07T07:31:14.012816+0000","last_unstale":"2024-03-07T07:31:15.507467+0000","last_undegraded":"2024-03-07T07:31:15.507467+0000","last_fullsized":"2024-03-07T07:31:15.507467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:01.505914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507560+0000","last_change":"2024-03-07T07:31:13.016042+0000","last_active":"2024-03-07T07:31:15.507560+0000","last_peered":"2024-03-07T07:31:15.507560+0000","last_clean":"2024-03-07T07:31:15.507560+0000","last_became_active":"2024-03-07T07:31:13.015749+0000","last_became_peered":"2024-03-07T07:31:13.015749+0000","last_unstale":"2024-03-07T07:31:15.507560+0000","last_undegraded":"2024-03-07T07:31:15.507560+0000","last_fullsized":"2024-03-07T07:31:15.507560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:37:21.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507367+0000","last_change":"2024-03-07T07:31:14.015090+0000","last_active":"2024-03-07T07:31:15.507367+0000","last_peered":"2024-03-07T07:31:15.507367+0000","last_clean":"2024-03-07T07:31:15.507367+0000","last_became_active":"2024-03-07T07:31:14.014806+0000","last_became_peered":"2024-03-07T07:31:14.014806+0000","last_unstale":"2024-03-07T07:31:15.507367+0000","last_undegraded":"2024-03-07T07:31:15.507367+0000","last_fullsized":"2024-03-07T07:31:15.507367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:54:43.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507597+0000","last_change":"2024-03-07T07:31:13.002882+0000","last_active":"2024-03-07T07:31:15.507597+0000","last_peered":"2024-03-07T07:31:15.507597+0000","last_clean":"2024-03-07T07:31:15.507597+0000","last_became_active":"2024-03-07T07:31:13.002570+0000","last_became_peered":"2024-03-07T07:31:13.002570+0000","last_unstale":"2024-03-07T07:31:15.507597+0000","last_undegraded":"2024-03-07T07:31:15.507597+0000","last_fullsized":"2024-03-07T07:31:15.507597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:45:09.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324540+0000","last_change":"2024-03-07T07:31:14.008276+0000","last_active":"2024-03-07T07:31:15.324540+0000","last_peered":"2024-03-07T07:31:15.324540+0000","last_clean":"2024-03-07T07:31:15.324540+0000","last_became_active":"2024-03-07T07:31:14.007776+0000","last_became_peered":"2024-03-07T07:31:14.007776+0000","last_unstale":"2024-03-07T07:31:15.324540+0000","last_undegraded":"2024-03-07T07:31:15.324540+0000","last_fullsized":"2024-03-07T07:31:15.324540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:31:10.904651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005322+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:31:15.005322+0000","last_peered":"2024-03-07T07:31:15.005322+0000","last_clean":"2024-03-07T07:31:15.005322+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:31:15.005322+0000","last_undegraded":"2024-03-07T07:31:15.005322+0000","last_fullsized":"2024-03-07T07:31:15.005322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324287+0000","last_change":"2024-03-07T07:31:13.008377+0000","last_active":"2024-03-07T07:31:15.324287+0000","last_peered":"2024-03-07T07:31:15.324287+0000","last_clean":"2024-03-07T07:31:15.324287+0000","last_became_active":"2024-03-07T07:31:13.007831+0000","last_became_peered":"2024-03-07T07:31:13.007831+0000","last_unstale":"2024-03-07T07:31:15.324287+0000","last_undegraded":"2024-03-07T07:31:15.324287+0000","last_fullsized":"2024-03-07T07:31:15.324287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:04.756437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004221+0000","last_change":"2024-03-07T07:31:14.011057+0000","last_active":"2024-03-07T07:31:15.004221+0000","last_peered":"2024-03-07T07:31:15.004221+0000","last_clean":"2024-03-07T07:31:15.004221+0000","last_became_active":"2024-03-07T07:31:14.008674+0000","last_became_peered":"2024-03-07T07:31:14.008674+0000","last_unstale":"2024-03-07T07:31:15.004221+0000","last_undegraded":"2024-03-07T07:31:15.004221+0000","last_fullsized":"2024-03-07T07:31:15.004221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:13:13.737562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324150+0000","last_change":"2024-03-07T07:31:13.008418+0000","last_active":"2024-03-07T07:31:15.324150+0000","last_peered":"2024-03-07T07:31:15.324150+0000","last_clean":"2024-03-07T07:31:15.324150+0000","last_became_active":"2024-03-07T07:31:13.008022+0000","last_became_peered":"2024-03-07T07:31:13.008022+0000","last_unstale":"2024-03-07T07:31:15.324150+0000","last_undegraded":"2024-03-07T07:31:15.324150+0000","last_fullsized":"2024-03-07T07:31:15.324150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506707+0000","last_change":"2024-03-07T07:31:14.021608+0000","last_active":"2024-03-07T07:31:15.506707+0000","last_peered":"2024-03-07T07:31:15.506707+0000","last_clean":"2024-03-07T07:31:15.506707+0000","last_became_active":"2024-03-07T07:31:14.021264+0000","last_became_peered":"2024-03-07T07:31:14.021264+0000","last_unstale":"2024-03-07T07:31:15.506707+0000","last_undegraded":"2024-03-07T07:31:15.506707+0000","last_fullsized":"2024-03-07T07:31:15.506707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:09.493361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506600+0000","last_change":"2024-03-07T07:31:13.012807+0000","last_active":"2024-03-07T07:31:15.506600+0000","last_peered":"2024-03-07T07:31:15.506600+0000","last_clean":"2024-03-07T07:31:15.506600+0000","last_became_active":"2024-03-07T07:31:13.011968+0000","last_became_peered":"2024-03-07T07:31:13.011968+0000","last_unstale":"2024-03-07T07:31:15.506600+0000","last_undegraded":"2024-03-07T07:31:15.506600+0000","last_fullsized":"2024-03-07T07:31:15.506600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:23.206739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507191+0000","last_change":"2024-03-07T07:31:14.013203+0000","last_active":"2024-03-07T07:31:15.507191+0000","last_peered":"2024-03-07T07:31:15.507191+0000","last_clean":"2024-03-07T07:31:15.507191+0000","last_became_active":"2024-03-07T07:31:14.012147+0000","last_became_peered":"2024-03-07T07:31:14.012147+0000","last_unstale":"2024-03-07T07:31:15.507191+0000","last_undegraded":"2024-03-07T07:31:15.507191+0000","last_fullsized":"2024-03-07T07:31:15.507191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324586+0000","last_change":"2024-03-07T07:31:13.004811+0000","last_active":"2024-03-07T07:31:15.324586+0000","last_peered":"2024-03-07T07:31:15.324586+0000","last_clean":"2024-03-07T07:31:15.324586+0000","last_became_active":"2024-03-07T07:31:13.001378+0000","last_became_peered":"2024-03-07T07:31:13.001378+0000","last_unstale":"2024-03-07T07:31:15.324586+0000","last_undegraded":"2024-03-07T07:31:15.324586+0000","last_fullsized":"2024-03-07T07:31:15.324586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:30.900538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507068+0000","last_change":"2024-03-07T07:31:14.001567+0000","last_active":"2024-03-07T07:31:15.507068+0000","last_peered":"2024-03-07T07:31:15.507068+0000","last_clean":"2024-03-07T07:31:15.507068+0000","last_became_active":"2024-03-07T07:31:14.001209+0000","last_became_peered":"2024-03-07T07:31:14.001209+0000","last_unstale":"2024-03-07T07:31:15.507068+0000","last_undegraded":"2024-03-07T07:31:15.507068+0000","last_fullsized":"2024-03-07T07:31:15.507068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507268+0000","last_change":"2024-03-07T07:31:13.009741+0000","last_active":"2024-03-07T07:31:15.507268+0000","last_peered":"2024-03-07T07:31:15.507268+0000","last_clean":"2024-03-07T07:31:15.507268+0000","last_became_active":"2024-03-07T07:31:13.009377+0000","last_became_peered":"2024-03-07T07:31:13.009377+0000","last_unstale":"2024-03-07T07:31:15.507268+0000","last_undegraded":"2024-03-07T07:31:15.507268+0000","last_fullsized":"2024-03-07T07:31:15.507268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:23.206739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004256+0000","last_change":"2024-03-07T07:31:14.029593+0000","last_active":"2024-03-07T07:31:15.004256+0000","last_peered":"2024-03-07T07:31:15.004256+0000","last_clean":"2024-03-07T07:31:15.004256+0000","last_became_active":"2024-03-07T07:31:14.029271+0000","last_became_peered":"2024-03-07T07:31:14.029271+0000","last_unstale":"2024-03-07T07:31:15.004256+0000","last_undegraded":"2024-03-07T07:31:15.004256+0000","last_fullsized":"2024-03-07T07:31:15.004256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324639+0000","last_change":"2024-03-07T07:31:12.999335+0000","last_active":"2024-03-07T07:31:15.324639+0000","last_peered":"2024-03-07T07:31:15.324639+0000","last_clean":"2024-03-07T07:31:15.324639+0000","last_became_active":"2024-03-07T07:31:12.998960+0000","last_became_peered":"2024-03-07T07:31:12.998960+0000","last_unstale":"2024-03-07T07:31:15.324639+0000","last_undegraded":"2024-03-07T07:31:15.324639+0000","last_fullsized":"2024-03-07T07:31:15.324639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:36.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507521+0000","last_change":"2024-03-07T07:31:14.023039+0000","last_active":"2024-03-07T07:31:15.507521+0000","last_peered":"2024-03-07T07:31:15.507521+0000","last_clean":"2024-03-07T07:31:15.507521+0000","last_became_active":"2024-03-07T07:31:14.022753+0000","last_became_peered":"2024-03-07T07:31:14.022753+0000","last_unstale":"2024-03-07T07:31:15.507521+0000","last_undegraded":"2024-03-07T07:31:15.507521+0000","last_fullsized":"2024-03-07T07:31:15.507521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:49:34.177805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004648+0000","last_change":"2024-03-07T07:31:13.004776+0000","last_active":"2024-03-07T07:31:15.004648+0000","last_peered":"2024-03-07T07:31:15.004648+0000","last_clean":"2024-03-07T07:31:15.004648+0000","last_became_active":"2024-03-07T07:31:13.004179+0000","last_became_peered":"2024-03-07T07:31:13.004179+0000","last_unstale":"2024-03-07T07:31:15.004648+0000","last_undegraded":"2024-03-07T07:31:15.004648+0000","last_fullsized":"2024-03-07T07:31:15.004648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:20:31.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004577+0000","last_change":"2024-03-07T07:31:14.018269+0000","last_active":"2024-03-07T07:31:15.004577+0000","last_peered":"2024-03-07T07:31:15.004577+0000","last_clean":"2024-03-07T07:31:15.004577+0000","last_became_active":"2024-03-07T07:31:14.017951+0000","last_became_peered":"2024-03-07T07:31:14.017951+0000","last_unstale":"2024-03-07T07:31:15.004577+0000","last_undegraded":"2024-03-07T07:31:15.004577+0000","last_fullsized":"2024-03-07T07:31:15.004577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:47.090004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324673+0000","last_change":"2024-03-07T07:31:13.014574+0000","last_active":"2024-03-07T07:31:15.324673+0000","last_peered":"2024-03-07T07:31:15.324673+0000","last_clean":"2024-03-07T07:31:15.324673+0000","last_became_active":"2024-03-07T07:31:13.014264+0000","last_became_peered":"2024-03-07T07:31:13.014264+0000","last_unstale":"2024-03-07T07:31:15.324673+0000","last_undegraded":"2024-03-07T07:31:15.324673+0000","last_fullsized":"2024-03-07T07:31:15.324673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004522+0000","last_change":"2024-03-07T07:31:14.013847+0000","last_active":"2024-03-07T07:31:15.004522+0000","last_peered":"2024-03-07T07:31:15.004522+0000","last_clean":"2024-03-07T07:31:15.004522+0000","last_became_active":"2024-03-07T07:31:14.013485+0000","last_became_peered":"2024-03-07T07:31:14.013485+0000","last_unstale":"2024-03-07T07:31:15.004522+0000","last_undegraded":"2024-03-07T07:31:15.004522+0000","last_fullsized":"2024-03-07T07:31:15.004522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:20:38.979357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506657+0000","last_change":"2024-03-07T07:31:13.010611+0000","last_active":"2024-03-07T07:31:15.506657+0000","last_peered":"2024-03-07T07:31:15.506657+0000","last_clean":"2024-03-07T07:31:15.506657+0000","last_became_active":"2024-03-07T07:31:13.005305+0000","last_became_peered":"2024-03-07T07:31:13.005305+0000","last_unstale":"2024-03-07T07:31:15.506657+0000","last_undegraded":"2024-03-07T07:31:15.506657+0000","last_fullsized":"2024-03-07T07:31:15.506657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:10.661050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324091+0000","last_change":"2024-03-07T07:31:14.021524+0000","last_active":"2024-03-07T07:31:15.324091+0000","last_peered":"2024-03-07T07:31:15.324091+0000","last_clean":"2024-03-07T07:31:15.324091+0000","last_became_active":"2024-03-07T07:31:14.021248+0000","last_became_peered":"2024-03-07T07:31:14.021248+0000","last_unstale":"2024-03-07T07:31:15.324091+0000","last_undegraded":"2024-03-07T07:31:15.324091+0000","last_fullsized":"2024-03-07T07:31:15.324091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:10:35.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004002+0000","last_change":"2024-03-07T07:31:13.002330+0000","last_active":"2024-03-07T07:31:15.004002+0000","last_peered":"2024-03-07T07:31:15.004002+0000","last_clean":"2024-03-07T07:31:15.004002+0000","last_became_active":"2024-03-07T07:31:13.002030+0000","last_became_peered":"2024-03-07T07:31:13.002030+0000","last_unstale":"2024-03-07T07:31:15.004002+0000","last_undegraded":"2024-03-07T07:31:15.004002+0000","last_fullsized":"2024-03-07T07:31:15.004002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:16:54.530906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.003974+0000","last_change":"2024-03-07T07:31:14.012840+0000","last_active":"2024-03-07T07:31:15.003974+0000","last_peered":"2024-03-07T07:31:15.003974+0000","last_clean":"2024-03-07T07:31:15.003974+0000","last_became_active":"2024-03-07T07:31:14.009043+0000","last_became_peered":"2024-03-07T07:31:14.009043+0000","last_unstale":"2024-03-07T07:31:15.003974+0000","last_undegraded":"2024-03-07T07:31:15.003974+0000","last_fullsized":"2024-03-07T07:31:15.003974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:17:16.143558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506843+0000","last_change":"2024-03-07T07:31:13.008737+0000","last_active":"2024-03-07T07:31:15.506843+0000","last_peered":"2024-03-07T07:31:15.506843+0000","last_clean":"2024-03-07T07:31:15.506843+0000","last_became_active":"2024-03-07T07:31:13.008485+0000","last_became_peered":"2024-03-07T07:31:13.008485+0000","last_unstale":"2024-03-07T07:31:15.506843+0000","last_undegraded":"2024-03-07T07:31:15.506843+0000","last_fullsized":"2024-03-07T07:31:15.506843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:34.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506665+0000","last_change":"2024-03-07T07:31:14.012842+0000","last_active":"2024-03-07T07:31:15.506665+0000","last_peered":"2024-03-07T07:31:15.506665+0000","last_clean":"2024-03-07T07:31:15.506665+0000","last_became_active":"2024-03-07T07:31:14.012549+0000","last_became_peered":"2024-03-07T07:31:14.012549+0000","last_unstale":"2024-03-07T07:31:15.506665+0000","last_undegraded":"2024-03-07T07:31:15.506665+0000","last_fullsized":"2024-03-07T07:31:15.506665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324173+0000","last_change":"2024-03-07T07:31:13.008117+0000","last_active":"2024-03-07T07:31:15.324173+0000","last_peered":"2024-03-07T07:31:15.324173+0000","last_clean":"2024-03-07T07:31:15.324173+0000","last_became_active":"2024-03-07T07:31:13.006517+0000","last_became_peered":"2024-03-07T07:31:13.006517+0000","last_unstale":"2024-03-07T07:31:15.324173+0000","last_undegraded":"2024-03-07T07:31:15.324173+0000","last_fullsized":"2024-03-07T07:31:15.324173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:17.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324678+0000","last_change":"2024-03-07T07:31:14.011780+0000","last_active":"2024-03-07T07:31:15.324678+0000","last_peered":"2024-03-07T07:31:15.324678+0000","last_clean":"2024-03-07T07:31:15.324678+0000","last_became_active":"2024-03-07T07:31:14.011509+0000","last_became_peered":"2024-03-07T07:31:14.011509+0000","last_unstale":"2024-03-07T07:31:15.324678+0000","last_undegraded":"2024-03-07T07:31:15.324678+0000","last_fullsized":"2024-03-07T07:31:15.324678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:20:14.495243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324463+0000","last_change":"2024-03-07T07:31:14.024307+0000","last_active":"2024-03-07T07:31:15.324463+0000","last_peered":"2024-03-07T07:31:15.324463+0000","last_clean":"2024-03-07T07:31:15.324463+0000","last_became_active":"2024-03-07T07:31:14.024003+0000","last_became_peered":"2024-03-07T07:31:14.024003+0000","last_unstale":"2024-03-07T07:31:15.324463+0000","last_undegraded":"2024-03-07T07:31:15.324463+0000","last_fullsized":"2024-03-07T07:31:15.324463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:15.163371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507245+0000","last_change":"2024-03-07T07:31:13.017220+0000","last_active":"2024-03-07T07:31:15.507245+0000","last_peered":"2024-03-07T07:31:15.507245+0000","last_clean":"2024-03-07T07:31:15.507245+0000","last_became_active":"2024-03-07T07:31:13.016766+0000","last_became_peered":"2024-03-07T07:31:13.016766+0000","last_unstale":"2024-03-07T07:31:15.507245+0000","last_undegraded":"2024-03-07T07:31:15.507245+0000","last_fullsized":"2024-03-07T07:31:15.507245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005588+0000","last_change":"2024-03-07T07:31:14.008305+0000","last_active":"2024-03-07T07:31:15.005588+0000","last_peered":"2024-03-07T07:31:15.005588+0000","last_clean":"2024-03-07T07:31:15.005588+0000","last_became_active":"2024-03-07T07:31:14.006803+0000","last_became_peered":"2024-03-07T07:31:14.006803+0000","last_unstale":"2024-03-07T07:31:15.005588+0000","last_undegraded":"2024-03-07T07:31:15.005588+0000","last_fullsized":"2024-03-07T07:31:15.005588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507223+0000","last_change":"2024-03-07T07:31:13.016945+0000","last_active":"2024-03-07T07:31:15.507223+0000","last_peered":"2024-03-07T07:31:15.507223+0000","last_clean":"2024-03-07T07:31:15.507223+0000","last_became_active":"2024-03-07T07:31:13.016362+0000","last_became_peered":"2024-03-07T07:31:13.016362+0000","last_unstale":"2024-03-07T07:31:15.507223+0000","last_undegraded":"2024-03-07T07:31:15.507223+0000","last_fullsized":"2024-03-07T07:31:15.507223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507857+0000","last_change":"2024-03-07T07:31:14.015081+0000","last_active":"2024-03-07T07:31:15.507857+0000","last_peered":"2024-03-07T07:31:15.507857+0000","last_clean":"2024-03-07T07:31:15.507857+0000","last_became_active":"2024-03-07T07:31:14.014734+0000","last_became_peered":"2024-03-07T07:31:14.014734+0000","last_unstale":"2024-03-07T07:31:15.507857+0000","last_undegraded":"2024-03-07T07:31:15.507857+0000","last_fullsized":"2024-03-07T07:31:15.507857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507737+0000","last_change":"2024-03-07T07:31:13.011989+0000","last_active":"2024-03-07T07:31:15.507737+0000","last_peered":"2024-03-07T07:31:15.507737+0000","last_clean":"2024-03-07T07:31:15.507737+0000","last_became_active":"2024-03-07T07:31:13.011663+0000","last_became_peered":"2024-03-07T07:31:13.011663+0000","last_unstale":"2024-03-07T07:31:15.507737+0000","last_undegraded":"2024-03-07T07:31:15.507737+0000","last_fullsized":"2024-03-07T07:31:15.507737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:50.212787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507644+0000","last_change":"2024-03-07T07:31:14.019436+0000","last_active":"2024-03-07T07:31:15.507644+0000","last_peered":"2024-03-07T07:31:15.507644+0000","last_clean":"2024-03-07T07:31:15.507644+0000","last_became_active":"2024-03-07T07:31:14.019144+0000","last_became_peered":"2024-03-07T07:31:14.019144+0000","last_unstale":"2024-03-07T07:31:15.507644+0000","last_undegraded":"2024-03-07T07:31:15.507644+0000","last_fullsized":"2024-03-07T07:31:15.507644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004520+0000","last_change":"2024-03-07T07:31:12.997330+0000","last_active":"2024-03-07T07:31:15.004520+0000","last_peered":"2024-03-07T07:31:15.004520+0000","last_clean":"2024-03-07T07:31:15.004520+0000","last_became_active":"2024-03-07T07:31:12.997026+0000","last_became_peered":"2024-03-07T07:31:12.997026+0000","last_unstale":"2024-03-07T07:31:15.004520+0000","last_undegraded":"2024-03-07T07:31:15.004520+0000","last_fullsized":"2024-03-07T07:31:15.004520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:04:34.643046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":73109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":662965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":662987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:31:22.918 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-07T07:31:22.919 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-07T07:31:22.919 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-07T07:31:22.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-07T07:31:22.919 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-07T07:31:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b9400640 1 Processor -- start 2024-03-07T07:31:23.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b9400640 1 -- start start 2024-03-07T07:31:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b9400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b40a9540 0x7fd6b415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b9400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6b40730e0 0x7fd6b415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b9400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b406d780 con 0x7fd6b4145a30 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b9400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b406da60 con 0x7fd6b40730e0 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b9400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b406dd40 con 0x7fd6b40a9540 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b2800640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd6b4145a30 0x7fd6b40729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33618/0 (socket says 172.21.15.84:33618) 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b2800640 1 -- 172.21.15.84:0/2895308617 learned_addr learned my addr 172.21.15.84:0/2895308617 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b3200640 1 --2- 172.21.15.84:0/2895308617 >> v2:172.21.15.161:3300/0 conn(0x7fd6b40730e0 0x7fd6b415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b1e00640 1 --2- 172.21.15.84:0/2895308617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b40a9540 0x7fd6b415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b1400640 1 -- 172.21.15.84:0/2895308617 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753594156 0 0) 0x7fd6b406d780 con 0x7fd6b4145a30 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b1400640 1 -- 172.21.15.84:0/2895308617 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd698003530 con 0x7fd6b4145a30 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b3200640 1 -- 172.21.15.84:0/2895308617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b40a9540 msgr2=0x7fd6b415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b3200640 1 --2- 172.21.15.84:0/2895308617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b40a9540 0x7fd6b415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b3200640 1 -- 172.21.15.84:0/2895308617 >> v1:172.21.15.84:6789/0 conn(0x7fd6b4145a30 legacy=0x7fd6b40729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.086+0000 7fd6b3200640 1 -- 172.21.15.84:0/2895308617 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b406e020 con 0x7fd6b40730e0 2024-03-07T07:31:23.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b3200640 1 --2- 172.21.15.84:0/2895308617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 0x7fd6b415cd20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0097c0 tx=0x7fd6ac01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32611b89412a0939 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b1400640 1 -- 172.21.15.84:0/2895308617 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0b0070 con 0x7fd6b40730e0 2024-03-07T07:31:23.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b1400640 1 -- 172.21.15.84:0/2895308617 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac0ab600 con 0x7fd6b40730e0 2024-03-07T07:31:23.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b1400640 1 -- 172.21.15.84:0/2895308617 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0ab9d0 con 0x7fd6b40730e0 2024-03-07T07:31:23.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b9400640 1 -- 172.21.15.84:0/2895308617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 msgr2=0x7fd6b415cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b9400640 1 --2- 172.21.15.84:0/2895308617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 0x7fd6b415cd20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0097c0 tx=0x7fd6ac01c380 comp rx=0 tx=0).stop 2024-03-07T07:31:23.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b9400640 1 -- 172.21.15.84:0/2895308617 shutdown_connections 2024-03-07T07:31:23.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b9400640 1 --2- 172.21.15.84:0/2895308617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 0x7fd6b415cd20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b9400640 1 --2- 172.21.15.84:0/2895308617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b40a9540 0x7fd6b415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b9400640 1 -- 172.21.15.84:0/2895308617 >> 172.21.15.84:0/2895308617 conn(0x7fd6b40704b0 msgr2=0x7fd6b40708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:23.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b9400640 1 -- 172.21.15.84:0/2895308617 shutdown_connections 2024-03-07T07:31:23.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.090+0000 7fd6b9400640 1 -- 172.21.15.84:0/2895308617 wait complete. 2024-03-07T07:31:23.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 Processor -- start 2024-03-07T07:31:23.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 -- start start 2024-03-07T07:31:23.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 0x7fd6b415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b4145a30 0x7fd6b4142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b4165520 0x7fd6b41428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4168d60 con 0x7fd6b4145a30 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4168be0 con 0x7fd6b40730e0 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4168ee0 con 0x7fd6b4165520 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b4145a30 0x7fd6b4142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b4145a30 0x7fd6b4142370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49858/0 (socket says 172.21.15.84:49858) 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 -- 172.21.15.84:0/1865538644 learned_addr learned my addr 172.21.15.84:0/1865538644 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b2800640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 0x7fd6b415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b3200640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b4165520 0x7fd6b41428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 -- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b4165520 msgr2=0x7fd6b41428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b4165520 0x7fd6b41428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 -- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 msgr2=0x7fd6b415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 0x7fd6b415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 -- 172.21.15.84:0/1865538644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4164480 con 0x7fd6b4145a30 2024-03-07T07:31:23.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b2800640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 0x7fd6b415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:23.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b1e00640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b4145a30 0x7fd6b4142370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000e930 tx=0x7fd6a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6aaa00640 1 -- 172.21.15.84:0/1865538644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0017070 con 0x7fd6b4145a30 2024-03-07T07:31:23.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6aaa00640 1 -- 172.21.15.84:0/1865538644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a000ca00 con 0x7fd6b4145a30 2024-03-07T07:31:23.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6aaa00640 1 -- 172.21.15.84:0/1865538644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a000cdb0 con 0x7fd6b4145a30 2024-03-07T07:31:23.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b4164760 con 0x7fd6b4145a30 2024-03-07T07:31:23.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b4164d20 con 0x7fd6b4145a30 2024-03-07T07:31:23.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.094+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b4062d40 con 0x7fd6b4145a30 2024-03-07T07:31:23.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.098+0000 7fd6aaa00640 1 -- 172.21.15.84:0/1865538644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fd6a001a070 con 0x7fd6b4145a30 2024-03-07T07:31:23.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.098+0000 7fd6aaa00640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd694066f90 0x7fd694069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.098+0000 7fd6aaa00640 1 -- 172.21.15.84:0/1865538644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6a0085370 con 0x7fd6b4145a30 2024-03-07T07:31:23.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.098+0000 7fd6b2800640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd694066f90 0x7fd694069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.098+0000 7fd6b2800640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd694066f90 0x7fd694069450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4005c10 tx=0x7fd6a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.102+0000 7fd6aaa00640 1 -- 172.21.15.84:0/1865538644 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fd6a0055de0 con 0x7fd6b4145a30 2024-03-07T07:31:23.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.290+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd6b406ed40 con 0x7fd6b4145a30 2024-03-07T07:31:23.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.294+0000 7fd6aaa00640 1 -- 172.21.15.84:0/1865538644 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+165730 (secure 0 0 0) 0x7fd6a0059e80 con 0x7fd6b4145a30 2024-03-07T07:31:23.299 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd694066f90 msgr2=0x7fd694069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd694066f90 0x7fd694069450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4005c10 tx=0x7fd6a4009040 comp rx=0 tx=0).stop 2024-03-07T07:31:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b4145a30 msgr2=0x7fd6b4142370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b4145a30 0x7fd6b4142370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000e930 tx=0x7fd6a000edf0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 shutdown_connections 2024-03-07T07:31:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd694066f90 0x7fd694069450 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6b4165520 0x7fd6b41428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b4145a30 0x7fd6b4142370 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 --2- 172.21.15.84:0/1865538644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6b40730e0 0x7fd6b415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 >> 172.21.15.84:0/1865538644 conn(0x7fd6b40704b0 msgr2=0x7fd6b40af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 shutdown_connections 2024-03-07T07:31:23.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.298+0000 7fd6b9400640 1 -- 172.21.15.84:0/1865538644 wait complete. 2024-03-07T07:31:23.319 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":2204566843},{"type":"v1","addr":"172.21.15.84:6833","nonce":2204566843}]},"active_addr":"172.21.15.84:6833/2204566843","active_change":"2024-03-07T07:30:52.865102+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3404640226}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":812178865}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2137505509}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3199184342}]}]} 2024-03-07T07:31:23.325 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-07T07:31:23.326 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-07T07:31:23.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.454+0000 7f7314e00640 1 Processor -- start 2024-03-07T07:31:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f7314e00640 1 -- start start 2024-03-07T07:31:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f7314e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73100b3a00 0x7f73100b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f7314e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100b0290 con 0x7f731015c1f0 2024-03-07T07:31:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f7314e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100b0570 con 0x7f73100cf100 2024-03-07T07:31:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f7314e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100b1d40 con 0x7f73100b3a00 2024-03-07T07:31:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f730e800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73100b3a00 0x7f73100b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f730de00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f731015c1f0 0x7f73100d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33634/0 (socket says 172.21.15.84:33634) 2024-03-07T07:31:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f730de00640 1 -- 172.21.15.84:0/3757596202 learned_addr learned my addr 172.21.15.84:0/3757596202 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f730e800640 1 -- 172.21.15.84:0/3757596202 >> v1:172.21.15.161:6789/0 conn(0x7f73100cf100 legacy=0x7f73100aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f730e800640 1 -- 172.21.15.84:0/3757596202 >> v1:172.21.15.84:6789/0 conn(0x7f731015c1f0 legacy=0x7f73100d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.458+0000 7f730e800640 1 -- 172.21.15.84:0/3757596202 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100b0850 con 0x7f73100b3a00 2024-03-07T07:31:23.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f730e800640 1 --2- 172.21.15.84:0/3757596202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f73100b1330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7308009d90 tx=0x7f730801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad81cba192d83aa server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f730d400640 1 -- 172.21.15.84:0/3757596202 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080b2070 con 0x7f73100b3a00 2024-03-07T07:31:23.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f730d400640 1 -- 172.21.15.84:0/3757596202 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73080a58b0 con 0x7f73100b3a00 2024-03-07T07:31:23.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f730d400640 1 -- 172.21.15.84:0/3757596202 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080a5c80 con 0x7f73100b3a00 2024-03-07T07:31:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 -- 172.21.15.84:0/3757596202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 msgr2=0x7f73100b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 --2- 172.21.15.84:0/3757596202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f73100b1330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7308009d90 tx=0x7f730801c8e0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 -- 172.21.15.84:0/3757596202 shutdown_connections 2024-03-07T07:31:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 --2- 172.21.15.84:0/3757596202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f73100b1330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 -- 172.21.15.84:0/3757596202 >> 172.21.15.84:0/3757596202 conn(0x7f73100b1ed0 msgr2=0x7f73100b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 -- 172.21.15.84:0/3757596202 shutdown_connections 2024-03-07T07:31:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 -- 172.21.15.84:0/3757596202 wait complete. 2024-03-07T07:31:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 Processor -- start 2024-03-07T07:31:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.462+0000 7f7314e00640 1 -- start start 2024-03-07T07:31:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f731014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73100cf100 0x7f731013cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f731015c1f0 0x7f7310155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731016a080 con 0x7f73100b3a00 2024-03-07T07:31:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310169f00 con 0x7f731015c1f0 2024-03-07T07:31:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731016a200 con 0x7f73100cf100 2024-03-07T07:31:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f731014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f731014e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49872/0 (socket says 172.21.15.84:49872) 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 -- 172.21.15.84:0/1403157126 learned_addr learned my addr 172.21.15.84:0/1403157126 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730e800640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f731015c1f0 0x7f7310155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7305400640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73100cf100 0x7f731013cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 -- 172.21.15.84:0/1403157126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73100cf100 msgr2=0x7f731013cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73100cf100 0x7f731013cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 -- 172.21.15.84:0/1403157126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f731015c1f0 msgr2=0x7f7310155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f731015c1f0 0x7f7310155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 -- 172.21.15.84:0/1403157126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731013d080 con 0x7f73100b3a00 2024-03-07T07:31:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f730de00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f731014e1e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f730000c370 tx=0x7f730000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7306a00640 1 -- 172.21.15.84:0/1403157126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300017070 con 0x7f73100b3a00 2024-03-07T07:31:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7306a00640 1 -- 172.21.15.84:0/1403157126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7300005cf0 con 0x7f73100b3a00 2024-03-07T07:31:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7310158d10 con 0x7f73100b3a00 2024-03-07T07:31:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7306a00640 1 -- 172.21.15.84:0/1403157126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73000072f0 con 0x7f73100b3a00 2024-03-07T07:31:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73101592d0 con 0x7f73100b3a00 2024-03-07T07:31:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7310062d40 con 0x7f73100b3a00 2024-03-07T07:31:23.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.466+0000 7f7306a00640 1 -- 172.21.15.84:0/1403157126 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f730001a070 con 0x7f73100b3a00 2024-03-07T07:31:23.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.470+0000 7f7306a00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f72ec066f60 0x7f72ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.470+0000 7f7306a00640 1 -- 172.21.15.84:0/1403157126 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7300084390 con 0x7f73100b3a00 2024-03-07T07:31:23.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.470+0000 7f7305400640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f72ec066f60 0x7f72ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.470+0000 7f7305400640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f72ec066f60 0x7f72ec069420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73101f88d0 tx=0x7f72f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.474+0000 7f7306a00640 1 -- 172.21.15.84:0/1403157126 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f7300054cb0 con 0x7f73100b3a00 2024-03-07T07:31:23.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.626+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f731015eb10 con 0x7f73100b3a00 2024-03-07T07:31:23.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7306a00640 1 -- 172.21.15.84:0/1403157126 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f7300058d50 con 0x7f73100b3a00 2024-03-07T07:31:23.633 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:23.633 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f72ec066f60 msgr2=0x7f72ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f72ec066f60 0x7f72ec069420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73101f88d0 tx=0x7f72f8009040 comp rx=0 tx=0).stop 2024-03-07T07:31:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 msgr2=0x7f731014e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f731014e1e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f730000c370 tx=0x7f730000c830 comp rx=0 tx=0).stop 2024-03-07T07:31:23.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 shutdown_connections 2024-03-07T07:31:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f72ec066f60 0x7f72ec069420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f731015c1f0 0x7f7310155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73100cf100 0x7f731013cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 --2- 172.21.15.84:0/1403157126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73100b3a00 0x7f731014e1e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 >> 172.21.15.84:0/1403157126 conn(0x7f73100b1ed0 msgr2=0x7f731015d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 shutdown_connections 2024-03-07T07:31:23.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.630+0000 7f7314e00640 1 -- 172.21.15.84:0/1403157126 wait complete. 2024-03-07T07:31:23.654 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-07T07:31:23.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:23.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.782+0000 7fcc0a800640 1 Processor -- start 2024-03-07T07:31:23.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.782+0000 7fcc0a800640 1 -- start start 2024-03-07T07:31:23.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc0a800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcc04145a30 0x7fcc040729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc0a800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0406d230 0x7fcc04072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc0a800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0406d780 con 0x7fcc040a9540 2024-03-07T07:31:23.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc0a800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0406da60 con 0x7fcc04145a30 2024-03-07T07:31:23.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc0a800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0406dd40 con 0x7fcc0406d230 2024-03-07T07:31:23.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc03e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0406d230 0x7fcc04072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc03e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0406d230 0x7fcc04072f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:45964/0 (socket says 172.21.15.84:45964) 2024-03-07T07:31:23.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc03400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcc04145a30 0x7fcc040729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc03e00640 1 -- 172.21.15.84:0/3074940597 learned_addr learned my addr 172.21.15.84:0/3074940597 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:23.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc03e00640 1 -- 172.21.15.84:0/3074940597 >> v2:172.21.15.161:3300/0 conn(0x7fcc04145a30 msgr2=0x7fcc040729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:23.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc03e00640 1 --2- 172.21.15.84:0/3074940597 >> v2:172.21.15.161:3300/0 conn(0x7fcc04145a30 0x7fcc040729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc03e00640 1 -- 172.21.15.84:0/3074940597 >> v1:172.21.15.161:6789/0 conn(0x7fcc040a9540 legacy=0x7fcc040ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.786+0000 7fcc03e00640 1 -- 172.21.15.84:0/3074940597 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0406e020 con 0x7fcc0406d230 2024-03-07T07:31:23.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc03e00640 1 --2- 172.21.15.84:0/3074940597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0406d230 0x7fcc04072f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009e50 tx=0x7fcbfc01c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24711a4769249633 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc02a00640 1 -- 172.21.15.84:0/3074940597 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0a56e0 con 0x7fcc0406d230 2024-03-07T07:31:23.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc02a00640 1 -- 172.21.15.84:0/3074940597 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0a5880 con 0x7fcc0406d230 2024-03-07T07:31:23.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc02a00640 1 -- 172.21.15.84:0/3074940597 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0a5c50 con 0x7fcc0406d230 2024-03-07T07:31:23.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 -- 172.21.15.84:0/3074940597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0406d230 msgr2=0x7fcc04072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 --2- 172.21.15.84:0/3074940597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0406d230 0x7fcc04072f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009e50 tx=0x7fcbfc01c910 comp rx=0 tx=0).stop 2024-03-07T07:31:23.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 -- 172.21.15.84:0/3074940597 shutdown_connections 2024-03-07T07:31:23.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 --2- 172.21.15.84:0/3074940597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc0406d230 0x7fcc04072f10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 --2- 172.21.15.84:0/3074940597 >> v2:172.21.15.161:3300/0 conn(0x7fcc04145a30 0x7fcc040729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 -- 172.21.15.84:0/3074940597 >> 172.21.15.84:0/3074940597 conn(0x7fcc040704b0 msgr2=0x7fcc040708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:23.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 -- 172.21.15.84:0/3074940597 shutdown_connections 2024-03-07T07:31:23.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 -- 172.21.15.84:0/3074940597 wait complete. 2024-03-07T07:31:23.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 Processor -- start 2024-03-07T07:31:23.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 -- start start 2024-03-07T07:31:23.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0406d230 0x7fcc0415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.790+0000 7fcc0a800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc04145a30 0x7fcc041426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc0a800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc04142bf0 0x7fcc04163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc0a800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc04168d60 con 0x7fcc0406d230 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc0a800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc04168be0 con 0x7fcc04145a30 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc0a800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc04168ee0 con 0x7fcc04142bf0 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0406d230 0x7fcc0415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0406d230 0x7fcc0415bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49878/0 (socket says 172.21.15.84:49878) 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 -- 172.21.15.84:0/510103751 learned_addr learned my addr 172.21.15.84:0/510103751 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03e00640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc04142bf0 0x7fcc04163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcbfaa00640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc04145a30 0x7fcc041426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 -- 172.21.15.84:0/510103751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc04142bf0 msgr2=0x7fcc04163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc04142bf0 0x7fcc04163da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 -- 172.21.15.84:0/510103751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc04145a30 msgr2=0x7fcc041426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc04145a30 0x7fcc041426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 -- 172.21.15.84:0/510103751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc041f7830 con 0x7fcc0406d230 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc03400640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0406d230 0x7fcc0415bd70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400e9b0 tx=0x7fcbf400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcbfbe00640 1 -- 172.21.15.84:0/510103751 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4017070 con 0x7fcc0406d230 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcbfbe00640 1 -- 172.21.15.84:0/510103751 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf400c9a0 con 0x7fcc0406d230 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc041f7b10 con 0x7fcc0406d230 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcbfbe00640 1 -- 172.21.15.84:0/510103751 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400cd70 con 0x7fcc0406d230 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc041f80d0 con 0x7fcc0406d230 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc04143000 con 0x7fcc0406d230 2024-03-07T07:31:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcbfbe00640 1 -- 172.21.15.84:0/510103751 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fcbf401a070 con 0x7fcc0406d230 2024-03-07T07:31:23.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.794+0000 7fcbfbe00640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcbe0066f60 0x7fcbe0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:23.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.798+0000 7fcbfbe00640 1 -- 172.21.15.84:0/510103751 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbf40853e0 con 0x7fcc0406d230 2024-03-07T07:31:23.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.798+0000 7fcbfaa00640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcbe0066f60 0x7fcbe0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:23.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.798+0000 7fcbfaa00640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcbe0066f60 0x7fcbe0069420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcc040ae4a0 tx=0x7fcbec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:23.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.798+0000 7fcbfbe00640 1 -- 172.21.15.84:0/510103751 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fcc04143000 con 0x7fcc0406d230 2024-03-07T07:31:23.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.954+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc04062d40 con 0x7fcc0406d230 2024-03-07T07:31:23.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcbfbe00640 1 -- 172.21.15.84:0/510103751 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7fcbf4055da0 con 0x7fcc0406d230 2024-03-07T07:31:23.961 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:23.961 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:23.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcbe0066f60 msgr2=0x7fcbe0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcbe0066f60 0x7fcbe0069420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcc040ae4a0 tx=0x7fcbec009040 comp rx=0 tx=0).stop 2024-03-07T07:31:23.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0406d230 msgr2=0x7fcc0415bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:23.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0406d230 0x7fcc0415bd70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400e9b0 tx=0x7fcbf400ee70 comp rx=0 tx=0).stop 2024-03-07T07:31:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 shutdown_connections 2024-03-07T07:31:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcbe0066f60 0x7fcbe0069420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc04142bf0 0x7fcc04163da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc04145a30 0x7fcc041426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 --2- 172.21.15.84:0/510103751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0406d230 0x7fcc0415bd70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 >> 172.21.15.84:0/510103751 conn(0x7fcc040704b0 msgr2=0x7fcc04072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 shutdown_connections 2024-03-07T07:31:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:23.958+0000 7fcc0a800640 1 -- 172.21.15.84:0/510103751 wait complete. 2024-03-07T07:31:23.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-07T07:31:23.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-07T07:31:23.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-07T07:31:23.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-07T07:31:23.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-07T07:31:23.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-07T07:31:23.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-07T07:31:23.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-07T07:31:24.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.222+0000 7f9a31c00640 1 Processor -- start 2024-03-07T07:31:24.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.222+0000 7f7df2200640 1 Processor -- start 2024-03-07T07:31:24.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.222+0000 7f9a31c00640 1 -- start start 2024-03-07T07:31:24.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.222+0000 7f7df2200640 1 -- start start 2024-03-07T07:31:24.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7416c00640 1 Processor -- start 2024-03-07T07:31:24.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7416c00640 1 -- start start 2024-03-07T07:31:24.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7df2200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de40540b0 0x7f7de4006f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7df2200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de4057df0 con 0x7f7de40e32e0 2024-03-07T07:31:24.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7df2200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de40580d0 con 0x7f7de4053c20 2024-03-07T07:31:24.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7df2200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de403bfd0 con 0x7f7de40540b0 2024-03-07T07:31:24.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7debe00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7de4053c20 0x7f7de4006800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41318/0 (socket says 172.21.15.84:41318) 2024-03-07T07:31:24.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7debe00640 1 -- 172.21.15.84:0/550585794 learned_addr learned my addr 172.21.15.84:0/550585794 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a31c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cd420 0x7f9a2c073150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a31c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0723d0 con 0x7f9a2c0af350 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a31c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0cfab0 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a31c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c072cc0 con 0x7f9a2c0cd420 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a2aa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cd420 0x7f9a2c073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a2b400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9a2c0cdf10 0x7f9a2c15c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41310/0 (socket says 172.21.15.84:41310) 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a2b400640 1 -- 172.21.15.84:0/792004644 learned_addr learned my addr 172.21.15.84:0/792004644 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7416c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7410071600 0x7f74100d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7416c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7410071b00 con 0x7f7410162750 2024-03-07T07:31:24.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7416c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7410071de0 con 0x7f7410162370 2024-03-07T07:31:24.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7416c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74100720c0 con 0x7f7410071600 2024-03-07T07:31:24.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a2aa00640 1 -- 172.21.15.84:0/792004644 >> v1:172.21.15.161:6789/0 conn(0x7f9a2c0cdf10 legacy=0x7f9a2c15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f740fe00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7410162370 0x7f7410072ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41324/0 (socket says 172.21.15.84:41324) 2024-03-07T07:31:24.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f740fe00640 1 -- 172.21.15.84:0/1756924490 learned_addr learned my addr 172.21.15.84:0/1756924490 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a2aa00640 1 -- 172.21.15.84:0/792004644 >> v1:172.21.15.84:6789/0 conn(0x7f9a2c0af350 legacy=0x7f9a2c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f9a2aa00640 1 -- 172.21.15.84:0/792004644 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c072670 con 0x7f9a2c0cd420 2024-03-07T07:31:24.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.226+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305654038 0 0) 0x7f7de40580d0 con 0x7f7de4053c20 2024-03-07T07:31:24.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd4003530 con 0x7f7de4053c20 2024-03-07T07:31:24.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7414c00640 1 --2- 172.21.15.84:0/1756924490 >> v2:172.21.15.161:3300/0 conn(0x7f7410071600 0x7f74100d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2560011147 0 0) 0x7f7dd4003530 con 0x7f7de4053c20 2024-03-07T07:31:24.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7414c00640 1 -- 172.21.15.84:0/1756924490 >> v1:172.21.15.161:6789/0 conn(0x7f7410162370 legacy=0x7f7410072ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7414c00640 1 -- 172.21.15.84:0/1756924490 >> v1:172.21.15.84:6789/0 conn(0x7f7410162750 legacy=0x7f74100d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 >> v2:172.21.15.84:3300/0 conn(0x7f7de40540b0 msgr2=0x7f7de4006f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 --2- 172.21.15.84:0/550585794 >> v2:172.21.15.84:3300/0 conn(0x7f7de40540b0 0x7f7de4006f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 >> v1:172.21.15.84:6789/0 conn(0x7f7de40e32e0 legacy=0x7f7de403e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40583b0 con 0x7f7de4053c20 2024-03-07T07:31:24.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f7dd8001680 con 0x7f7de4053c20 2024-03-07T07:31:24.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 >> v1:172.21.15.161:6789/0 conn(0x7f7de4053c20 legacy=0x7f7de4006800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7dd4003a10 0x7f7dd4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dd4004810 0x7f7dd4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd40052f0 0x7f7dd40141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd4014a20 con 0x7f7dd40052f0 2024-03-07T07:31:24.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd4014bd0 con 0x7f7dd4004810 2024-03-07T07:31:24.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd4014dd0 con 0x7f7dd4003a10 2024-03-07T07:31:24.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7414c00640 1 -- 172.21.15.84:0/1756924490 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100723a0 con 0x7f7410071600 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7debe00640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dd4004810 0x7f7dd4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7df0e00640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7dd4003a10 0x7f7dd4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7df0e00640 1 -- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dd4004810 msgr2=0x7f7dd4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7df0e00640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dd4004810 0x7f7dd4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7df0e00640 1 -- 172.21.15.84:0/550585794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd40052f0 msgr2=0x7f7dd40141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7df0e00640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd40052f0 0x7f7dd40141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7df0e00640 1 -- 172.21.15.84:0/550585794 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4003530 con 0x7f7dd4003a10 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.230+0000 7f7df1800640 1 -- 172.21.15.84:0/550585794 reap_dead start 2024-03-07T07:31:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0903e00640 1 Processor -- start 2024-03-07T07:31:24.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c74000640 1 Processor -- start 2024-03-07T07:31:24.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0903e00640 1 -- start start 2024-03-07T07:31:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a2aa00640 1 --2- 172.21.15.84:0/792004644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cd420 0x7f9a2c073150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c072e40 tx=0x7f9a1c01c200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65eef736bf99a13 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a29600640 1 -- 172.21.15.84:0/792004644 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0b0070 con 0x7f9a2c0cd420 2024-03-07T07:31:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a29600640 1 -- 172.21.15.84:0/792004644 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c0ab400 con 0x7f9a2c0cd420 2024-03-07T07:31:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c74000640 1 -- start start 2024-03-07T07:31:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a29600640 1 -- 172.21.15.84:0/792004644 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0b0070 con 0x7f9a2c0cd420 2024-03-07T07:31:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f7414c00640 1 --2- 172.21.15.84:0/1756924490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410071600 0x7f74100d1430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7408009d90 tx=0x7f740801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=601325a991d04a4a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a31c00640 1 -- 172.21.15.84:0/792004644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cd420 msgr2=0x7f9a2c073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a31c00640 1 --2- 172.21.15.84:0/792004644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cd420 0x7f9a2c073150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c072e40 tx=0x7f9a1c01c200 comp rx=0 tx=0).stop 2024-03-07T07:31:24.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a31c00640 1 -- 172.21.15.84:0/792004644 shutdown_connections 2024-03-07T07:31:24.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a31c00640 1 --2- 172.21.15.84:0/792004644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cd420 0x7f9a2c073150 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a31c00640 1 -- 172.21.15.84:0/792004644 >> 172.21.15.84:0/792004644 conn(0x7f9a2c0b2fa0 msgr2=0x7f9a2c0b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f740f400640 1 -- 172.21.15.84:0/1756924490 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080b2070 con 0x7f7410071600 2024-03-07T07:31:24.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f740f400640 1 -- 172.21.15.84:0/1756924490 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74080a58d0 con 0x7f7410071600 2024-03-07T07:31:24.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f740f400640 1 -- 172.21.15.84:0/1756924490 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080a5ca0 con 0x7f7410071600 2024-03-07T07:31:24.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0903e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f08fc0e6cd0 0x7f08fc053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0903e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc0e7a90 con 0x7f08fc03c100 2024-03-07T07:31:24.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0903e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc054530 con 0x7f08fc053750 2024-03-07T07:31:24.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0903e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc0e3640 con 0x7f08fc0e6cd0 2024-03-07T07:31:24.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7fa34fe00640 1 Processor -- start 2024-03-07T07:31:24.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a31c00640 1 -- 172.21.15.84:0/792004644 shutdown_connections 2024-03-07T07:31:24.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7fa34fe00640 1 -- start start 2024-03-07T07:31:24.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c74000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c144360 0x7f2c6c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0902000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f08fc053750 0x7f08fc0e70b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41328/0 (socket says 172.21.15.84:41328) 2024-03-07T07:31:24.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c74000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c0cc880 con 0x7f2c6c0730e0 2024-03-07T07:31:24.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c74000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c0ccb60 con 0x7f2c6c143dd0 2024-03-07T07:31:24.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c74000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1441b0 con 0x7f2c6c144360 2024-03-07T07:31:24.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0903400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f08fc03c100 0x7f08fc006f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33660/0 (socket says 172.21.15.84:33660) 2024-03-07T07:31:24.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f0903400640 1 -- 172.21.15.84:0/1036094100 learned_addr learned my addr 172.21.15.84:0/1036094100 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c71600640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2c6c143dd0 0x7f2c6c0729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41344/0 (socket says 172.21.15.84:41344) 2024-03-07T07:31:24.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c71600640 1 -- 172.21.15.84:0/3241517690 learned_addr learned my addr 172.21.15.84:0/3241517690 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f9a31c00640 1 -- 172.21.15.84:0/792004644 wait complete. 2024-03-07T07:31:24.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.234+0000 7f2c72000640 1 --2- 172.21.15.84:0/3241517690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c144360 0x7f2c6c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7416c00640 1 -- 172.21.15.84:0/1756924490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410071600 msgr2=0x7f74100d1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f2c72000640 1 -- 172.21.15.84:0/3241517690 >> v1:172.21.15.161:6789/0 conn(0x7f2c6c143dd0 legacy=0x7f2c6c0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f2c72000640 1 -- 172.21.15.84:0/3241517690 >> v1:172.21.15.84:6789/0 conn(0x7f2c6c0730e0 legacy=0x7f2c6c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f2c72000640 1 -- 172.21.15.84:0/3241517690 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0cce40 con 0x7f2c6c144360 2024-03-07T07:31:24.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26983992 0 0) 0x7f08fc054530 con 0x7f08fc053750 2024-03-07T07:31:24.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e8003530 con 0x7f08fc053750 2024-03-07T07:31:24.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738862682 0 0) 0x7f08fc0e7a90 con 0x7f08fc03c100 2024-03-07T07:31:24.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc054530 con 0x7f08fc03c100 2024-03-07T07:31:24.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa348147750 0x7fa348161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3480aece0 0x7fa348071f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34fe00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa348162140 con 0x7fa34815e520 2024-03-07T07:31:24.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34fe00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa348071af0 con 0x7fa348147750 2024-03-07T07:31:24.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34fe00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa348162420 con 0x7fa3480aece0 2024-03-07T07:31:24.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876646660 0 0) 0x7f08e8003530 con 0x7f08fc053750 2024-03-07T07:31:24.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 >> v2:172.21.15.161:3300/0 conn(0x7f08fc0e6cd0 msgr2=0x7f08fc053f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f9a31c00640 1 Processor -- start 2024-03-07T07:31:24.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7416c00640 1 --2- 172.21.15.84:0/1756924490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410071600 0x7f74100d1430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7408009d90 tx=0x7f740801c900 comp rx=0 tx=0).stop 2024-03-07T07:31:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902a00640 1 --2- 172.21.15.84:0/1036094100 >> v2:172.21.15.161:3300/0 conn(0x7f08fc0e6cd0 0x7f08fc053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f9a31c00640 1 -- start start 2024-03-07T07:31:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7416c00640 1 -- 172.21.15.84:0/1756924490 shutdown_connections 2024-03-07T07:31:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7416c00640 1 --2- 172.21.15.84:0/1756924490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410071600 0x7f74100d1430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7416c00640 1 -- 172.21.15.84:0/1756924490 >> 172.21.15.84:0/1756924490 conn(0x7f74100704b0 msgr2=0x7f74100708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 --2- 172.21.15.84:0/1036094100 >> v2:172.21.15.161:3300/0 conn(0x7f08fc0e6cd0 0x7f08fc053f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 >> v1:172.21.15.84:6789/0 conn(0x7f08fc03c100 legacy=0x7f08fc006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc006420 con 0x7f08fc053750 2024-03-07T07:31:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902a00640 1 --2- 172.21.15.84:0/1036094100 >> v2:172.21.15.161:3300/0 conn(0x7f08fc0e6cd0 0x7f08fc053f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:24.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7416c00640 1 -- 172.21.15.84:0/1756924490 shutdown_connections 2024-03-07T07:31:24.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7416c00640 1 -- 172.21.15.84:0/1756924490 wait complete. 2024-03-07T07:31:24.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f08f4001680 con 0x7f08fc053750 2024-03-07T07:31:24.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 >> v1:172.21.15.161:6789/0 conn(0x7f08fc053750 legacy=0x7f08fc0e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08e8004bb0 0x7f08e8004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34de00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3480aece0 0x7fa348071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34ca00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa34815e520 0x7fa3480ae5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33664/0 (socket says 172.21.15.84:33664) 2024-03-07T07:31:24.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34ca00640 1 -- 172.21.15.84:0/3059055739 learned_addr learned my addr 172.21.15.84:0/3059055739 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e80037b0 0x7f08e8003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f05d5a00640 1 Processor -- start 2024-03-07T07:31:24.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34d400640 1 --2- 172.21.15.84:0/3059055739 >> v2:172.21.15.161:3300/0 conn(0x7fa348147750 0x7fa348161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e8004170 0x7f08e800ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e800c0c0 con 0x7f08e8004bb0 2024-03-07T07:31:24.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e800c270 con 0x7f08e8004170 2024-03-07T07:31:24.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e800c470 con 0x7f08e80037b0 2024-03-07T07:31:24.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902a00640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08e8004bb0 0x7f08e8004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902000640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e80037b0 0x7f08e8003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0903400640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e8004170 0x7f08e800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7df0e00640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7dd4003a10 0x7f7dd4003e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7de0007fd0 tx=0x7f7de001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a3c0d2150284d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0001250 con 0x7f7dd4003a10 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de0005270 con 0x7f7dd4003a10 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7deb400640 1 -- 172.21.15.84:0/550585794 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0003860 con 0x7f7dd4003a10 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7df2200640 1 -- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7dd4003a10 msgr2=0x7f7dd4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7df2200640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7dd4003a10 0x7f7dd4003e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7de0007fd0 tx=0x7f7de001c2e0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7df2200640 1 -- 172.21.15.84:0/550585794 shutdown_connections 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7df2200640 1 --2- 172.21.15.84:0/550585794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7dd4003a10 0x7f7dd4003e10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f7df2200640 1 -- 172.21.15.84:0/550585794 >> 172.21.15.84:0/550585794 conn(0x7f7de40559f0 msgr2=0x7f7de4055e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa347e00640 1 -- 172.21.15.84:0/3059055739 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160348204 0 0) 0x7fa348162140 con 0x7fa34815e520 2024-03-07T07:31:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa347e00640 1 -- 172.21.15.84:0/3059055739 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa330003530 con 0x7fa34815e520 2024-03-07T07:31:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7fa34d400640 1 -- 172.21.15.84:0/3059055739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3480aece0 msgr2=0x7fa348071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cfa00640 1 Processor -- start 2024-03-07T07:31:24.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cfa00640 1 -- start start 2024-03-07T07:31:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902000640 1 -- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e8004170 msgr2=0x7f08e800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902000640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e8004170 0x7f08e800ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902000640 1 -- 172.21.15.84:0/1036094100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08e8004bb0 msgr2=0x7f08e8004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902000640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08e8004bb0 0x7f08e8004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f7df2200640 1 -- 172.21.15.84:0/550585794 shutdown_connections 2024-03-07T07:31:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f7df2200640 1 -- 172.21.15.84:0/550585794 wait complete. 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f0902000640 1 -- 172.21.15.84:0/1036094100 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc006420 con 0x7f08e80037b0 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f0903400640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08e8004170 0x7f08e800ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f0903400640 1 -- 172.21.15.84:0/1036094100 reap_dead start 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a31c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a2c0af350 0x7f9a2c0ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a31c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2c0cd420 0x7f9a2c0ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a31c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cdf10 0x7f9a2c138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a31c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c167d20 con 0x7f9a2c0af350 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a31c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c167ba0 con 0x7f9a2c0cd420 2024-03-07T07:31:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a31c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c167ea0 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fa347e00640 1 -- 172.21.15.84:0/3059055739 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292684217 0 0) 0x7fa330003530 con 0x7fa34815e520 2024-03-07T07:31:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fa34d400640 1 --2- 172.21.15.84:0/3059055739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3480aece0 0x7fa348071f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fa34d400640 1 -- 172.21.15.84:0/3059055739 >> v1:172.21.15.84:6789/0 conn(0x7fa34815e520 legacy=0x7fa3480ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fa34d400640 1 -- 172.21.15.84:0/3059055739 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa348162700 con 0x7fa348147750 2024-03-07T07:31:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fa34de00640 1 --2- 172.21.15.84:0/3059055739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3480aece0 0x7fa348071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.238+0000 7f05d5a00640 1 -- start start 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05d5a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f05d01628e0 0x7f05d00cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05d5a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d0072730 con 0x7f05d006cbd0 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05d5a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d0072a10 con 0x7f05d00cfd60 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05d5a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d015ce50 con 0x7f05d01628e0 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05cea00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f05d00cfd60 0x7f05d0071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41350/0 (socket says 172.21.15.84:41350) 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05cea00640 1 -- 172.21.15.84:0/2680833507 learned_addr learned my addr 172.21.15.84:0/2680833507 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cdf10 0x7f9a2c138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cdf10 0x7f9a2c138540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46028/0 (socket says 172.21.15.84:46028) 2024-03-07T07:31:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2b400640 1 -- 172.21.15.84:0/3550927289 learned_addr learned my addr 172.21.15.84:0/3550927289 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05c6000640 1 --2- 172.21.15.84:0/2680833507 >> v2:172.21.15.161:3300/0 conn(0x7f05d01628e0 0x7f05d00cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cfa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c80ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cfa00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3c806e380 0x7fc3c806e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2a000640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2c0cd420 0x7f9a2c0ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143253307 0 0) 0x7f05d0072a10 con 0x7f05d00cfd60 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b4003530 con 0x7f05d00cfd60 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18036083 0 0) 0x7f05b4003530 con 0x7f05d00cfd60 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 >> v2:172.21.15.161:3300/0 conn(0x7f05d01628e0 msgr2=0x7f05d00cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 --2- 172.21.15.84:0/2680833507 >> v2:172.21.15.161:3300/0 conn(0x7f05d01628e0 0x7f05d00cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 >> v1:172.21.15.84:6789/0 conn(0x7f05d006cbd0 legacy=0x7f05d00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0072cf0 con 0x7f05d00cfd60 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f05c0001a00 con 0x7f05d00cfd60 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 >> v1:172.21.15.161:6789/0 conn(0x7f05d00cfd60 legacy=0x7f05d0071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b40039c0 0x7f05b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b4004810 0x7f05b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40051d0 0x7f05b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d015ce50 con 0x7f05b40051d0 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b400c120 con 0x7f05b40039c0 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b400c320 con 0x7f05b4004810 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cfa00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c80ad4d0 con 0x7fc3c8144900 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cfa00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c8073370 con 0x7fc3c806e380 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cfa00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80ad770 con 0x7fc3c80707e0 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cda00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3c806e380 0x7fc3c806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cda00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3c806e380 0x7fc3c806e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49920/0 (socket says 172.21.15.84:49920) 2024-03-07T07:31:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3cda00640 1 -- 172.21.15.84:0/2648025696 learned_addr learned my addr 172.21.15.84:0/2648025696 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2b400640 1 -- 172.21.15.84:0/3550927289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2c0cd420 msgr2=0x7f9a2c0ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2b400640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2c0cd420 0x7f9a2c0ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2b400640 1 -- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a2c0af350 msgr2=0x7f9a2c0ac060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f7416c00640 1 Processor -- start 2024-03-07T07:31:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05c6000640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b4004810 0x7f05b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05cea00640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b40039c0 0x7f05b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7fc3c7e00640 1 --2- 172.21.15.84:0/2648025696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c80ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f7df2200640 1 Processor -- start 2024-03-07T07:31:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2aa00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a2c0af350 0x7f9a2c0ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df2200640 1 -- start start 2024-03-07T07:31:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2b400640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a2c0af350 0x7f9a2c0ac060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f9a2b400640 1 -- 172.21.15.84:0/3550927289 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0ad070 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f9a2aa00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a2c0af350 0x7f9a2c0ac060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f9a2b400640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cdf10 0x7f9a2c138540 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9a24010fa0 tx=0x7f9a24015570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2401d420 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2401d5c0 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2401d9f0 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0902000640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e80037b0 0x7f08e8003c30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c190 tx=0x7f08f401cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e6cbb918f9eafd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4007c80 con 0x7f08e80037b0 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f40a9070 con 0x7f08e80037b0 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0901600640 1 -- 172.21.15.84:0/1036094100 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40074f0 con 0x7f08e80037b0 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05c6000640 1 -- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b40039c0 msgr2=0x7f05b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05c6000640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b40039c0 0x7f05b4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05c6000640 1 -- 172.21.15.84:0/2680833507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40051d0 msgr2=0x7f05b400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05c6000640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40051d0 0x7f05b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.242+0000 7f05c6000640 1 -- 172.21.15.84:0/2680833507 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0072cf0 con 0x7f05b4004810 2024-03-07T07:31:24.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f05cf400640 1 -- 172.21.15.84:0/2680833507 reap_dead start 2024-03-07T07:31:24.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fc3cda00640 1 -- 172.21.15.84:0/2648025696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 msgr2=0x7fc3c80ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fc3cda00640 1 --2- 172.21.15.84:0/2648025696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c80ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fc3cda00640 1 -- 172.21.15.84:0/2648025696 >> v1:172.21.15.84:6789/0 conn(0x7fc3c8144900 legacy=0x7fc3c8072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fc3cda00640 1 -- 172.21.15.84:0/2648025696 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80ada50 con 0x7fc3c806e380 2024-03-07T07:31:24.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fc3c7e00640 1 --2- 172.21.15.84:0/2648025696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c80ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:24.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c0ad350 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0903e00640 1 -- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e80037b0 msgr2=0x7f08e8003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0903e00640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e80037b0 0x7f08e8003c30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c190 tx=0x7f08f401cb60 comp rx=0 tx=0).stop 2024-03-07T07:31:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fa34d400640 1 --2- 172.21.15.84:0/3059055739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa348147750 0x7fa348161b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa340009d90 tx=0x7fa34001c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca787bc32e2bef8a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd4003a10 0x7f7de40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7416c00640 1 -- start start 2024-03-07T07:31:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f2c72000640 1 --2- 172.21.15.84:0/3241517690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c144360 0x7f2c6c0cdc00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2c640097f0 tx=0x7f2c6401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60162d571f9e4af4 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0903e00640 1 -- 172.21.15.84:0/1036094100 shutdown_connections 2024-03-07T07:31:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0903e00640 1 --2- 172.21.15.84:0/1036094100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08e80037b0 0x7f08e8003c30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0903e00640 1 -- 172.21.15.84:0/1036094100 >> 172.21.15.84:0/1036094100 conn(0x7f08fc058ef0 msgr2=0x7f08fc059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df2200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de404c9d0 0x7f7de40e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c0ad910 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df2200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de404ce30 0x7f7de40e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4057a50 con 0x7f7dd4003a10 2024-03-07T07:31:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df2200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4054500 con 0x7f7de404ce30 2024-03-07T07:31:24.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df2200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4057bd0 con 0x7f7de404c9d0 2024-03-07T07:31:24.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7debe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de404c9d0 0x7f7de40e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f2c6be00640 1 -- 172.21.15.84:0/3241517690 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640ab5f0 con 0x7f2c6c144360 2024-03-07T07:31:24.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd4003a10 0x7f7de40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7debe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de404c9d0 0x7f7de40e5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46056/0 (socket says 172.21.15.84:46056) 2024-03-07T07:31:24.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7debe00640 1 -- 172.21.15.84:0/1531700223 learned_addr learned my addr 172.21.15.84:0/1531700223 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df1800640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de404ce30 0x7f7de40e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f2c6be00640 1 -- 172.21.15.84:0/3241517690 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c640b0070 con 0x7f2c6c144360 2024-03-07T07:31:24.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f2c6be00640 1 -- 172.21.15.84:0/3241517690 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640ab9b0 con 0x7f2c6c144360 2024-03-07T07:31:24.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f0903e00640 1 -- 172.21.15.84:0/1036094100 shutdown_connections 2024-03-07T07:31:24.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fa347e00640 1 -- 172.21.15.84:0/3059055739 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400b2070 con 0x7fa348147750 2024-03-07T07:31:24.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fa347e00640 1 -- 172.21.15.84:0/3059055739 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3400a5680 con 0x7fa348147750 2024-03-07T07:31:24.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7fa347e00640 1 -- 172.21.15.84:0/3059055739 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334001680 con 0x7fa348147750 2024-03-07T07:31:24.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7416c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410071600 0x7f74101545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7416c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7410162370 0x7f74101589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df0e00640 1 -- 172.21.15.84:0/1531700223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de404c9d0 msgr2=0x7f7de40e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df0e00640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de404c9d0 0x7f7de40e5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df0e00640 1 -- 172.21.15.84:0/1531700223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de404ce30 msgr2=0x7f7de40e5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df0e00640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de404ce30 0x7f7de40e5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df0e00640 1 -- 172.21.15.84:0/1531700223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40e3800 con 0x7f7dd4003a10 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7416c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410162750 0x7f7410158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7416c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100b65f0 con 0x7f7410071600 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7416c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100b6470 con 0x7f7410162750 2024-03-07T07:31:24.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7416c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7410170480 con 0x7f7410162370 2024-03-07T07:31:24.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7df1800640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de404ce30 0x7f7de40e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:24.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7407400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7410162370 0x7f74101589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7407400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7410162370 0x7f74101589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46062/0 (socket says 172.21.15.84:46062) 2024-03-07T07:31:24.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7414c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410162750 0x7f7410158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7414c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410162750 0x7f7410158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:50998/0 (socket says 172.21.15.84:50998) 2024-03-07T07:31:24.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.246+0000 7f7414c00640 1 -- 172.21.15.84:0/1729073313 learned_addr learned my addr 172.21.15.84:0/1729073313 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a2c062d40 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f740fe00640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410071600 0x7f74101545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05c6000640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b4004810 0x7f05b4004c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05b800ba30 tx=0x7f05b801c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c726f0f47ea6e68 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7414c00640 1 -- 172.21.15.84:0/1729073313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7410162370 msgr2=0x7f74101589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7414c00640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7410162370 0x7f74101589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7414c00640 1 -- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410071600 msgr2=0x7f74101545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7414c00640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410071600 0x7f74101545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7414c00640 1 -- 172.21.15.84:0/1729073313 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741015e640 con 0x7f7410162750 2024-03-07T07:31:24.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 -- 172.21.15.84:0/3241517690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c144360 msgr2=0x7f2c6c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 --2- 172.21.15.84:0/3241517690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c144360 0x7f2c6c0cdc00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2c640097f0 tx=0x7f2c6401c500 comp rx=0 tx=0).stop 2024-03-07T07:31:24.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7407400640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7410162370 0x7f74101589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:24.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 -- 172.21.15.84:0/3241517690 shutdown_connections 2024-03-07T07:31:24.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 --2- 172.21.15.84:0/3241517690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c144360 0x7f2c6c0cdc00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 -- 172.21.15.84:0/3241517690 >> 172.21.15.84:0/3241517690 conn(0x7f2c6c0704b0 msgr2=0x7f2c6c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800b600 con 0x7f05b4004810 2024-03-07T07:31:24.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05ce000640 1 -- 172.21.15.84:0/2680833507 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b80aa650 con 0x7f05b4004810 2024-03-07T07:31:24.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 -- 172.21.15.84:0/3241517690 shutdown_connections 2024-03-07T07:31:24.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 -- 172.21.15.84:0/3241517690 wait complete. 2024-03-07T07:31:24.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7414c00640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410162750 0x7f7410158f10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7408019510 tx=0x7f74080196a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7df0e00640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd4003a10 0x7f7de40d0300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4014fa0 tx=0x7f7dd4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05d5a00640 1 -- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b4004810 msgr2=0x7f05b4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05d5a00640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b4004810 0x7f05b4004c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05b800ba30 tx=0x7f05b801c700 comp rx=0 tx=0).stop 2024-03-07T07:31:24.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0007a60 con 0x7f7dd4003a10 2024-03-07T07:31:24.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080b2070 con 0x7f7410162750 2024-03-07T07:31:24.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74080bf070 con 0x7f7410162750 2024-03-07T07:31:24.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080adda0 con 0x7f7410162750 2024-03-07T07:31:24.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f9a2401a070 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05d5a00640 1 -- 172.21.15.84:0/2680833507 shutdown_connections 2024-03-07T07:31:24.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de0005420 con 0x7f7dd4003a10 2024-03-07T07:31:24.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00050d0 con 0x7f7dd4003a10 2024-03-07T07:31:24.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de40e3ae0 con 0x7f7dd4003a10 2024-03-07T07:31:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de40e40a0 con 0x7f7dd4003a10 2024-03-07T07:31:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7416c00640 1 -- 172.21.15.84:0/1729073313 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741015e920 con 0x7f7410162750 2024-03-07T07:31:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7fa34fe00640 1 -- 172.21.15.84:0/3059055739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa348147750 msgr2=0x7fa348161b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7fa34fe00640 1 --2- 172.21.15.84:0/3059055739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa348147750 0x7fa348161b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa340009d90 tx=0x7fa34001c860 comp rx=0 tx=0).stop 2024-03-07T07:31:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7fa34fe00640 1 -- 172.21.15.84:0/3059055739 shutdown_connections 2024-03-07T07:31:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7fa34fe00640 1 --2- 172.21.15.84:0/3059055739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3480aece0 0x7fa348071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7fa34fe00640 1 --2- 172.21.15.84:0/3059055739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa348147750 0x7fa348161b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7fa34fe00640 1 -- 172.21.15.84:0/3059055739 >> 172.21.15.84:0/3059055739 conn(0x7fa3480b2fa0 msgr2=0x7fa3480b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f9a22a00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9a0c066fb0 0x7f9a0c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7fa34fe00640 1 -- 172.21.15.84:0/3059055739 shutdown_connections 2024-03-07T07:31:24.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7fa34fe00640 1 -- 172.21.15.84:0/3059055739 wait complete. 2024-03-07T07:31:24.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 Processor -- start 2024-03-07T07:31:24.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a2405c2e0 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f9a22a00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7f9a0c06fdd0 0x7f9a0c072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 --> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a0c072940 con 0x7f9a0c06fdd0 2024-03-07T07:31:24.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f2c74000640 1 -- start start 2024-03-07T07:31:24.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a2405ac70 con 0x7f9a2c0cdf10 2024-03-07T07:31:24.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05d5a00640 1 --2- 172.21.15.84:0/2680833507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b4004810 0x7f05b4004c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05d5a00640 1 -- 172.21.15.84:0/2680833507 >> 172.21.15.84:0/2680833507 conn(0x7f05d00674f0 msgr2=0x7f05d00704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f05d5a00640 1 -- 172.21.15.84:0/2680833507 shutdown_connections 2024-03-07T07:31:24.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3cda00640 1 --2- 172.21.15.84:0/2648025696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c806e380 0x7fc3c806e830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009e50 tx=0x7fc3c0025240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1ed1b07237a39e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f7416c00640 1 -- 172.21.15.84:0/1729073313 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741015eee0 con 0x7f7410162750 2024-03-07T07:31:24.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.250+0000 7f0903e00640 1 -- 172.21.15.84:0/1036094100 wait complete. 2024-03-07T07:31:24.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f9a2a000640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7f9a0c06fdd0 0x7f9a0c072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7de40057f0 con 0x7f7dd4003a10 2024-03-07T07:31:24.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f0903e00640 1 Processor -- start 2024-03-07T07:31:24.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3c7400640 1 -- 172.21.15.84:0/2648025696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00b9070 con 0x7fc3c806e380 2024-03-07T07:31:24.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3c7400640 1 -- 172.21.15.84:0/2648025696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c00b4400 con 0x7fc3c806e380 2024-03-07T07:31:24.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3c7400640 1 -- 172.21.15.84:0/2648025696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00b47d0 con 0x7fc3c806e380 2024-03-07T07:31:24.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c74000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c0730e0 0x7f2c6c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c74000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c6c143dd0 0x7f2c6c157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c74000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c6c144360 0x7f2c6c13ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c74000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c15c0b0 con 0x7f2c6c144360 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c74000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c15bf30 con 0x7f2c6c143dd0 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c74000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c06d230 con 0x7f2c6c0730e0 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c0730e0 0x7f2c6c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c0730e0 0x7f2c6c0b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46064/0 (socket says 172.21.15.84:46064) 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 -- 172.21.15.84:0/1043861684 learned_addr learned my addr 172.21.15.84:0/1043861684 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c72000640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c6c144360 0x7f2c6c13ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 -- 172.21.15.84:0/1043861684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c6c143dd0 msgr2=0x7f2c6c157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c6c143dd0 0x7f2c6c157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 -- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c6c144360 msgr2=0x7f2c6c13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c6c144360 0x7f2c6c13ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 -- 172.21.15.84:0/1043861684 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0ce530 con 0x7f2c6c0730e0 2024-03-07T07:31:24.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fa34fe00640 1 Processor -- start 2024-03-07T07:31:24.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fa34fe00640 1 -- start start 2024-03-07T07:31:24.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f74080b9480 con 0x7f7410162750 2024-03-07T07:31:24.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f7416c00640 1 -- 172.21.15.84:0/1729073313 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f741015e3f0 con 0x7f7410162750 2024-03-07T07:31:24.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f05d5a00640 1 -- 172.21.15.84:0/2680833507 wait complete. 2024-03-07T07:31:24.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3cfa00640 1 -- 172.21.15.84:0/2648025696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c806e380 msgr2=0x7fc3c806e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3cfa00640 1 --2- 172.21.15.84:0/2648025696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c806e380 0x7fc3c806e830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009e50 tx=0x7fc3c0025240 comp rx=0 tx=0).stop 2024-03-07T07:31:24.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f9a2aa00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9a0c066fb0 0x7f9a0c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3cfa00640 1 -- 172.21.15.84:0/2648025696 shutdown_connections 2024-03-07T07:31:24.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3cfa00640 1 --2- 172.21.15.84:0/2648025696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c806e380 0x7fc3c806e830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3cfa00640 1 --2- 172.21.15.84:0/2648025696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c80ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fc3cfa00640 1 -- 172.21.15.84:0/2648025696 >> 172.21.15.84:0/2648025696 conn(0x7fc3c80b1e30 msgr2=0x7fc3c80b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f2c71600640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c0730e0 0x7f2c6c0b00e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000cbd0 tx=0x7f2c6000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f7de00069c0 con 0x7f7dd4003a10 2024-03-07T07:31:24.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f7de8c00640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7dcc066fe0 0x7f7dcc0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f05d5a00640 1 Processor -- start 2024-03-07T07:31:24.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f9a2aa00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9a0c066fb0 0x7f9a0c069470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0ad000 tx=0x7f9a1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f0903e00640 1 -- start start 2024-03-07T07:31:24.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f9a2a000640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7f9a0c06fdd0 0x7f9a0c072270 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3480aece0 0x7fa34815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348147750 0x7fa348142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7de011cc60 con 0x7f7dd4003a10 2024-03-07T07:31:24.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f740cc00640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73ec066fb0 0x7f73ec069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.254+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7408002020 con 0x7f7410162750 2024-03-07T07:31:24.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f740cc00640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f73ec06f150 0x7f73ec071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 --> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73ec071c20 con 0x7f73ec06f150 2024-03-07T07:31:24.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f05d5a00640 1 -- start start 2024-03-07T07:31:24.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7de8c00640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f7dcc06f200 0x7f7dcc071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 --> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7de00ace50 con 0x7f7dcc06f200 2024-03-07T07:31:24.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7de0123050 con 0x7f7dd4003a10 2024-03-07T07:31:24.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60017070 con 0x7f2c6c0730e0 2024-03-07T07:31:24.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6000ad40 con 0x7f2c6c0730e0 2024-03-07T07:31:24.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60012600 con 0x7f2c6c0730e0 2024-03-07T07:31:24.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34d400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3480aece0 0x7fa34815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34d400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3480aece0 0x7fa34815d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51018/0 (socket says 172.21.15.84:51018) 2024-03-07T07:31:24.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7debe00640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7dcc066fe0 0x7f7dcc0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08e80037b0 0x7f08fc18b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc00c640 0x7f08fc00cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08fc0e4630 0x7f08fc0e4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc007aa0 con 0x7f08e80037b0 2024-03-07T07:31:24.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc007920 con 0x7f08fc00c640 2024-03-07T07:31:24.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0061d0 con 0x7f08fc0e4630 2024-03-07T07:31:24.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348147750 0x7fa348142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348147750 0x7fa348142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49974/0 (socket says 172.21.15.84:49974) 2024-03-07T07:31:24.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0902000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc00c640 0x7f08fc00cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34d400640 1 -- 172.21.15.84:0/1505785394 learned_addr learned my addr 172.21.15.84:0/1505785394 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c0afdd0 con 0x7f2c6c0730e0 2024-03-07T07:31:24.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34fe00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa34815e520 0x7fa348142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0902000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc00c640 0x7f08fc00cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51034/0 (socket says 172.21.15.84:51034) 2024-03-07T07:31:24.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0902000640 1 -- 172.21.15.84:0/1597002702 learned_addr learned my addr 172.21.15.84:0/1597002702 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903400640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08fc0e4630 0x7f08fc0e4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903400640 1 -- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc00c640 msgr2=0x7f08fc00cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903400640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc00c640 0x7f08fc00cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903400640 1 -- 172.21.15.84:0/1597002702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08e80037b0 msgr2=0x7f08fc18b860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-07T07:31:24.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7debe00640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7dcc066fe0 0x7f7dcc0694a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7de40ddd70 tx=0x7f7dd8001b70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fc3cfa00640 1 -- 172.21.15.84:0/2648025696 shutdown_connections 2024-03-07T07:31:24.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f740fe00640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73ec066fb0 0x7f73ec069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7407400640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f73ec06f150 0x7f73ec071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0902a00640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08e80037b0 0x7f08fc18b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7df1800640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f7dcc06f200 0x7f7dcc071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903400640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08e80037b0 0x7f08fc18b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903400640 1 -- 172.21.15.84:0/1597002702 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc00d400 con 0x7f08fc0e4630 2024-03-07T07:31:24.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa348072e50 con 0x7fa348147750 2024-03-07T07:31:24.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c1f3cc0 con 0x7f2c6c0730e0 2024-03-07T07:31:24.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f740fe00640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73ec066fb0 0x7f73ec069470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f73f8005890 tx=0x7f73f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74080ecde0 con 0x7f7410162750 2024-03-07T07:31:24.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903400640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08fc0e4630 0x7f08fc0e4ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0904069cd0 tx=0x7f0904074540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904074950 con 0x7f08fc0e4630 2024-03-07T07:31:24.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34de00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa34815e520 0x7fa348142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc00d6e0 con 0x7f08fc0e4630 2024-03-07T07:31:24.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc0e3e30 con 0x7f08fc0e4630 2024-03-07T07:31:24.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fc3cfa00640 1 -- 172.21.15.84:0/2648025696 wait complete. 2024-03-07T07:31:24.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f7407400640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f73ec06f150 0x7f73ec071570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08fc0053a0 con 0x7f08fc0e4630 2024-03-07T07:31:24.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090406f050 con 0x7f08fc0e4630 2024-03-07T07:31:24.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa348072cd0 con 0x7fa3480aece0 2024-03-07T07:31:24.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040008e0 con 0x7f08fc0e4630 2024-03-07T07:31:24.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f2c6001a070 con 0x7f2c6c0730e0 2024-03-07T07:31:24.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 <== osd.1 v2:172.21.15.84:6800/212168279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9a0c072940 con 0x7f9a0c06fdd0 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f05d5a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b4004810 0x7f05d00c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f05d5a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05d00c76e0 0x7f05d015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f05d5a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d015d510 0x7f05d015d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f05d5a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00d0140 con 0x7f05b4004810 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f05d5a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00d18c0 con 0x7f05d015d510 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f05d5a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00d02c0 con 0x7f05d00c76e0 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.258+0000 7f05cea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b4004810 0x7f05d00c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b4004810 0x7f05d00c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50000/0 (socket says 172.21.15.84:50000) 2024-03-07T07:31:24.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cea00640 1 -- 172.21.15.84:0/1062700870 learned_addr learned my addr 172.21.15.84:0/1062700870 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cfa00640 1 Processor -- start 2024-03-07T07:31:24.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cf400640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d015d510 0x7f05d015d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c6c062d40 con 0x7f2c6c0730e0 2024-03-07T07:31:24.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c69600640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2c4c066fb0 0x7f2c4c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cf400640 1 -- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05d00c76e0 msgr2=0x7f05d015cfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-07T07:31:24.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cf400640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05d00c76e0 0x7f05d015cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa348072fd0 con 0x7fa34815e520 2024-03-07T07:31:24.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cf400640 1 -- 172.21.15.84:0/1062700870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b4004810 msgr2=0x7f05d00c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cf400640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b4004810 0x7f05d00c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cf400640 1 -- 172.21.15.84:0/1062700870 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d015fd80 con 0x7f05d015d510 2024-03-07T07:31:24.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c60084fb0 con 0x7f2c6c0730e0 2024-03-07T07:31:24.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c69600640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7f2c4c06f1d0 0x7f2c4c0715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 --> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c4c071ca0 con 0x7f2c4c06f1d0 2024-03-07T07:31:24.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c600875d0 con 0x7f2c6c0730e0 2024-03-07T07:31:24.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c72000640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7f2c4c06f1d0 0x7f2c4c0715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 <== osd.2 v2:172.21.15.84:6824/3227098675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f73ec071c20 con 0x7f73ec06f150 2024-03-07T07:31:24.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f090404f3d0 con 0x7f08fc0e4630 2024-03-07T07:31:24.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05cf400640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d015d510 0x7f05d015d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05d0162cc0 tx=0x7f05c8001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cfa00640 1 -- start start 2024-03-07T07:31:24.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cfa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c806e380 0x7fc3c81579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cfa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c8157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cfa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8144900 0x7fc3c809d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3c7e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c8157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c70c00640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2c4c066fb0 0x7f2c4c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c72000640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7f2c4c06f1d0 0x7f2c4c0715f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cfa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80ae910 con 0x7fc3c8144900 2024-03-07T07:31:24.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cfa00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80ae790 con 0x7fc3c806e380 2024-03-07T07:31:24.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cfa00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815bd20 con 0x7fc3c80707e0 2024-03-07T07:31:24.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3c7e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c8157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46096/0 (socket says 172.21.15.84:46096) 2024-03-07T07:31:24.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3c7e00640 1 -- 172.21.15.84:0/1970466270 learned_addr learned my addr 172.21.15.84:0/1970466270 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cd000640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c806e380 0x7fc3c81579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fa34de00640 1 -- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3480aece0 msgr2=0x7fa34815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fa34de00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3480aece0 0x7fa34815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fa34de00640 1 -- 172.21.15.84:0/1505785394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348147750 msgr2=0x7fa348142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fa34de00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348147750 0x7fa348142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fa34de00640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34813dba0 con 0x7fa34815e520 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fa34d400640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3480aece0 0x7fa34815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fa34de00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa34815e520 0x7fa348142ab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00e960 tx=0x7fa33c00ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cd000640 1 -- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 msgr2=0x7fc3c8157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cd000640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c8157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cd000640 1 -- 172.21.15.84:0/1970466270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8144900 msgr2=0x7fc3c809d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cd000640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8144900 0x7fc3c809d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f7df1800640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f7dcc06f200 0x7f7dcc071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f2c70c00640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2c4c066fb0 0x7f2c4c069470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c58000f70 tx=0x7f2c580079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c017070 con 0x7fa34815e520 2024-03-07T07:31:24.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c00ca00 con 0x7fa34815e520 2024-03-07T07:31:24.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c00ce10 con 0x7fa34815e520 2024-03-07T07:31:24.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8007540 con 0x7f05d015d510 2024-03-07T07:31:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c80057d0 con 0x7f05d015d510 2024-03-07T07:31:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8005bc0 con 0x7f05d015d510 2024-03-07T07:31:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7fc3cd000640 1 -- 172.21.15.84:0/1970466270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c809b6a0 con 0x7fc3c806e380 2024-03-07T07:31:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fc3c7e00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c80707e0 0x7fc3c8157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d0160060 con 0x7f05d015d510 2024-03-07T07:31:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d0160620 con 0x7f05d015d510 2024-03-07T07:31:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34813de80 con 0x7fa34815e520 2024-03-07T07:31:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34813e440 con 0x7fa34815e520 2024-03-07T07:31:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f08faa00640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f08e4067130 0x7f08e40695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.262+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0904075010 con 0x7f08fc0e4630 2024-03-07T07:31:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f0902a00640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f08e4067130 0x7f08e40695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f08faa00640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f08e406f350 0x7f08e4071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 --> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0904074950 con 0x7f08e406f350 2024-03-07T07:31:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09040fff10 con 0x7f08fc0e4630 2024-03-07T07:31:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f0902000640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f08e406f350 0x7f08e4071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fc3cd000640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c806e380 0x7fc3c81579c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c3f0 tx=0x7fc3bc00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f0902a00640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f08e4067130 0x7f08e40695f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08fc037c60 tx=0x7f08f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa348062d40 con 0x7fa34815e520 2024-03-07T07:31:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0052d0 con 0x7fc3c806e380 2024-03-07T07:31:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc005470 con 0x7fc3c806e380 2024-03-07T07:31:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc007260 con 0x7fc3c806e380 2024-03-07T07:31:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c809b980 con 0x7fc3c806e380 2024-03-07T07:31:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f0902000640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f08e406f350 0x7f08e4071770 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c813da50 con 0x7fc3c806e380 2024-03-07T07:31:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 <== osd.3 v2:172.21.15.84:6816/201863371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2c4c071ca0 con 0x7f2c4c06f1d0 2024-03-07T07:31:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05d0062d40 con 0x7f05d015d510 2024-03-07T07:31:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 <== osd.0 v2:172.21.15.84:6803/3620020508 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7de00ace50 con 0x7f7dcc06f200 2024-03-07T07:31:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f05c8011070 con 0x7f05d015d510 2024-03-07T07:31:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3c8062d40 con 0x7fc3c806e380 2024-03-07T07:31:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 <== osd.5 v2:172.21.15.161:6824/300876994 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0904074950 con 0x7f08e406f350 2024-03-07T07:31:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05c7400640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ac066fe0 0x7f05ac0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05c80842a0 con 0x7f05d015d510 2024-03-07T07:31:24.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc3bc007400 con 0x7fc3c806e380 2024-03-07T07:31:24.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05c7400640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7f05ac06f200 0x7f05ac071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 --> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05ac071cd0 con 0x7f05ac06f200 2024-03-07T07:31:24.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05c808b050 con 0x7f05d015d510 2024-03-07T07:31:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3c4c00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3a8066f60 0x7fc3a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3bc0843e0 con 0x7fc3c806e380 2024-03-07T07:31:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.266+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa33c013470 con 0x7fa34815e520 2024-03-07T07:31:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fa345600640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa328067030 0x7fa3280694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa33c084dd0 con 0x7fa34815e520 2024-03-07T07:31:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fa345600640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7fa32806f250 0x7fa328071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa33c006880 con 0x7fa32806f250 2024-03-07T07:31:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa33c087430 con 0x7fa34815e520 2024-03-07T07:31:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05c6000640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7f05ac06f200 0x7f05ac071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05cea00640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ac066fe0 0x7f05ac0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3c4c00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7fc3a806f100 0x7fc3a8071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 --> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3a8071bd0 con 0x7fc3a806f100 2024-03-07T07:31:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3bc08b050 con 0x7fc3c806e380 2024-03-07T07:31:24.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fa34d400640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa328067030 0x7fa3280694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05c6000640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7f05ac06f200 0x7f05ac071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3c7e00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3a8066f60 0x7fc3a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fa34ca00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7fa32806f250 0x7fa328071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 <== osd.6 v2:172.21.15.161:6802/878445946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f05ac071cd0 con 0x7f05ac06f200 2024-03-07T07:31:24.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fa34d400640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa328067030 0x7fa3280694f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa340009d90 tx=0x7fa3400a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3c7e00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3a8066f60 0x7fc3a8069420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc3c81402f0 tx=0x7fc3b4011040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7f05cea00640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ac066fe0 0x7f05ac0694a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05c0001340 tx=0x7f05c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.270+0000 7fc3cda00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7fc3a806f100 0x7fc3a8071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.274+0000 7fa34ca00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7fa32806f250 0x7fa328071670 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.274+0000 7fc3cda00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7fc3a806f100 0x7fc3a8071520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.274+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 <== osd.4 v2:172.21.15.161:6800/2435467047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa33c006880 con 0x7fa32806f250 2024-03-07T07:31:24.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.274+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 <== osd.7 v2:172.21.15.161:6816/2319772910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc3a8071bd0 con 0x7fc3a806f100 2024-03-07T07:31:24.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.294+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 --> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a2c0ac600 con 0x7f9a0c06fdd0 2024-03-07T07:31:24.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.294+0000 7f9a22a00640 1 -- 172.21.15.84:0/3550927289 <== osd.1 v2:172.21.15.84:6800/212168279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a2c0ac600 con 0x7f9a0c06fdd0 2024-03-07T07:31:24.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.294+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 --> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7de4057250 con 0x7f7dcc06f200 2024-03-07T07:31:24.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.294+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 --> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c6c15b1f0 con 0x7f2c4c06f1d0 2024-03-07T07:31:24.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7f9a0c06fdd0 msgr2=0x7f9a0c072270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7f9a0c06fdd0 0x7f9a0c072270 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 --> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05d00d2fb0 con 0x7f05ac06f200 2024-03-07T07:31:24.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7de8c00640 1 -- 172.21.15.84:0/1531700223 <== osd.0 v2:172.21.15.84:6803/3620020508 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7de4057250 con 0x7f7dcc06f200 2024-03-07T07:31:24.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9a0c066fb0 msgr2=0x7f9a0c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9a0c066fb0 0x7f9a0c069470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0ad000 tx=0x7f9a1c008040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cdf10 msgr2=0x7f9a2c138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 --2- 172.21.15.84:0/3550927289 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2c0cdf10 0x7f9a2c138540 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9a24010fa0 tx=0x7f9a24015570 comp rx=0 tx=0).stop 2024-03-07T07:31:24.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a2b400640 1 -- 172.21.15.84:0/3550927289 reap_dead start 2024-03-07T07:31:24.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 shutdown_connections 2024-03-07T07:31:24.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 >> 172.21.15.84:0/3550927289 conn(0x7f9a2c0b2fa0 msgr2=0x7f9a2c15e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05c7400640 1 -- 172.21.15.84:0/1062700870 <== osd.6 v2:172.21.15.161:6802/878445946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05d00d2fb0 con 0x7f05ac06f200 2024-03-07T07:31:24.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f7dcc06f200 msgr2=0x7f7dcc071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f7dcc06f200 0x7f7dcc071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 shutdown_connections 2024-03-07T07:31:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f9a31c00640 1 -- 172.21.15.84:0/3550927289 wait complete. 2024-03-07T07:31:24.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7f05ac06f200 msgr2=0x7f05ac071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05d5a00640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7f05ac06f200 0x7f05ac071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7416c00640 1 -- 172.21.15.84:0/1729073313 --> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7410062d40 con 0x7f73ec06f150 2024-03-07T07:31:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7dcc066fe0 msgr2=0x7f7dcc0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7dcc066fe0 0x7f7dcc0694a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7de40ddd70 tx=0x7f7dd8001b70 comp rx=0 tx=0).stop 2024-03-07T07:31:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd4003a10 msgr2=0x7f7de40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c69600640 1 -- 172.21.15.84:0/1043861684 <== osd.3 v2:172.21.15.84:6816/201863371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c6c15b1f0 con 0x7f2c4c06f1d0 2024-03-07T07:31:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 --2- 172.21.15.84:0/1531700223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd4003a10 0x7f7de40d0300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4014fa0 tx=0x7f7dd4005840 comp rx=0 tx=0).stop 2024-03-07T07:31:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df1800640 1 -- 172.21.15.84:0/1531700223 reap_dead start 2024-03-07T07:31:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 shutdown_connections 2024-03-07T07:31:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 >> 172.21.15.84:0/1531700223 conn(0x7f7de40559f0 msgr2=0x7f7de403c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 shutdown_connections 2024-03-07T07:31:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f7df2200640 1 -- 172.21.15.84:0/1531700223 wait complete. 2024-03-07T07:31:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7f2c4c06f1d0 msgr2=0x7f2c4c0715f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7f2c4c06f1d0 0x7f2c4c0715f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ac066fe0 msgr2=0x7f05ac0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2c4c066fb0 msgr2=0x7f2c4c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2c4c066fb0 0x7f2c4c069470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c58000f70 tx=0x7f2c580079c0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c0730e0 msgr2=0x7f2c6c0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 --2- 172.21.15.84:0/1043861684 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c6c0730e0 0x7f2c6c0b00e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000cbd0 tx=0x7f2c6000a430 comp rx=0 tx=0).stop 2024-03-07T07:31:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c72000640 1 -- 172.21.15.84:0/1043861684 reap_dead start 2024-03-07T07:31:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05d5a00640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ac066fe0 0x7f05ac0694a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05c0001340 tx=0x7f05c0009040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d015d510 msgr2=0x7f05d015d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 shutdown_connections 2024-03-07T07:31:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 >> 172.21.15.84:0/1043861684 conn(0x7f2c6c0704b0 msgr2=0x7f2c6c06d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05d5a00640 1 --2- 172.21.15.84:0/1062700870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05d015d510 0x7f05d015d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05d0162cc0 tx=0x7f05c8001e80 comp rx=0 tx=0).stop 2024-03-07T07:31:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f740cc00640 1 -- 172.21.15.84:0/1729073313 <== osd.2 v2:172.21.15.84:6824/3227098675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7410062d40 con 0x7f73ec06f150 2024-03-07T07:31:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 shutdown_connections 2024-03-07T07:31:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f05cf400640 1 -- 172.21.15.84:0/1062700870 reap_dead start 2024-03-07T07:31:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.298+0000 7f2c74000640 1 -- 172.21.15.84:0/1043861684 wait complete. 2024-03-07T07:31:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 shutdown_connections 2024-03-07T07:31:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 >> 172.21.15.84:0/1062700870 conn(0x7f05d00674f0 msgr2=0x7f05d015c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 -- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f73ec06f150 msgr2=0x7f73ec071570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f73ec06f150 0x7f73ec071570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 shutdown_connections 2024-03-07T07:31:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 -- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73ec066fb0 msgr2=0x7f73ec069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73ec066fb0 0x7f73ec069470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f73f8005890 tx=0x7f73f8009040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 -- 172.21.15.84:0/1729073313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410162750 msgr2=0x7f7410158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 --2- 172.21.15.84:0/1729073313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7410162750 0x7f7410158f10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7408019510 tx=0x7f74080196a0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 --> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3480ade60 con 0x7fa32806f250 2024-03-07T07:31:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f05d5a00640 1 -- 172.21.15.84:0/1062700870 wait complete. 2024-03-07T07:31:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 --> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08fc053d30 con 0x7f08e406f350 2024-03-07T07:31:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7414c00640 1 -- 172.21.15.84:0/1729073313 reap_dead start 2024-03-07T07:31:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 -- 172.21.15.84:0/1729073313 shutdown_connections 2024-03-07T07:31:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 -- 172.21.15.84:0/1729073313 >> 172.21.15.84:0/1729073313 conn(0x7f74100704b0 msgr2=0x7f7410159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f08faa00640 1 -- 172.21.15.84:0/1597002702 <== osd.5 v2:172.21.15.161:6824/300876994 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08fc053d30 con 0x7f08e406f350 2024-03-07T07:31:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 -- 172.21.15.84:0/1729073313 shutdown_connections 2024-03-07T07:31:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f7405600640 1 -- 172.21.15.84:0/1729073313 wait complete. 2024-03-07T07:31:24.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa345600640 1 -- 172.21.15.84:0/1505785394 <== osd.4 v2:172.21.15.161:6800/2435467047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3480ade60 con 0x7fa32806f250 2024-03-07T07:31:24.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f08e406f350 msgr2=0x7f08e4071770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7fa32806f250 msgr2=0x7fa328071670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7fa32806f250 0x7fa328071670 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f08e406f350 0x7f08e4071770 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 --> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3c80722c0 con 0x7fc3a806f100 2024-03-07T07:31:24.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa328067030 msgr2=0x7fa3280694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa328067030 0x7fa3280694f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa340009d90 tx=0x7fa3400a7070 comp rx=0 tx=0).stop 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa34815e520 msgr2=0x7fa348142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 --2- 172.21.15.84:0/1505785394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa34815e520 0x7fa348142ab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00e960 tx=0x7fa33c00ee20 comp rx=0 tx=0).stop 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34de00640 1 -- 172.21.15.84:0/1505785394 reap_dead start 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f08e4067130 msgr2=0x7f08e40695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f08e4067130 0x7f08e40695f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08fc037c60 tx=0x7f08f0008040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08fc0e4630 msgr2=0x7f08fc0e4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 --2- 172.21.15.84:0/1597002702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08fc0e4630 0x7f08fc0e4ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0904069cd0 tx=0x7f0904074540 comp rx=0 tx=0).stop 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903400640 1 -- 172.21.15.84:0/1597002702 reap_dead start 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 shutdown_connections 2024-03-07T07:31:24.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 >> 172.21.15.84:0/1597002702 conn(0x7f08fc058ef0 msgr2=0x7f08fc04e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 shutdown_connections 2024-03-07T07:31:24.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 >> 172.21.15.84:0/1505785394 conn(0x7fa3480b2fa0 msgr2=0x7fa348146a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 shutdown_connections 2024-03-07T07:31:24.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fa34fe00640 1 -- 172.21.15.84:0/1505785394 wait complete. 2024-03-07T07:31:24.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.302+0000 7fc3c4c00640 1 -- 172.21.15.84:0/1970466270 <== osd.7 v2:172.21.15.161:6816/2319772910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc3c80722c0 con 0x7fc3a806f100 2024-03-07T07:31:24.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 shutdown_connections 2024-03-07T07:31:24.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7fc3a806f100 msgr2=0x7fc3a8071520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cfa00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7fc3a806f100 0x7fc3a8071520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7f0903e00640 1 -- 172.21.15.84:0/1597002702 wait complete. 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3a8066f60 msgr2=0x7fc3a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cfa00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3a8066f60 0x7fc3a8069420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc3c81402f0 tx=0x7fc3b4011040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c806e380 msgr2=0x7fc3c81579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cfa00640 1 --2- 172.21.15.84:0/1970466270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c806e380 0x7fc3c81579c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c3f0 tx=0x7fc3bc00c8b0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cda00640 1 -- 172.21.15.84:0/1970466270 reap_dead start 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 shutdown_connections 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.306+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 >> 172.21.15.84:0/1970466270 conn(0x7fc3c80b1e30 msgr2=0x7fc3c8143860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.310+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 shutdown_connections 2024-03-07T07:31:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.310+0000 7fc3cfa00640 1 -- 172.21.15.84:0/1970466270 wait complete. 2024-03-07T07:31:24.349 INFO:teuthology.orchestra.run.smithi084.stdout:60129542151 2024-03-07T07:31:24.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-07T07:31:24.350 INFO:teuthology.orchestra.run.smithi084.stdout:64424509447 2024-03-07T07:31:24.351 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-07T07:31:24.351 INFO:teuthology.orchestra.run.smithi084.stdout:64424509447 2024-03-07T07:31:24.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-07T07:31:24.355 INFO:teuthology.orchestra.run.smithi084.stdout:60129542151 2024-03-07T07:31:24.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-07T07:31:24.358 INFO:teuthology.orchestra.run.smithi084.stdout:64424509446 2024-03-07T07:31:24.359 INFO:teuthology.orchestra.run.smithi084.stdout:64424509447 2024-03-07T07:31:24.359 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-07T07:31:24.359 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2024-03-07T07:31:24.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-07T07:31:24.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-07T07:31:24.362 INFO:teuthology.orchestra.run.smithi084.stdout:60129542151 2024-03-07T07:31:24.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-07T07:31:24.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.586+0000 7f98f0400640 1 Processor -- start 2024-03-07T07:31:24.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.586+0000 7f98f0400640 1 -- start start 2024-03-07T07:31:24.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98f0400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e0054880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98f0400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98e0051730 0x7f98e0009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98f0400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e0054e60 con 0x7f98e00e13b0 2024-03-07T07:31:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98f0400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e0055140 con 0x7f98e0051730 2024-03-07T07:31:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98f0400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0055420 con 0x7f98e00e0fd0 2024-03-07T07:31:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98eda00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e0054880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98ee400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98e0051730 0x7f98e0009e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98ee400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98e0051730 0x7f98e0009e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51062/0 (socket says 172.21.15.84:51062) 2024-03-07T07:31:24.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98ee400640 1 -- 172.21.15.84:0/2454815365 learned_addr learned my addr 172.21.15.84:0/2454815365 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f75e3200640 1 Processor -- start 2024-03-07T07:31:24.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98eda00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e0054880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46110/0 (socket says 172.21.15.84:46110) 2024-03-07T07:31:24.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f75e3200640 1 -- start start 2024-03-07T07:31:24.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98e7e00640 1 -- 172.21.15.84:0/2454815365 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044687406 0 0) 0x7f98e0054e60 con 0x7f98e00e13b0 2024-03-07T07:31:24.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98eda00640 1 -- 172.21.15.84:0/2454815365 >> v2:172.21.15.161:3300/0 conn(0x7f98e0051730 msgr2=0x7f98e0009e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98eda00640 1 --2- 172.21.15.84:0/2454815365 >> v2:172.21.15.161:3300/0 conn(0x7f98e0051730 0x7f98e0009e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98eda00640 1 -- 172.21.15.84:0/2454815365 >> v1:172.21.15.161:6789/0 conn(0x7f98e00e13b0 legacy=0x7f98e003a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f98eda00640 1 -- 172.21.15.84:0/2454815365 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0055700 con 0x7f98e00e0fd0 2024-03-07T07:31:24.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f75e3200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75dc0d06c0 0x7f75dc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f75e3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f75e3200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc160d70 con 0x7f75dc0b2d30 2024-03-07T07:31:24.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f75e3200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc0729e0 con 0x7f75dc0d06c0 2024-03-07T07:31:24.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.590+0000 7f75e3200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0719d0 con 0x7f75dc06ed30 2024-03-07T07:31:24.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75dbe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75dc0d06c0 0x7f75dc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75dbe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75dc0d06c0 0x7f75dc15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50014/0 (socket says 172.21.15.84:50014) 2024-03-07T07:31:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75db400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75dbe00640 1 -- 172.21.15.84:0/3202076702 learned_addr learned my addr 172.21.15.84:0/3202076702 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75db400640 1 -- 172.21.15.84:0/3202076702 >> v2:172.21.15.84:3300/0 conn(0x7f75dc0d06c0 msgr2=0x7f75dc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75db400640 1 --2- 172.21.15.84:0/3202076702 >> v2:172.21.15.84:3300/0 conn(0x7f75dc0d06c0 0x7f75dc15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75db400640 1 -- 172.21.15.84:0/3202076702 >> v1:172.21.15.84:6789/0 conn(0x7f75dc0b2d30 legacy=0x7f75dc15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75db400640 1 -- 172.21.15.84:0/3202076702 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc071f00 con 0x7f75dc06ed30 2024-03-07T07:31:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f75dbe00640 1 --2- 172.21.15.84:0/3202076702 >> v2:172.21.15.84:3300/0 conn(0x7f75dc0d06c0 0x7f75dc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:24.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f5a2d200640 1 Processor -- start 2024-03-07T07:31:24.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f98eda00640 1 --2- 172.21.15.84:0/2454815365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e0054880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0097c0 tx=0x7f98dc01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e5334bb180afa86 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f5a2d200640 1 -- start start 2024-03-07T07:31:24.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f98e7e00640 1 -- 172.21.15.84:0/2454815365 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0b0070 con 0x7f98e00e0fd0 2024-03-07T07:31:24.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f98e7e00640 1 -- 172.21.15.84:0/2454815365 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc0ab600 con 0x7f98e00e0fd0 2024-03-07T07:31:24.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.594+0000 7f98e7e00640 1 -- 172.21.15.84:0/2454815365 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0ab9d0 con 0x7f98e00e0fd0 2024-03-07T07:31:24.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a2d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20047c20 0x7f5a200eb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a2d200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a20005ea0 0x7f5a200062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a2d200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a20034220 con 0x7f5a20033e40 2024-03-07T07:31:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a2d200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a20050210 con 0x7f5a20005ea0 2024-03-07T07:31:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a2d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20037bc0 con 0x7f5a20047c20 2024-03-07T07:31:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a27e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a20005ea0 0x7f5a200062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a26a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20047c20 0x7f5a200eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a27e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a20005ea0 0x7f5a200062f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51072/0 (socket says 172.21.15.84:51072) 2024-03-07T07:31:24.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a26a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20047c20 0x7f5a200eb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46128/0 (socket says 172.21.15.84:46128) 2024-03-07T07:31:24.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a27e00640 1 -- 172.21.15.84:0/1447444698 learned_addr learned my addr 172.21.15.84:0/1447444698 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea23200640 1 Processor -- start 2024-03-07T07:31:24.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f98f0400640 1 -- 172.21.15.84:0/2454815365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 msgr2=0x7f98e0054880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f98f0400640 1 --2- 172.21.15.84:0/2454815365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e0054880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0097c0 tx=0x7f98dc01c3e0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea23200640 1 -- start start 2024-03-07T07:31:24.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f75db400640 1 --2- 172.21.15.84:0/3202076702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc1577f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75c80097c0 tx=0x7f75c801ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=181ab370218aca66 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea23200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea1c0aece0 0x7fea1c161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea23200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fea1c15e520 0x7fea1c071f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea23200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c162140 con 0x7fea1c147750 2024-03-07T07:31:24.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea23200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c071af0 con 0x7fea1c0aece0 2024-03-07T07:31:24.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea23200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c162420 con 0x7fea1c15e520 2024-03-07T07:31:24.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f75daa00640 1 -- 172.21.15.84:0/3202076702 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80b5070 con 0x7f75dc06ed30 2024-03-07T07:31:24.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f75daa00640 1 -- 172.21.15.84:0/3202076702 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c80a8910 con 0x7f75dc06ed30 2024-03-07T07:31:24.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1be00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fea1c147750 0x7fea1c0ae5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41362/0 (socket says 172.21.15.84:41362) 2024-03-07T07:31:24.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1be00640 1 -- 172.21.15.84:0/3849296137 learned_addr learned my addr 172.21.15.84:0/3849296137 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f75daa00640 1 -- 172.21.15.84:0/3202076702 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80b5070 con 0x7f75dc06ed30 2024-03-07T07:31:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f98f0400640 1 -- 172.21.15.84:0/2454815365 shutdown_connections 2024-03-07T07:31:24.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747669345 0 0) 0x7fea1c162140 con 0x7fea1c147750 2024-03-07T07:31:24.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea00003530 con 0x7fea1c147750 2024-03-07T07:31:24.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea21200640 1 --2- 172.21.15.84:0/3849296137 >> v2:172.21.15.161:3300/0 conn(0x7fea1c15e520 0x7fea1c071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f98f0400640 1 --2- 172.21.15.84:0/2454815365 >> v2:172.21.15.161:3300/0 conn(0x7f98e0051730 0x7f98e0009e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f98f0400640 1 --2- 172.21.15.84:0/2454815365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e0054880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f98f0400640 1 -- 172.21.15.84:0/2454815365 >> 172.21.15.84:0/2454815365 conn(0x7f98e00537c0 msgr2=0x7f98e0053bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284926483 0 0) 0x7fea00003530 con 0x7fea1c147750 2024-03-07T07:31:24.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 >> v2:172.21.15.161:3300/0 conn(0x7fea1c15e520 msgr2=0x7fea1c071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 --2- 172.21.15.84:0/3849296137 >> v2:172.21.15.161:3300/0 conn(0x7fea1c15e520 0x7fea1c071f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 >> v2:172.21.15.84:3300/0 conn(0x7fea1c0aece0 msgr2=0x7fea1c161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 --2- 172.21.15.84:0/3849296137 >> v2:172.21.15.84:3300/0 conn(0x7fea1c0aece0 0x7fea1c161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c162700 con 0x7fea1c147750 2024-03-07T07:31:24.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7fea0c001680 con 0x7fea1c147750 2024-03-07T07:31:24.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 >> v1:172.21.15.161:6789/0 conn(0x7fea1c147750 legacy=0x7fea1c0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1aa00640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea000039c0 0x7fea00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1aa00640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea00004810 0x7fea00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1aa00640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea000052f0 0x7fea000141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c071af0 con 0x7fea000039c0 2024-03-07T07:31:24.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c162420 con 0x7fea00004810 2024-03-07T07:31:24.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea00014a50 con 0x7fea000052f0 2024-03-07T07:31:24.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f98f0400640 1 -- 172.21.15.84:0/2454815365 shutdown_connections 2024-03-07T07:31:24.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a26a00640 1 -- 172.21.15.84:0/1447444698 >> v2:172.21.15.161:3300/0 conn(0x7f5a20005ea0 msgr2=0x7f5a200062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a26a00640 1 --2- 172.21.15.84:0/1447444698 >> v2:172.21.15.161:3300/0 conn(0x7f5a20005ea0 0x7f5a200062f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a26a00640 1 -- 172.21.15.84:0/1447444698 >> v1:172.21.15.84:6789/0 conn(0x7f5a20033e40 legacy=0x7f5a200eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.598+0000 7f5a26a00640 1 -- 172.21.15.84:0/1447444698 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2004fa30 con 0x7f5a20047c20 2024-03-07T07:31:24.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f98f0400640 1 -- 172.21.15.84:0/2454815365 wait complete. 2024-03-07T07:31:24.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f75e3200640 1 -- 172.21.15.84:0/3202076702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 msgr2=0x7f75dc1577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f75e3200640 1 --2- 172.21.15.84:0/3202076702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc1577f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75c80097c0 tx=0x7f75c801ec50 comp rx=0 tx=0).stop 2024-03-07T07:31:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1b400640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea00004810 0x7fea00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1be00640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea000039c0 0x7fea00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea21200640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea000052f0 0x7fea000141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f75e3200640 1 -- 172.21.15.84:0/3202076702 shutdown_connections 2024-03-07T07:31:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f75e3200640 1 --2- 172.21.15.84:0/3202076702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc1577f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f75e3200640 1 --2- 172.21.15.84:0/3202076702 >> v2:172.21.15.84:3300/0 conn(0x7f75dc0d06c0 0x7f75dc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f75e3200640 1 -- 172.21.15.84:0/3202076702 >> 172.21.15.84:0/3202076702 conn(0x7f75dc0cfba0 msgr2=0x7f75dc0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1b400640 1 -- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea000052f0 msgr2=0x7fea000141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1b400640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea000052f0 0x7fea000141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1b400640 1 -- 172.21.15.84:0/3849296137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea000039c0 msgr2=0x7fea00003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1b400640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea000039c0 0x7fea00003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea1b400640 1 -- 172.21.15.84:0/3849296137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c162700 con 0x7fea00004810 2024-03-07T07:31:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fea21200640 1 -- 172.21.15.84:0/3849296137 reap_dead start 2024-03-07T07:31:24.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f75e3200640 1 -- 172.21.15.84:0/3202076702 shutdown_connections 2024-03-07T07:31:24.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fe4c2200640 1 Processor -- start 2024-03-07T07:31:24.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f5a26a00640 1 --2- 172.21.15.84:0/1447444698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20047c20 0x7f5a200eb890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0097c0 tx=0x7f5a1c01ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7006ee14edd74c3a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7fe4c2200640 1 -- start start 2024-03-07T07:31:24.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f5a26000640 1 -- 172.21.15.84:0/1447444698 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0b5070 con 0x7f5a20047c20 2024-03-07T07:31:24.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f5a26000640 1 -- 172.21.15.84:0/1447444698 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c0a8850 con 0x7f5a20047c20 2024-03-07T07:31:24.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f5a26000640 1 -- 172.21.15.84:0/1447444698 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0a8c20 con 0x7f5a20047c20 2024-03-07T07:31:24.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f98f0400640 1 Processor -- start 2024-03-07T07:31:24.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f98f0400640 1 -- start start 2024-03-07T07:31:24.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.602+0000 7f75e3200640 1 -- 172.21.15.84:0/3202076702 wait complete. 2024-03-07T07:31:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4c2200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4bc14b890 0x7fe4bc06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4c2200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe4bc0cb680 0x7fe4bc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4c2200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc0cbfe0 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4c2200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc06e0c0 con 0x7fe4bc0cb680 2024-03-07T07:31:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4c2200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc06e3a0 con 0x7fe4bc14b890 2024-03-07T07:31:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f5a2d200640 1 -- 172.21.15.84:0/1447444698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20047c20 msgr2=0x7f5a200eb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1447444698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20047c20 0x7f5a200eb890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0097c0 tx=0x7f5a1c01ebb0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e3200640 1 Processor -- start 2024-03-07T07:31:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e3200640 1 -- start start 2024-03-07T07:31:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98f0400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e0051730 0x7f98e017c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4bb400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4bc14b890 0x7fe4bc06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4bb400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4bc14b890 0x7fe4bc06da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51096/0 (socket says 172.21.15.84:51096) 2024-03-07T07:31:24.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4bb400640 1 -- 172.21.15.84:0/2572421522 learned_addr learned my addr 172.21.15.84:0/2572421522 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98f0400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e00dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98f0400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e00e13b0 0x7f98e00ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4bb400640 1 -- 172.21.15.84:0/2572421522 >> v2:172.21.15.84:3300/0 conn(0x7fe4bc0cb680 msgr2=0x7fe4bc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e0051730 0x7f98e017c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4bb400640 1 --2- 172.21.15.84:0/2572421522 >> v2:172.21.15.84:3300/0 conn(0x7fe4bc0cb680 0x7fe4bc0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4bb400640 1 -- 172.21.15.84:0/2572421522 >> v1:172.21.15.84:6789/0 conn(0x7fe4bc0b38d0 legacy=0x7fe4bc0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fe4bb400640 1 -- 172.21.15.84:0/2572421522 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc071be0 con 0x7fe4bc14b890 2024-03-07T07:31:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98f0400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0056aa0 con 0x7f98e00e13b0 2024-03-07T07:31:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e0051730 0x7f98e017c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51110/0 (socket says 172.21.15.84:51110) 2024-03-07T07:31:24.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 -- 172.21.15.84:0/847260400 learned_addr learned my addr 172.21.15.84:0/847260400 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0056920 con 0x7f98e0051730 2024-03-07T07:31:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e003bae0 con 0x7f98e00e0fd0 2024-03-07T07:31:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f5a2d200640 1 -- 172.21.15.84:0/1447444698 shutdown_connections 2024-03-07T07:31:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1447444698 >> v2:172.21.15.161:3300/0 conn(0x7f5a20005ea0 0x7f5a200062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1447444698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20047c20 0x7f5a200eb890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f5a2d200640 1 -- 172.21.15.84:0/1447444698 >> 172.21.15.84:0/1447444698 conn(0x7f5a20009fc0 msgr2=0x7f5a2000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98ed000640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e00dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98ee400640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e00e13b0 0x7f98e00ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 -- 172.21.15.84:0/847260400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 msgr2=0x7f98e00dd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e00dd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 -- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e00e13b0 msgr2=0x7f98e00ddcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e00e13b0 0x7f98e00ddcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 -- 172.21.15.84:0/847260400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00e2000 con 0x7f98e0051730 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f98eda00640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e0051730 0x7f98e017c340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0097c0 tx=0x7f98dc01ac20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7fd659000640 1 Processor -- start 2024-03-07T07:31:24.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc0b2d30 0x7f75dc158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e3200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75dc0d06c0 0x7f75dc159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e3200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0724c0 con 0x7f75dc0b2d30 2024-03-07T07:31:24.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e3200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0ce000 con 0x7f75dc0d06c0 2024-03-07T07:31:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e3200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc06f190 con 0x7f75dc06ed30 2024-03-07T07:31:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75dbe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75dbe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc137ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46164/0 (socket says 172.21.15.84:46164) 2024-03-07T07:31:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e1200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75dc0d06c0 0x7f75dc159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e1200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75dc0d06c0 0x7f75dc159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51114/0 (socket says 172.21.15.84:51114) 2024-03-07T07:31:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f75e1200640 1 -- 172.21.15.84:0/3428905939 learned_addr learned my addr 172.21.15.84:0/3428905939 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f5a2d200640 1 -- 172.21.15.84:0/1447444698 shutdown_connections 2024-03-07T07:31:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f98ee400640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e00e13b0 0x7f98e00ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea1b400640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea00004810 0x7fea00004c90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fea14009c70 tx=0x7fea1401cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9934d7a9d3a4bdd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fd659000640 1 -- start start 2024-03-07T07:31:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75e1200640 1 -- 172.21.15.84:0/3428905939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 msgr2=0x7f75dc137ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75e1200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc137ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f98e5600640 1 -- 172.21.15.84:0/847260400 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0b0050 con 0x7f98e0051730 2024-03-07T07:31:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f98e5600640 1 -- 172.21.15.84:0/847260400 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc0bc070 con 0x7f98e0051730 2024-03-07T07:31:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f98e5600640 1 -- 172.21.15.84:0/847260400 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0b5810 con 0x7f98e0051730 2024-03-07T07:31:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e00e22e0 con 0x7f98e0051730 2024-03-07T07:31:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e00e28a0 con 0x7f98e0051730 2024-03-07T07:31:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea140b2070 con 0x7fea00004810 2024-03-07T07:31:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea140a5b10 con 0x7fea00004810 2024-03-07T07:31:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea1aa00640 1 -- 172.21.15.84:0/3849296137 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14006e60 con 0x7fea00004810 2024-03-07T07:31:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d9400640 1 Processor -- start 2024-03-07T07:31:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75e1200640 1 -- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc0b2d30 msgr2=0x7f75dc158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75db400640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc0b2d30 0x7f75dc158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75e1200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc0b2d30 0x7f75dc158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75e1200640 1 -- 172.21.15.84:0/3428905939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc138400 con 0x7f75dc0d06c0 2024-03-07T07:31:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75dbe00640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc137ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.606+0000 7f5a2d200640 1 -- 172.21.15.84:0/1447444698 wait complete. 2024-03-07T07:31:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f5a2d200640 1 Processor -- start 2024-03-07T07:31:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f5a2d200640 1 -- start start 2024-03-07T07:31:24.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e0051300 con 0x7f98e0051730 2024-03-07T07:31:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea23200640 1 -- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea00004810 msgr2=0x7fea00004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea23200640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea00004810 0x7fea00004c90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fea14009c70 tx=0x7fea1401cbf0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea23200640 1 -- 172.21.15.84:0/3849296137 shutdown_connections 2024-03-07T07:31:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea23200640 1 --2- 172.21.15.84:0/3849296137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea00004810 0x7fea00004c90 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fea14009c70 tx=0x7fea1401cbf0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea23200640 1 -- 172.21.15.84:0/3849296137 >> 172.21.15.84:0/3849296137 conn(0x7fea1c0b2fa0 msgr2=0x7fea1c0b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea23200640 1 -- 172.21.15.84:0/3849296137 shutdown_connections 2024-03-07T07:31:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fea23200640 1 -- 172.21.15.84:0/3849296137 wait complete. 2024-03-07T07:31:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75db400640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc0b2d30 0x7f75dc158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d9400640 1 -- start start 2024-03-07T07:31:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75e1200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75dc0d06c0 0x7f75dc159490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c7e0 tx=0x7f75d400cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fd57be00640 1 Processor -- start 2024-03-07T07:31:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fd57be00640 1 -- start start 2024-03-07T07:31:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d3e00640 1 -- 172.21.15.84:0/3428905939 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4017070 con 0x7f75dc0d06c0 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d9400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75d40717a0 0x7f75d415e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d9400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4071c30 0x7f75d415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d9400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d4070700 con 0x7f75d4140240 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d9400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d413d990 con 0x7f75d40717a0 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d9400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40704b0 con 0x7f75d4071c30 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fd659000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6540cc6f0 0x7fd65406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fd659000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd65406d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fd659000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540cd0d0 con 0x7fd6540ce290 2024-03-07T07:31:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fd659000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6540cd3b0 con 0x7fd6540cc6f0 2024-03-07T07:31:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fd659000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540cd690 con 0x7fd6540ccb60 2024-03-07T07:31:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7fe4bb400640 1 --2- 172.21.15.84:0/2572421522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc14b890 0x7fe4bc06da30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc06f520 tx=0x7fe4ac01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cea109b422b1e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f5a2d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20005ea0 0x7f5a20037400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a2d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a20033e40 0x7f5a2004aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20005ea0 0x7f5a20037400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20005ea0 0x7f5a20037400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46168/0 (socket says 172.21.15.84:46168) 2024-03-07T07:31:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4ba000640 1 -- 172.21.15.84:0/2572421522 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0b0070 con 0x7fe4bc14b890 2024-03-07T07:31:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4ba000640 1 -- 172.21.15.84:0/2572421522 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac0a4e50 con 0x7fe4bc14b890 2024-03-07T07:31:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4ba000640 1 -- 172.21.15.84:0/2572421522 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0ab820 con 0x7fe4bc14b890 2024-03-07T07:31:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 -- 172.21.15.84:0/1842864462 learned_addr learned my addr 172.21.15.84:0/1842864462 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea23200640 1 Processor -- start 2024-03-07T07:31:24.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a20047c20 0x7f5a20034510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2004fd80 con 0x7f5a20033e40 2024-03-07T07:31:24.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2004f090 con 0x7f5a20047c20 2024-03-07T07:31:24.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2004f5c0 con 0x7f5a20005ea0 2024-03-07T07:31:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea23200640 1 -- start start 2024-03-07T07:31:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd651400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6540cc6f0 0x7fd65406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd651400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6540cc6f0 0x7fd65406d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51126/0 (socket says 172.21.15.84:51126) 2024-03-07T07:31:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd651400640 1 -- 172.21.15.84:0/1865375258 learned_addr learned my addr 172.21.15.84:0/1865375258 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd652800640 1 --2- 172.21.15.84:0/1865375258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd65406d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d3e00640 1 -- 172.21.15.84:0/3428905939 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4003db0 con 0x7f75dc0d06c0 2024-03-07T07:31:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.610+0000 7f75d3e00640 1 -- 172.21.15.84:0/3428905939 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d40052b0 con 0x7f75dc0d06c0 2024-03-07T07:31:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27e00640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a20047c20 0x7f5a20034510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd57c15c370 0x7fd57c0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4c2200640 1 -- 172.21.15.84:0/2572421522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc14b890 msgr2=0x7fe4bc06da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4c2200640 1 --2- 172.21.15.84:0/2572421522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc14b890 0x7fe4bc06da30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc06f520 tx=0x7fe4ac01c3c0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4c2200640 1 -- 172.21.15.84:0/2572421522 shutdown_connections 2024-03-07T07:31:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4c2200640 1 --2- 172.21.15.84:0/2572421522 >> v2:172.21.15.84:3300/0 conn(0x7fe4bc0cb680 0x7fe4bc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4c2200640 1 --2- 172.21.15.84:0/2572421522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc14b890 0x7fe4bc06da30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4c2200640 1 -- 172.21.15.84:0/2572421522 >> 172.21.15.84:0/2572421522 conn(0x7fe4bc0cfba0 msgr2=0x7fe4bc0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4c2200640 1 -- 172.21.15.84:0/2572421522 shutdown_connections 2024-03-07T07:31:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57b400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd57c0cfe00 0x7fd57c070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41388/0 (socket says 172.21.15.84:41388) 2024-03-07T07:31:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57b400640 1 -- 172.21.15.84:0/187495359 learned_addr learned my addr 172.21.15.84:0/187495359 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57be00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c15fba0 con 0x7fd57c144980 2024-03-07T07:31:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fe4c2200640 1 -- 172.21.15.84:0/2572421522 wait complete. 2024-03-07T07:31:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57be00640 1 -- 172.21.15.84:0/187495359 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c15fe80 con 0x7fd57c0cfe00 2024-03-07T07:31:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57be00640 1 -- 172.21.15.84:0/187495359 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0d0270 con 0x7fd57c15c370 2024-03-07T07:31:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd651400640 1 -- 172.21.15.84:0/1865375258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 msgr2=0x7fd65406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 -- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a20047c20 msgr2=0x7f5a20034510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a20047c20 0x7f5a20034510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 -- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a20033e40 msgr2=0x7f5a2004aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd651400640 1 --2- 172.21.15.84:0/1865375258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd65406d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a20033e40 0x7f5a2004aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 -- 172.21.15.84:0/1842864462 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a20048cd0 con 0x7f5a20005ea0 2024-03-07T07:31:24.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57a000640 1 --2- 172.21.15.84:0/187495359 >> v2:172.21.15.161:3300/0 conn(0x7fd57c15c370 0x7fd57c0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd651400640 1 -- 172.21.15.84:0/1865375258 >> v1:172.21.15.161:6789/0 conn(0x7fd6540ce290 legacy=0x7fd6540ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd651400640 1 -- 172.21.15.84:0/1865375258 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540cd970 con 0x7fd6540cc6f0 2024-03-07T07:31:24.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27e00640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a20047c20 0x7f5a20034510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea23200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea1c1436f0 0x7fea1c0c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea23200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1c143ad0 0x7fea1c0b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea23200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c15fa70 0x7fea1c0b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea23200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0ae5d0 con 0x7fea1c15fa70 2024-03-07T07:31:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea23200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c147d40 con 0x7fea1c143ad0 2024-03-07T07:31:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea23200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0ae750 con 0x7fea1c1436f0 2024-03-07T07:31:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a27400640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20005ea0 0x7f5a20037400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c490 tx=0x7f5a14001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f75d3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4071c30 0x7f75d415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f75d3200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4071c30 0x7f75d415e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46186/0 (socket says 172.21.15.84:46186) 2024-03-07T07:31:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f75d3200640 1 -- 172.21.15.84:0/1623275190 learned_addr learned my addr 172.21.15.84:0/1623275190 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f98e5600640 1 -- 172.21.15.84:0/847260400 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f98dc0b59b0 con 0x7f98e0051730 2024-03-07T07:31:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea1c1436f0 0x7fea1c0c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1b400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1c143ad0 0x7fea1c0b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea1c1436f0 0x7fea1c0c2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46194/0 (socket says 172.21.15.84:46194) 2024-03-07T07:31:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 -- 172.21.15.84:0/571077205 learned_addr learned my addr 172.21.15.84:0/571077205 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 -- 172.21.15.84:0/571077205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1c143ad0 msgr2=0x7fea1c0b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1c143ad0 0x7fea1c0b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 -- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c15fa70 msgr2=0x7fea1c0b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c15fa70 0x7fea1c0b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f75d1e00640 1 --2- 172.21.15.84:0/1623275190 >> v2:172.21.15.84:3300/0 conn(0x7f75d40717a0 0x7f75d415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc0b2770 con 0x7f75dc0d06c0 2024-03-07T07:31:24.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc0b2490 con 0x7f75dc0d06c0 2024-03-07T07:31:24.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a1b400640 1 -- 172.21.15.84:0/1842864462 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14017070 con 0x7f5a20005ea0 2024-03-07T07:31:24.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a1b400640 1 -- 172.21.15.84:0/1842864462 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14003600 con 0x7f5a20005ea0 2024-03-07T07:31:24.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a1b400640 1 -- 172.21.15.84:0/1842864462 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14003a30 con 0x7f5a20005ea0 2024-03-07T07:31:24.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57a000640 1 -- 172.21.15.84:0/187495359 >> v1:172.21.15.161:6789/0 conn(0x7fd57c0cfe00 legacy=0x7fd57c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57a000640 1 -- 172.21.15.84:0/187495359 >> v1:172.21.15.84:6789/0 conn(0x7fd57c144980 legacy=0x7fd57c071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fd57a000640 1 -- 172.21.15.84:0/187495359 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c160160 con 0x7fd57c15c370 2024-03-07T07:31:24.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 -- 172.21.15.84:0/571077205 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c1f2dd0 con 0x7fea1c1436f0 2024-03-07T07:31:24.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea1be00640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea1c1436f0 0x7fea1c0c2e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fea0c007310 tx=0x7fea0c0077d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20048f70 con 0x7f5a20005ea0 2024-03-07T07:31:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a20049530 con 0x7f5a20005ea0 2024-03-07T07:31:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.614+0000 7fea13e00640 1 -- 172.21.15.84:0/571077205 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00fa00 con 0x7fea1c1436f0 2024-03-07T07:31:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fea13e00640 1 -- 172.21.15.84:0/571077205 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c018070 con 0x7fea1c1436f0 2024-03-07T07:31:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fea13e00640 1 -- 172.21.15.84:0/571077205 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00fe00 con 0x7fea1c1436f0 2024-03-07T07:31:24.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0c3700 con 0x7fea1c1436f0 2024-03-07T07:31:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f75d1e00640 1 -- 172.21.15.84:0/1623275190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4071c30 msgr2=0x7f75d415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f75d1e00640 1 --2- 172.21.15.84:0/1623275190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4071c30 0x7f75d415e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f75d1e00640 1 -- 172.21.15.84:0/1623275190 >> v1:172.21.15.84:6789/0 conn(0x7f75d4140240 legacy=0x7f75d4140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc062d40 con 0x7f75dc0d06c0 2024-03-07T07:31:24.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f98e5600640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f98c8067030 0x7f98c80694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f98e5600640 1 -- 172.21.15.84:0/847260400 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98dc11f730 con 0x7f98e0051730 2024-03-07T07:31:24.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0c3cc0 con 0x7fea1c1436f0 2024-03-07T07:31:24.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f75d1e00640 1 -- 172.21.15.84:0/1623275190 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d40709e0 con 0x7f75d40717a0 2024-03-07T07:31:24.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fe4c2200640 1 Processor -- start 2024-03-07T07:31:24.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a200053a0 con 0x7f5a20005ea0 2024-03-07T07:31:24.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f98ed000640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f98c8067030 0x7f98c80694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c1f2fa0 con 0x7fea1c1436f0 2024-03-07T07:31:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fea13e00640 1 -- 172.21.15.84:0/571077205 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fea0c01d460 con 0x7fea1c1436f0 2024-03-07T07:31:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f5a1b400640 1 -- 172.21.15.84:0/1842864462 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f5a1401a070 con 0x7f5a20005ea0 2024-03-07T07:31:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fea13e00640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe9fc066fe0 0x7fe9fc0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fd651400640 1 --2- 172.21.15.84:0/1865375258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540cc6f0 0x7fd65406d2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd64400bb40 tx=0x7fd64401ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cfcfc1b7624aa7d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7f98ed000640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f98c8067030 0x7f98c80694f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f98e017ff30 tx=0x7f98d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fea13e00640 1 -- 172.21.15.84:0/571077205 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea0c085240 con 0x7fea1c1436f0 2024-03-07T07:31:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fe4c2200640 1 -- start start 2024-03-07T07:31:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fe4c2200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc0b38d0 0x7fe4bc149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fe4c2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4bc0cb680 0x7fe4bc161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fe4c2200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4bc14b890 0x7fe4bc160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fe4c2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc14bdf0 con 0x7fe4bc0cb680 2024-03-07T07:31:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fe4c2200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc14bc70 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.618+0000 7fe4c2200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc16efa0 con 0x7fe4bc14b890 2024-03-07T07:31:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fea1b400640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe9fc066fe0 0x7fe9fc0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f98e5600640 1 -- 172.21.15.84:0/847260400 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f98dc015fd0 con 0x7f98e0051730 2024-03-07T07:31:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc0b38d0 0x7fe4bc149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc0b38d0 0x7fe4bc149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51150/0 (socket says 172.21.15.84:51150) 2024-03-07T07:31:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 -- 172.21.15.84:0/2160748719 learned_addr learned my addr 172.21.15.84:0/2160748719 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4baa00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4bc0cb680 0x7fe4bc161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f5a1b400640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5a08067030 0x7f5a080694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 -- 172.21.15.84:0/2160748719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4bc14b890 msgr2=0x7fe4bc160420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-07T07:31:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4bc14b890 0x7fe4bc160420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 -- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4bc0cb680 msgr2=0x7fe4bc161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4bc0cb680 0x7fe4bc161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f5a1b400640 1 -- 172.21.15.84:0/1842864462 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a14084460 con 0x7f5a20005ea0 2024-03-07T07:31:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 -- 172.21.15.84:0/2160748719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc149df0 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fd57a000640 1 --2- 172.21.15.84:0/187495359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c15c370 0x7fd57c0cf8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0097c0 tx=0x7fd56c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f65bfe0549980cee server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fe4bb400640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc0b38d0 0x7fe4bc149210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac01aa70 tx=0x7fe4ac01ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f5a26a00640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5a08067030 0x7f5a080694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d1e00640 1 --2- 172.21.15.84:0/1623275190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d40717a0 0x7f75d415e070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f75c40097c0 tx=0x7f75c401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428159256a02fe82 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d1400640 1 -- 172.21.15.84:0/1623275190 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40b0070 con 0x7f75d40717a0 2024-03-07T07:31:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d1400640 1 -- 172.21.15.84:0/1623275190 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c40ab600 con 0x7f75d40717a0 2024-03-07T07:31:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d1400640 1 -- 172.21.15.84:0/1623275190 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40ab9d0 con 0x7f75d40717a0 2024-03-07T07:31:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d3e00640 1 -- 172.21.15.84:0/3428905939 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f75d401a070 con 0x7f75dc0d06c0 2024-03-07T07:31:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f5a26a00640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5a08067030 0x7f5a080694f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0b2000 tx=0x7f5a1c004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7fea1b400640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe9fc066fe0 0x7fe9fc0694a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea140af000 tx=0x7fea14004bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d9400640 1 -- 172.21.15.84:0/1623275190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d40717a0 msgr2=0x7f75d415e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d9400640 1 --2- 172.21.15.84:0/1623275190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d40717a0 0x7f75d415e070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f75c40097c0 tx=0x7f75c401c480 comp rx=0 tx=0).stop 2024-03-07T07:31:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d9400640 1 -- 172.21.15.84:0/1623275190 shutdown_connections 2024-03-07T07:31:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d9400640 1 --2- 172.21.15.84:0/1623275190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4071c30 0x7f75d415e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d9400640 1 --2- 172.21.15.84:0/1623275190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d40717a0 0x7f75d415e070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d9400640 1 -- 172.21.15.84:0/1623275190 >> 172.21.15.84:0/1623275190 conn(0x7f75d4072240 msgr2=0x7f75d4072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d9400640 1 -- 172.21.15.84:0/1623275190 shutdown_connections 2024-03-07T07:31:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d9400640 1 -- 172.21.15.84:0/1623275190 wait complete. 2024-03-07T07:31:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d3e00640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75bc066fb0 0x7f75bc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.622+0000 7f75d3e00640 1 -- 172.21.15.84:0/3428905939 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75d4084a40 con 0x7f75dc0d06c0 2024-03-07T07:31:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7f75dbe00640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75bc066fb0 0x7f75bc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fe4b3400640 1 -- 172.21.15.84:0/2160748719 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0ba020 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fe4b3400640 1 -- 172.21.15.84:0/2160748719 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac0b6420 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fe4b3400640 1 -- 172.21.15.84:0/2160748719 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0b0040 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd650a00640 1 -- 172.21.15.84:0/1865375258 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440b4070 con 0x7fd6540cc6f0 2024-03-07T07:31:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd650a00640 1 -- 172.21.15.84:0/1865375258 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440a7990 con 0x7fd6540cc6f0 2024-03-07T07:31:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd650a00640 1 -- 172.21.15.84:0/1865375258 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440a7d60 con 0x7fd6540cc6f0 2024-03-07T07:31:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fe4c2200640 1 -- 172.21.15.84:0/2160748719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4bc149b10 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd579600640 1 -- 172.21.15.84:0/187495359 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c0b0070 con 0x7fd57c15c370 2024-03-07T07:31:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd579600640 1 -- 172.21.15.84:0/187495359 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c0ab600 con 0x7fd57c15c370 2024-03-07T07:31:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd579600640 1 -- 172.21.15.84:0/187495359 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c0ab9d0 con 0x7fd57c15c370 2024-03-07T07:31:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fe4c2200640 1 -- 172.21.15.84:0/2160748719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc161200 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7f75d3e00640 1 -- 172.21.15.84:0/3428905939 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f75d4021020 con 0x7f75dc0d06c0 2024-03-07T07:31:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd57be00640 1 -- 172.21.15.84:0/187495359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c15c370 msgr2=0x7fd57c0cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd57be00640 1 --2- 172.21.15.84:0/187495359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c15c370 0x7fd57c0cf8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0097c0 tx=0x7fd56c01c460 comp rx=0 tx=0).stop 2024-03-07T07:31:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd659000640 1 -- 172.21.15.84:0/1865375258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540cc6f0 msgr2=0x7fd65406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd659000640 1 --2- 172.21.15.84:0/1865375258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540cc6f0 0x7fd65406d2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd64400bb40 tx=0x7fd64401ec10 comp rx=0 tx=0).stop 2024-03-07T07:31:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd659000640 1 -- 172.21.15.84:0/1865375258 shutdown_connections 2024-03-07T07:31:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd659000640 1 --2- 172.21.15.84:0/1865375258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd65406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd659000640 1 --2- 172.21.15.84:0/1865375258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540cc6f0 0x7fd65406d2c0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd64400bb40 tx=0x7fd64401ec10 comp rx=0 tx=0).stop 2024-03-07T07:31:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd659000640 1 -- 172.21.15.84:0/1865375258 >> 172.21.15.84:0/1865375258 conn(0x7fd6540b2fa0 msgr2=0x7fd6540b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd659000640 1 -- 172.21.15.84:0/1865375258 shutdown_connections 2024-03-07T07:31:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7f75dbe00640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75bc066fb0 0x7f75bc069470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0099e0 tx=0x7f75cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd659000640 1 -- 172.21.15.84:0/1865375258 wait complete. 2024-03-07T07:31:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7f75d9400640 1 Processor -- start 2024-03-07T07:31:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fe4b0c00640 1 -- 172.21.15.84:0/2160748719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4bc062d40 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7f75d9400640 1 -- start start 2024-03-07T07:31:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd57be00640 1 -- 172.21.15.84:0/187495359 shutdown_connections 2024-03-07T07:31:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd57be00640 1 --2- 172.21.15.84:0/187495359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c15c370 0x7fd57c0cf8c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd57be00640 1 -- 172.21.15.84:0/187495359 >> 172.21.15.84:0/187495359 conn(0x7fd57c06b0f0 msgr2=0x7fd57c06b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd57be00640 1 -- 172.21.15.84:0/187495359 shutdown_connections 2024-03-07T07:31:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fd57be00640 1 -- 172.21.15.84:0/187495359 wait complete. 2024-03-07T07:31:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.626+0000 7fe4b3400640 1 -- 172.21.15.84:0/2160748719 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe4ac0bd020 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd659000640 1 Processor -- start 2024-03-07T07:31:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd659000640 1 -- start start 2024-03-07T07:31:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d9400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d40717a0 0x7f75d4132cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d4071c30 0x7f75d415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d9400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4140240 0x7f75d41fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d9400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d413dd90 con 0x7f75d4071c30 2024-03-07T07:31:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d9400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d413dc10 con 0x7f75d40717a0 2024-03-07T07:31:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d9400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d413df10 con 0x7f75d4140240 2024-03-07T07:31:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fe4b3400640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe49c067030 0x7fe49c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fe4b3400640 1 -- 172.21.15.84:0/2160748719 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4ac11f170 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d40717a0 0x7f75d4132cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d40717a0 0x7f75d4132cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51160/0 (socket says 172.21.15.84:51160) 2024-03-07T07:31:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 -- 172.21.15.84:0/2995955643 learned_addr learned my addr 172.21.15.84:0/2995955643 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 -- 172.21.15.84:0/2995955643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4140240 msgr2=0x7f75d41fdbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-07T07:31:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4140240 0x7f75d41fdbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 -- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d4071c30 msgr2=0x7f75d415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d4071c30 0x7f75d415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 -- 172.21.15.84:0/2995955643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4133920 con 0x7f75d40717a0 2024-03-07T07:31:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f75d2800640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d40717a0 0x7f75d4132cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00ba50 tx=0x7f75cc00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fe4baa00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe49c067030 0x7fe49c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd659000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd654157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd659000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540ce290 0x7fd654155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd659000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65413b5d0 0x7fd6540b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7f5a1b400640 1 -- 172.21.15.84:0/1842864462 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f5a14054e00 con 0x7f5a20005ea0 2024-03-07T07:31:24.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd57be00640 1 Processor -- start 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540ce290 0x7fd654155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd659000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540723d0 con 0x7fd65413b5d0 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540ce290 0x7fd654155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51172/0 (socket says 172.21.15.84:51172) 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651400640 1 -- 172.21.15.84:0/3224776127 learned_addr learned my addr 172.21.15.84:0/3224776127 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd652800640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65413b5d0 0x7fd6540b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651e00640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd654157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654072250 con 0x7fd6540ce290 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd654072550 con 0x7fd6540ccb60 2024-03-07T07:31:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fe4baa00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe49c067030 0x7fe49c0694f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc162390 tx=0x7fe4a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd57be00640 1 -- start start 2024-03-07T07:31:24.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651400640 1 -- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 msgr2=0x7fd654157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651400640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd654157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651400640 1 -- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65413b5d0 msgr2=0x7fd6540b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651400640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65413b5d0 0x7fd6540b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651400640 1 -- 172.21.15.84:0/3224776127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654155f70 con 0x7fd6540ce290 2024-03-07T07:31:24.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.630+0000 7fd651e00640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd654157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:24.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7f75caa00640 1 -- 172.21.15.84:0/2995955643 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc019070 con 0x7f75d40717a0 2024-03-07T07:31:24.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d4133360 con 0x7f75d40717a0 2024-03-07T07:31:24.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d4158740 con 0x7f75d40717a0 2024-03-07T07:31:24.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd651400640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540ce290 0x7fd654155810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b2c0 tx=0x7fd64401b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fe4b3400640 1 -- 172.21.15.84:0/2160748719 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe4ac0c4030 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7f75caa00640 1 -- 172.21.15.84:0/2995955643 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00cc20 con 0x7f75d40717a0 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7f75caa00640 1 -- 172.21.15.84:0/2995955643 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc014680 con 0x7f75d40717a0 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c0cfe00 0x7fd57c1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57be00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c144980 0x7fd57c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd57c15c370 0x7fd57c14f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c169d40 con 0x7fd57c0cfe00 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57be00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c1607b0 con 0x7fd57c144980 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57be00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c169ec0 con 0x7fd57c15c370 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd64a000640 1 -- 172.21.15.84:0/3224776127 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440be070 con 0x7fd6540ce290 2024-03-07T07:31:24.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd64a000640 1 -- 172.21.15.84:0/3224776127 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd644004230 con 0x7fd6540ce290 2024-03-07T07:31:24.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd64a000640 1 -- 172.21.15.84:0/3224776127 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440b4040 con 0x7fd6540ce290 2024-03-07T07:31:24.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57a000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c144980 0x7fd57c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd57c15c370 0x7fd57c14f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd57c15c370 0x7fd57c14f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46216/0 (socket says 172.21.15.84:46216) 2024-03-07T07:31:24.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 -- 172.21.15.84:0/696642065 learned_addr learned my addr 172.21.15.84:0/696642065 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd654156250 con 0x7fd6540ce290 2024-03-07T07:31:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654156810 con 0x7fd6540ce290 2024-03-07T07:31:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57aa00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c0cfe00 0x7fd57c1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 -- 172.21.15.84:0/696642065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c144980 msgr2=0x7fd57c0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c144980 0x7fd57c0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 -- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c0cfe00 msgr2=0x7fd57c1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c0cfe00 0x7fd57c1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 -- 172.21.15.84:0/696642065 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c150220 con 0x7fd57c15c370 2024-03-07T07:31:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57a000640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c144980 0x7fd57c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57aa00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c0cfe00 0x7fd57c1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd57b400640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd57c15c370 0x7fd57c14f920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd56800c3f0 tx=0x7fd56800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.634+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c0052a0 con 0x7fd6540ce290 2024-03-07T07:31:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac0052a0 con 0x7f75d40717a0 2024-03-07T07:31:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7f75caa00640 1 -- 172.21.15.84:0/2995955643 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f75cc01c070 con 0x7f75d40717a0 2024-03-07T07:31:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd64a000640 1 -- 172.21.15.84:0/3224776127 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fd644003620 con 0x7fd6540ce290 2024-03-07T07:31:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd572a00640 1 -- 172.21.15.84:0/696642065 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568017070 con 0x7fd57c15c370 2024-03-07T07:31:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd572a00640 1 -- 172.21.15.84:0/696642065 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd568005cf0 con 0x7fd57c15c370 2024-03-07T07:31:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd572a00640 1 -- 172.21.15.84:0/696642065 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680072d0 con 0x7fd57c15c370 2024-03-07T07:31:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c150500 con 0x7fd57c15c370 2024-03-07T07:31:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c150ac0 con 0x7fd57c15c370 2024-03-07T07:31:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7f75caa00640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75b4066f90 0x7f75b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7f75caa00640 1 -- 172.21.15.84:0/2995955643 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75cc084c30 con 0x7f75d40717a0 2024-03-07T07:31:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd64a000640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd634067030 0x7fd6340694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd64a000640 1 -- 172.21.15.84:0/3224776127 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd64411ea90 con 0x7fd6540ce290 2024-03-07T07:31:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd651e00640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd634067030 0x7fd6340694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.638+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5540052a0 con 0x7fd57c15c370 2024-03-07T07:31:24.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7fea13e00640 1 -- 172.21.15.84:0/571077205 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fea0c056230 con 0x7fea1c1436f0 2024-03-07T07:31:24.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7f75d1e00640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75b4066f90 0x7f75b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7fd651e00640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd634067030 0x7fd6340694f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd640000f70 tx=0x7fd640009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7f75d1e00640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75b4066f90 0x7f75b4069450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75c40ad000 tx=0x7f75c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7fd572a00640 1 -- 172.21.15.84:0/696642065 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fd56801a070 con 0x7fd57c15c370 2024-03-07T07:31:24.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7f75caa00640 1 -- 172.21.15.84:0/2995955643 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f75cc0555e0 con 0x7f75d40717a0 2024-03-07T07:31:24.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7fd572a00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd55c067030 0x7fd55c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:24.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7fd572a00640 1 -- 172.21.15.84:0/696642065 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5680842e0 con 0x7fd57c15c370 2024-03-07T07:31:24.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.642+0000 7fd57aa00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd55c067030 0x7fd55c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:24.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.646+0000 7fd57aa00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd55c067030 0x7fd55c0694f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd574007e90 tx=0x7fd5740073a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:24.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.650+0000 7fd64a000640 1 -- 172.21.15.84:0/3224776127 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fd644018800 con 0x7fd6540ce290 2024-03-07T07:31:24.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.654+0000 7fd572a00640 1 -- 172.21.15.84:0/696642065 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fd568054c80 con 0x7fd57c15c370 2024-03-07T07:31:24.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.946+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f98e0054420 con 0x7f98e0051730 2024-03-07T07:31:24.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.950+0000 7f98e5600640 1 -- 172.21.15.84:0/847260400 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98dc015fd0 con 0x7f98e0051730 2024-03-07T07:31:24.953 INFO:teuthology.orchestra.run.smithi084.stdout:64424509446 2024-03-07T07:31:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.958+0000 7fe4b0c00640 1 -- 172.21.15.84:0/2160748719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe4bc13f710 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.958+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f98c8067030 msgr2=0x7f98c80694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.958+0000 7f98f0400640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f98c8067030 0x7f98c80694f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f98e017ff30 tx=0x7f98d4009040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.958+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e0051730 msgr2=0x7f98e017c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.958+0000 7f98f0400640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e0051730 0x7f98e017c340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0097c0 tx=0x7f98dc01ac20 comp rx=0 tx=0).stop 2024-03-07T07:31:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.958+0000 7fe4b3400640 1 -- 172.21.15.84:0/2160748719 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4ac0160d0 con 0x7fe4bc0b38d0 2024-03-07T07:31:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.958+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f75dc15e880 con 0x7f75dc0d06c0 2024-03-07T07:31:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 shutdown_connections 2024-03-07T07:31:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f98f0400640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f98c8067030 0x7f98c80694f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f98f0400640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e00e13b0 0x7f98e00ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f98f0400640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98e00e0fd0 0x7f98e00dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f98f0400640 1 --2- 172.21.15.84:0/847260400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e0051730 0x7f98e017c340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 >> 172.21.15.84:0/847260400 conn(0x7f98e00537c0 msgr2=0x7f98e00d9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.966 INFO:teuthology.orchestra.run.smithi084.stdout:64424509445 2024-03-07T07:31:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f75d3e00640 1 -- 172.21.15.84:0/3428905939 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75d4055b40 con 0x7f75dc0d06c0 2024-03-07T07:31:24.967 INFO:teuthology.orchestra.run.smithi084.stdout:60129542149 2024-03-07T07:31:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a20052830 con 0x7f5a20005ea0 2024-03-07T07:31:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 shutdown_connections 2024-03-07T07:31:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7f98f0400640 1 -- 172.21.15.84:0/847260400 wait complete. 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7fe4b0c00640 1 -- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe49c067030 msgr2=0x7fe49c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7fe4b0c00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe49c067030 0x7fe49c0694f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc162390 tx=0x7fe4a8009040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7fe4b0c00640 1 -- 172.21.15.84:0/2160748719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc0b38d0 msgr2=0x7fe4bc149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.962+0000 7fe4b0c00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc0b38d0 0x7fe4bc149210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac01aa70 tx=0x7fe4ac01ac00 comp rx=0 tx=0).stop 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7fe4b0c00640 1 -- 172.21.15.84:0/2160748719 shutdown_connections 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7fe4b0c00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe49c067030 0x7fe49c0694f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7fe4b0c00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4bc14b890 0x7fe4bc160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7fe4b0c00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4bc0cb680 0x7fe4bc161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7fe4b0c00640 1 --2- 172.21.15.84:0/2160748719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4bc0b38d0 0x7fe4bc149210 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac01aa70 tx=0x7fe4ac01ac00 comp rx=0 tx=0).stop 2024-03-07T07:31:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7fe4b0c00640 1 -- 172.21.15.84:0/2160748719 >> 172.21.15.84:0/2160748719 conn(0x7fe4bc0cfba0 msgr2=0x7fe4bc0cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7fe4b0c00640 1 -- 172.21.15.84:0/2160748719 shutdown_connections 2024-03-07T07:31:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7fe4b0c00640 1 -- 172.21.15.84:0/2160748719 wait complete. 2024-03-07T07:31:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75bc066fb0 msgr2=0x7f75bc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75bc066fb0 0x7f75bc069470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0099e0 tx=0x7f75cc008040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75dc0d06c0 msgr2=0x7f75dc159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75dc0d06c0 0x7f75dc159490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c7e0 tx=0x7f75d400cca0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 shutdown_connections 2024-03-07T07:31:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75bc066fb0 0x7f75bc069470 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0099e0 tx=0x7f75cc008040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75dc0d06c0 0x7f75dc159490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc0b2d30 0x7f75dc158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 --2- 172.21.15.84:0/3428905939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75dc06ed30 0x7f75dc137ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 >> 172.21.15.84:0/3428905939 conn(0x7f75dc0cfba0 msgr2=0x7f75dc144ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 shutdown_connections 2024-03-07T07:31:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f75e3200640 1 -- 172.21.15.84:0/3428905939 wait complete. 2024-03-07T07:31:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.966+0000 7f5a1b400640 1 -- 172.21.15.84:0/1842864462 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a14058ea0 con 0x7f5a20005ea0 2024-03-07T07:31:24.980 INFO:teuthology.orchestra.run.smithi084.stdout:64424509446 2024-03-07T07:31:24.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.970+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd62c005590 con 0x7fd6540ce290 2024-03-07T07:31:24.981 INFO:teuthology.orchestra.run.smithi084.stdout:64424509446 2024-03-07T07:31:24.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fea1c062d40 con 0x7fea1c1436f0 2024-03-07T07:31:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.974+0000 7fd64a000640 1 -- 172.21.15.84:0/3224776127 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6440ef430 con 0x7fd6540ce290 2024-03-07T07:31:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5a08067030 msgr2=0x7f5a080694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5a08067030 0x7f5a080694f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0b2000 tx=0x7f5a1c004740 comp rx=0 tx=0).stop 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20005ea0 msgr2=0x7f5a20037400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20005ea0 0x7f5a20037400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c490 tx=0x7f5a14001e80 comp rx=0 tx=0).stop 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 shutdown_connections 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5a08067030 0x7f5a080694f0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0b2000 tx=0x7f5a1c004740 comp rx=0 tx=0).stop 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a20047c20 0x7f5a20034510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a20033e40 0x7f5a2004aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 --2- 172.21.15.84:0/1842864462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a20005ea0 0x7f5a20037400 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c490 tx=0x7f5a14001e80 comp rx=0 tx=0).stop 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 >> 172.21.15.84:0/1842864462 conn(0x7f5a20009fc0 msgr2=0x7f5a200062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7fea13e00640 1 -- 172.21.15.84:0/571077205 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea0c055b30 con 0x7fea1c1436f0 2024-03-07T07:31:24.985 INFO:teuthology.orchestra.run.smithi084.stdout:60129542151 2024-03-07T07:31:24.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.978+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd554005590 con 0x7fd57c15c370 2024-03-07T07:31:24.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 shutdown_connections 2024-03-07T07:31:24.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7f5a2d200640 1 -- 172.21.15.84:0/1842864462 wait complete. 2024-03-07T07:31:24.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd572a00640 1 -- 172.21.15.84:0/696642065 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd568058d20 con 0x7fd57c15c370 2024-03-07T07:31:24.986 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2024-03-07T07:31:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd634067030 msgr2=0x7fd6340694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd634067030 0x7fd6340694f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd640000f70 tx=0x7fd640009040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540ce290 msgr2=0x7fd654155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540ce290 0x7fd654155810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b2c0 tx=0x7fd64401b9b0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 shutdown_connections 2024-03-07T07:31:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd634067030 0x7fd6340694f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65413b5d0 0x7fd6540b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540ce290 0x7fd654155810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 --2- 172.21.15.84:0/3224776127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6540ccb60 0x7fd654157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 >> 172.21.15.84:0/3224776127 conn(0x7fd6540b2fa0 msgr2=0x7fd65406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 shutdown_connections 2024-03-07T07:31:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7fd659000640 1 -- 172.21.15.84:0/3224776127 wait complete. 2024-03-07T07:31:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f75ac005590 con 0x7f75d40717a0 2024-03-07T07:31:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.982+0000 7f75caa00640 1 -- 172.21.15.84:0/2995955643 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75cc059680 con 0x7f75d40717a0 2024-03-07T07:31:24.989 INFO:teuthology.orchestra.run.smithi084.stdout:60129542151 2024-03-07T07:31:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd55c067030 msgr2=0x7fd55c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd55c067030 0x7fd55c0694f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd574007e90 tx=0x7fd5740073a0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd57c15c370 msgr2=0x7fd57c14f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd57c15c370 0x7fd57c14f920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd56800c3f0 tx=0x7fd56800c8b0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 shutdown_connections 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd55c067030 0x7fd55c0694f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd57c15c370 0x7fd57c14f920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd57c144980 0x7fd57c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 --2- 172.21.15.84:0/696642065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c0cfe00 0x7fd57c1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 >> 172.21.15.84:0/696642065 conn(0x7fd57c06b0f0 msgr2=0x7fd57c0b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 shutdown_connections 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75b4066f90 msgr2=0x7f75b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75b4066f90 0x7f75b4069450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75c40ad000 tx=0x7f75c4008040 comp rx=0 tx=0).stop 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d40717a0 msgr2=0x7f75d4132cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d40717a0 0x7f75d4132cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00ba50 tx=0x7f75cc00bf10 comp rx=0 tx=0).stop 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 shutdown_connections 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f75b4066f90 0x7f75b4069450 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75d4140240 0x7f75d41fdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d4071c30 0x7f75d415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 --2- 172.21.15.84:0/2995955643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d40717a0 0x7f75d4132cf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 >> 172.21.15.84:0/2995955643 conn(0x7f75d4072240 msgr2=0x7f75d41372c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 shutdown_connections 2024-03-07T07:31:24.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fd57be00640 1 -- 172.21.15.84:0/696642065 wait complete. 2024-03-07T07:31:24.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7f75d9400640 1 -- 172.21.15.84:0/2995955643 wait complete. 2024-03-07T07:31:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe9fc066fe0 msgr2=0x7fe9fc0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fea23200640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe9fc066fe0 0x7fe9fc0694a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea140af000 tx=0x7fea14004bd0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea1c1436f0 msgr2=0x7fea1c0c2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.986+0000 7fea23200640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea1c1436f0 0x7fea1c0c2e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fea0c007310 tx=0x7fea0c0077d0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.990+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 shutdown_connections 2024-03-07T07:31:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.990+0000 7fea23200640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe9fc066fe0 0x7fe9fc0694a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.990+0000 7fea23200640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c15fa70 0x7fea1c0b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.990+0000 7fea23200640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1c143ad0 0x7fea1c0b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.990+0000 7fea23200640 1 --2- 172.21.15.84:0/571077205 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea1c1436f0 0x7fea1c0c2e70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.990+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 >> 172.21.15.84:0/571077205 conn(0x7fea1c0b2fa0 msgr2=0x7fea1c160fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.990+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 shutdown_connections 2024-03-07T07:31:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:24.990+0000 7fea23200640 1 -- 172.21.15.84:0/571077205 wait complete. 2024-03-07T07:31:25.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-03-07T07:31:25.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-03-07T07:31:25.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.6 2024-03-07T07:31:25.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-03-07T07:31:25.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-03-07T07:31:25.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.5 2024-03-07T07:31:25.034 DEBUG:teuthology.parallel:result is None 2024-03-07T07:31:25.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2024-03-07T07:31:25.035 DEBUG:teuthology.parallel:result is None 2024-03-07T07:31:25.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-03-07T07:31:25.035 DEBUG:teuthology.parallel:result is None 2024-03-07T07:31:26.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-07T07:31:26.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-07T07:31:26.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-07T07:31:26.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-07T07:31:26.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-07T07:31:26.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.154+0000 7f29d8000640 1 Processor -- start 2024-03-07T07:31:26.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.154+0000 7f29d8000640 1 -- start start 2024-03-07T07:31:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.154+0000 7f4a40e00640 1 Processor -- start 2024-03-07T07:31:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a40e00640 1 -- start start 2024-03-07T07:31:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d8000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d01405a0 0x7f29d015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d8000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d0140a30 con 0x7f29d00d0370 2024-03-07T07:31:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d8000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d0140d10 con 0x7f29d00d0750 2024-03-07T07:31:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d8000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d006e400 con 0x7f29d01405a0 2024-03-07T07:31:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d4c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d01405a0 0x7f29d015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d5600640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f29d00d0370 0x7f29d00cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33732/0 (socket says 172.21.15.84:33732) 2024-03-07T07:31:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d5600640 1 -- 172.21.15.84:0/1962340071 learned_addr learned my addr 172.21.15.84:0/1962340071 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d6000640 1 --1- 172.21.15.84:0/1962340071 >> v1:172.21.15.161:6789/0 conn(0x7f29d00d0750 0x7f29d00b2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41398/0 (socket says 172.21.15.84:41398) 2024-03-07T07:31:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d4c00640 1 -- 172.21.15.84:0/1962340071 >> v1:172.21.15.161:6789/0 conn(0x7f29d00d0750 legacy=0x7f29d00b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d4c00640 1 -- 172.21.15.84:0/1962340071 >> v1:172.21.15.84:6789/0 conn(0x7f29d00d0370 legacy=0x7f29d00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29d4c00640 1 -- 172.21.15.84:0/1962340071 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0140ff0 con 0x7f29d01405a0 2024-03-07T07:31:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f29cfe00640 1 -- 172.21.15.84:0/1962340071 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082868727 0 0) 0x7f29d0140d10 con 0x7f29d00d0750 2024-03-07T07:31:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a40e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c0cd540 0x7f4a3c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a40e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a3c070df0 0x7f4a3c0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a40e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c0b47c0 con 0x7f4a3c153190 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a40e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c0cca60 con 0x7f4a3c070df0 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a40e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0ccd40 con 0x7f4a3c0cd540 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a39e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4a3c153190 0x7f4a3c15ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41408/0 (socket says 172.21.15.84:41408) 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a39e00640 1 -- 172.21.15.84:0/4229923551 learned_addr learned my addr 172.21.15.84:0/4229923551 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a39400640 1 --2- 172.21.15.84:0/4229923551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c0cd540 0x7f4a3c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a3a800640 1 --2- 172.21.15.84:0/4229923551 >> v2:172.21.15.84:3300/0 conn(0x7f4a3c070df0 0x7f4a3c0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a38a00640 1 -- 172.21.15.84:0/4229923551 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835488624 0 0) 0x7f4a3c0b47c0 con 0x7f4a3c153190 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a38a00640 1 -- 172.21.15.84:0/4229923551 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a20003530 con 0x7f4a3c153190 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a39400640 1 -- 172.21.15.84:0/4229923551 >> v2:172.21.15.84:3300/0 conn(0x7f4a3c070df0 msgr2=0x7f4a3c0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a39400640 1 --2- 172.21.15.84:0/4229923551 >> v2:172.21.15.84:3300/0 conn(0x7f4a3c070df0 0x7f4a3c0ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a39400640 1 -- 172.21.15.84:0/4229923551 >> v1:172.21.15.161:6789/0 conn(0x7f4a3c153190 legacy=0x7f4a3c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a39400640 1 -- 172.21.15.84:0/4229923551 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c0b4400 con 0x7f4a3c0cd540 2024-03-07T07:31:26.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.158+0000 7f4a3a800640 1 --2- 172.21.15.84:0/4229923551 >> v2:172.21.15.84:3300/0 conn(0x7f4a3c070df0 0x7f4a3c0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:26.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29d4c00640 1 --2- 172.21.15.84:0/1962340071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d01405a0 0x7f29d015bd80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0097f0 tx=0x7f29bc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e59a720267051ae server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29cfe00640 1 -- 172.21.15.84:0/1962340071 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0b2070 con 0x7f29d01405a0 2024-03-07T07:31:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29cfe00640 1 -- 172.21.15.84:0/1962340071 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc0a9070 con 0x7f29d01405a0 2024-03-07T07:31:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29cfe00640 1 -- 172.21.15.84:0/1962340071 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0ad880 con 0x7f29d01405a0 2024-03-07T07:31:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29d8000640 1 -- 172.21.15.84:0/1962340071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d01405a0 msgr2=0x7f29d015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29d8000640 1 --2- 172.21.15.84:0/1962340071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d01405a0 0x7f29d015bd80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0097f0 tx=0x7f29bc01c450 comp rx=0 tx=0).stop 2024-03-07T07:31:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29d8000640 1 -- 172.21.15.84:0/1962340071 shutdown_connections 2024-03-07T07:31:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29d8000640 1 --2- 172.21.15.84:0/1962340071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d01405a0 0x7f29d015bd80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29d8000640 1 -- 172.21.15.84:0/1962340071 >> 172.21.15.84:0/1962340071 conn(0x7f29d006b0f0 msgr2=0x7f29d006b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29d8000640 1 -- 172.21.15.84:0/1962340071 shutdown_connections 2024-03-07T07:31:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f29d8000640 1 -- 172.21.15.84:0/1962340071 wait complete. 2024-03-07T07:31:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f4a39400640 1 --2- 172.21.15.84:0/4229923551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c0cd540 0x7f4a3c0708b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a280097c0 tx=0x7f4a2801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f3a65fc49140f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f4a38a00640 1 -- 172.21.15.84:0/4229923551 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280b0070 con 0x7f4a3c0cd540 2024-03-07T07:31:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f4a38a00640 1 -- 172.21.15.84:0/4229923551 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280ab600 con 0x7f4a3c0cd540 2024-03-07T07:31:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.162+0000 7f4a38a00640 1 -- 172.21.15.84:0/4229923551 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280ab9d0 con 0x7f4a3c0cd540 2024-03-07T07:31:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 -- 172.21.15.84:0/4229923551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c0cd540 msgr2=0x7f4a3c0708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 --2- 172.21.15.84:0/4229923551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c0cd540 0x7f4a3c0708b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a280097c0 tx=0x7f4a2801c430 comp rx=0 tx=0).stop 2024-03-07T07:31:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 -- 172.21.15.84:0/4229923551 shutdown_connections 2024-03-07T07:31:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 --2- 172.21.15.84:0/4229923551 >> v2:172.21.15.84:3300/0 conn(0x7f4a3c070df0 0x7f4a3c0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 --2- 172.21.15.84:0/4229923551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c0cd540 0x7f4a3c0708b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 -- 172.21.15.84:0/4229923551 >> 172.21.15.84:0/4229923551 conn(0x7f4a3c0b37a0 msgr2=0x7f4a3c0b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 -- 172.21.15.84:0/4229923551 shutdown_connections 2024-03-07T07:31:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 -- 172.21.15.84:0/4229923551 wait complete. 2024-03-07T07:31:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d8000640 1 Processor -- start 2024-03-07T07:31:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d8000640 1 -- start start 2024-03-07T07:31:26.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d8000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29d00d0370 0x7f29d0152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d8000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d00d0750 0x7f29d013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d8000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d013d090 0x7f29d015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d8000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d006f0a0 con 0x7f29d00d0750 2024-03-07T07:31:26.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d8000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d006f220 con 0x7f29d00d0370 2024-03-07T07:31:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d8000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d006f3a0 con 0x7f29d013d090 2024-03-07T07:31:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 Processor -- start 2024-03-07T07:31:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d5600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29d00d0370 0x7f29d0152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d5600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29d00d0370 0x7f29d0152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51184/0 (socket says 172.21.15.84:51184) 2024-03-07T07:31:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d5600640 1 -- 172.21.15.84:0/724482413 learned_addr learned my addr 172.21.15.84:0/724482413 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d6000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d013d090 0x7f29d015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f29d4c00640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d00d0750 0x7f29d013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.166+0000 7f4a40e00640 1 -- start start 2024-03-07T07:31:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d6000640 1 -- 172.21.15.84:0/724482413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29d00d0370 msgr2=0x7f29d0152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d6000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29d00d0370 0x7f29d0152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d6000640 1 -- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d00d0750 msgr2=0x7f29d013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d6000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d00d0750 0x7f29d013cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d6000640 1 -- 172.21.15.84:0/724482413 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0144040 con 0x7f29d013d090 2024-03-07T07:31:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d6000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d013d090 0x7f29d015e900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f29d015b340 tx=0x7f29c800cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29cd600640 1 -- 172.21.15.84:0/724482413 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8018070 con 0x7f29d013d090 2024-03-07T07:31:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29cd600640 1 -- 172.21.15.84:0/724482413 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c8004d90 con 0x7f29d013d090 2024-03-07T07:31:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d01434c0 con 0x7f29d013d090 2024-03-07T07:31:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29cd600640 1 -- 172.21.15.84:0/724482413 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c800a880 con 0x7f29d013d090 2024-03-07T07:31:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d0143a80 con 0x7f29d013d090 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a40e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c070df0 0x7f4a3c14f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a40e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0cd540 0x7f4a3c0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a40e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a3c153190 0x7f4a3c0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a40e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c071200 con 0x7f4a3c0cd540 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a40e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0cdbb0 con 0x7f4a3c153190 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a40e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c169610 con 0x7f4a3c070df0 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a39e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c070df0 0x7f4a3c14f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a39e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c070df0 0x7f4a3c14f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46260/0 (socket says 172.21.15.84:46260) 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a39e00640 1 -- 172.21.15.84:0/600509945 learned_addr learned my addr 172.21.15.84:0/600509945 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a3a800640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a3c153190 0x7f4a3c0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a39400640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0cd540 0x7f4a3c0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a3a800640 1 -- 172.21.15.84:0/600509945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c070df0 msgr2=0x7f4a3c14f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a3a800640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c070df0 0x7f4a3c14f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a3a800640 1 -- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0cd540 msgr2=0x7f4a3c0aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a3a800640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0cd540 0x7f4a3c0aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a3a800640 1 -- 172.21.15.84:0/600509945 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c14d360 con 0x7f4a3c153190 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a3a800640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a3c153190 0x7f4a3c0ab3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400cc90 tx=0x7f4a3400a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a32000640 1 -- 172.21.15.84:0/600509945 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400f680 con 0x7f4a3c153190 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a32000640 1 -- 172.21.15.84:0/600509945 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3400f840 con 0x7f4a3c153190 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a32000640 1 -- 172.21.15.84:0/600509945 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400fc30 con 0x7f4a3c153190 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c14d640 con 0x7f4a3c153190 2024-03-07T07:31:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c14dc00 con 0x7f4a3c153190 2024-03-07T07:31:26.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.170+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d0062d40 con 0x7f29d013d090 2024-03-07T07:31:26.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f29cd600640 1 -- 172.21.15.84:0/724482413 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f29c800aa20 con 0x7f29d013d090 2024-03-07T07:31:26.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c062d40 con 0x7f4a3c153190 2024-03-07T07:31:26.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f4a32000640 1 -- 172.21.15.84:0/600509945 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f4a3400e3e0 con 0x7f4a3c153190 2024-03-07T07:31:26.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f29cd600640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f29b0066f90 0x7f29b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f29cd600640 1 -- 172.21.15.84:0/724482413 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29c8084550 con 0x7f29d013d090 2024-03-07T07:31:26.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f4a32000640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4a1c066f60 0x7f4a1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f4a32000640 1 -- 172.21.15.84:0/600509945 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a34085c90 con 0x7f4a3c153190 2024-03-07T07:31:26.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f29d5600640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f29b0066f90 0x7f29b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f4a39e00640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4a1c066f60 0x7f4a1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.174+0000 7f4a39e00640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4a1c066f60 0x7f4a1c069420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0011f0 tx=0x7f4a2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.178+0000 7f29d5600640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f29b0066f90 0x7f29b0069450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29c4005890 tx=0x7f29c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.178+0000 7f29cd600640 1 -- 172.21.15.84:0/724482413 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f29c8054e70 con 0x7f29d013d090 2024-03-07T07:31:26.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.178+0000 7f4a32000640 1 -- 172.21.15.84:0/600509945 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f4a34014030 con 0x7f4a3c153190 2024-03-07T07:31:26.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.190+0000 7efca9000640 1 Processor -- start 2024-03-07T07:31:26.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.190+0000 7efca9000640 1 -- start start 2024-03-07T07:31:26.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca9000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efca4147d10 0x7efca40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca9000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4071600 0x7efca40b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca9000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efca40b3a00 0x7efca40aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca9000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca41480f0 con 0x7efca40b3a00 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca9000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40724f0 con 0x7efca4147d10 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca9000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca40b0f80 con 0x7efca4071600 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efca4147d10 0x7efca40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4071600 0x7efca40b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efca4147d10 0x7efca40b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51200/0 (socket says 172.21.15.84:51200) 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1e00640 1 -- 172.21.15.84:0/2903068613 learned_addr learned my addr 172.21.15.84:0/2903068613 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca2800640 1 --2- 172.21.15.84:0/2903068613 >> v2:172.21.15.84:3300/0 conn(0x7efca40b3a00 0x7efca40aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1400640 1 -- 172.21.15.84:0/2903068613 >> v2:172.21.15.161:3300/0 conn(0x7efca4147d10 msgr2=0x7efca40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1400640 1 --2- 172.21.15.84:0/2903068613 >> v2:172.21.15.161:3300/0 conn(0x7efca4147d10 0x7efca40b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1400640 1 -- 172.21.15.84:0/2903068613 >> v2:172.21.15.84:3300/0 conn(0x7efca40b3a00 msgr2=0x7efca40aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:26.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1400640 1 --2- 172.21.15.84:0/2903068613 >> v2:172.21.15.84:3300/0 conn(0x7efca40b3a00 0x7efca40aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.194+0000 7efca1400640 1 -- 172.21.15.84:0/2903068613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca40732f0 con 0x7efca4071600 2024-03-07T07:31:26.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca1400640 1 --2- 172.21.15.84:0/2903068613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4071600 0x7efca40b0700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efca406ef90 tx=0x7efc9001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a30da44d1d22c87 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca0a00640 1 -- 172.21.15.84:0/2903068613 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900b5070 con 0x7efca4071600 2024-03-07T07:31:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca0a00640 1 -- 172.21.15.84:0/2903068613 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc900a8930 con 0x7efca4071600 2024-03-07T07:31:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca0a00640 1 -- 172.21.15.84:0/2903068613 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900a8d00 con 0x7efca4071600 2024-03-07T07:31:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 -- 172.21.15.84:0/2903068613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4071600 msgr2=0x7efca40b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 --2- 172.21.15.84:0/2903068613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4071600 0x7efca40b0700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efca406ef90 tx=0x7efc9001ec70 comp rx=0 tx=0).stop 2024-03-07T07:31:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 -- 172.21.15.84:0/2903068613 shutdown_connections 2024-03-07T07:31:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 --2- 172.21.15.84:0/2903068613 >> v2:172.21.15.84:3300/0 conn(0x7efca40b3a00 0x7efca40aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 --2- 172.21.15.84:0/2903068613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4071600 0x7efca40b0700 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 --2- 172.21.15.84:0/2903068613 >> v2:172.21.15.161:3300/0 conn(0x7efca4147d10 0x7efca40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 -- 172.21.15.84:0/2903068613 >> 172.21.15.84:0/2903068613 conn(0x7efca40b1ed0 msgr2=0x7efca40b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 -- 172.21.15.84:0/2903068613 shutdown_connections 2024-03-07T07:31:26.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.198+0000 7efca9000640 1 -- 172.21.15.84:0/2903068613 wait complete. 2024-03-07T07:31:26.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca9000640 1 Processor -- start 2024-03-07T07:31:26.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca9000640 1 -- start start 2024-03-07T07:31:26.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca9000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca4071600 0x7efca4142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca40b3a00 0x7efca415dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca9000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4147d10 0x7efca40cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca9000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca4072d30 con 0x7efca40b3a00 2024-03-07T07:31:26.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca9000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca4072a50 con 0x7efca4071600 2024-03-07T07:31:26.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca9000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca4073010 con 0x7efca4147d10 2024-03-07T07:31:26.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca40b3a00 0x7efca415dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca1e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca4071600 0x7efca4142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca2800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4147d10 0x7efca40cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca40b3a00 0x7efca415dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50150/0 (socket says 172.21.15.84:50150) 2024-03-07T07:31:26.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca1e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca4071600 0x7efca4142c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51216/0 (socket says 172.21.15.84:51216) 2024-03-07T07:31:26.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca1400640 1 -- 172.21.15.84:0/3415504177 learned_addr learned my addr 172.21.15.84:0/3415504177 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca2800640 1 -- 172.21.15.84:0/3415504177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca4071600 msgr2=0x7efca4142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca2800640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca4071600 0x7efca4142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca2800640 1 -- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca40b3a00 msgr2=0x7efca415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca2800640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca40b3a00 0x7efca415dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca2800640 1 -- 172.21.15.84:0/3415504177 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4141340 con 0x7efca4147d10 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.202+0000 7efca2800640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4147d10 0x7efca40cd5d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00eed0 tx=0x7efc9c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efc9a000640 1 -- 172.21.15.84:0/3415504177 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c018020 con 0x7efca4147d10 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efc9a000640 1 -- 172.21.15.84:0/3415504177 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c014400 con 0x7efca4147d10 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efc9a000640 1 -- 172.21.15.84:0/3415504177 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c009e60 con 0x7efca4147d10 2024-03-07T07:31:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca4141bf0 con 0x7efca4147d10 2024-03-07T07:31:26.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca4142430 con 0x7efca4147d10 2024-03-07T07:31:26.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca4062d40 con 0x7efca4147d10 2024-03-07T07:31:26.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efc9a000640 1 -- 172.21.15.84:0/3415504177 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7efc9c01b020 con 0x7efca4147d10 2024-03-07T07:31:26.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efc9a000640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7efc84066f60 0x7efc84069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efc9a000640 1 -- 172.21.15.84:0/3415504177 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc9c085880 con 0x7efca4147d10 2024-03-07T07:31:26.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.206+0000 7efca1e00640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7efc84066f60 0x7efc84069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.210+0000 7efca1e00640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7efc84066f60 0x7efc84069420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc94009ab0 tx=0x7efc94009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.210+0000 7efc9a000640 1 -- 172.21.15.84:0/3415504177 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7efc9c022030 con 0x7efca4147d10 2024-03-07T07:31:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c54800640 1 Processor -- start 2024-03-07T07:31:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c54800640 1 -- start start 2024-03-07T07:31:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c54800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c15c1f0 0x7f8c4c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c54800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c4c0cf100 0x7f8c4c0d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c54800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4c0b0290 con 0x7f8c4c0b3a00 2024-03-07T07:31:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c54800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4c0b1d40 con 0x7f8c4c0cf100 2024-03-07T07:31:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c54800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0b0570 con 0x7f8c4c15c1f0 2024-03-07T07:31:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c15c1f0 0x7f8c4c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c4c0cf100 0x7f8c4c0d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c15c1f0 0x7f8c4c0b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46278/0 (socket says 172.21.15.84:46278) 2024-03-07T07:31:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c4c0cf100 0x7f8c4c0d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51226/0 (socket says 172.21.15.84:51226) 2024-03-07T07:31:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51e00640 1 -- 172.21.15.84:0/3452836499 learned_addr learned my addr 172.21.15.84:0/3452836499 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c52800640 1 --1- 172.21.15.84:0/3452836499 >> v1:172.21.15.161:6789/0 conn(0x7f8c4c0b3a00 0x7f8c4c15c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41424/0 (socket says 172.21.15.84:41424) 2024-03-07T07:31:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51e00640 1 -- 172.21.15.84:0/3452836499 >> v2:172.21.15.161:3300/0 conn(0x7f8c4c0cf100 msgr2=0x7f8c4c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51e00640 1 --2- 172.21.15.84:0/3452836499 >> v2:172.21.15.161:3300/0 conn(0x7f8c4c0cf100 0x7f8c4c0d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51e00640 1 -- 172.21.15.84:0/3452836499 >> v1:172.21.15.161:6789/0 conn(0x7f8c4c0b3a00 legacy=0x7f8c4c15c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c50a00640 1 -- 172.21.15.84:0/3452836499 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835260056 0 0) 0x7f8c4c0b0290 con 0x7f8c4c0b3a00 2024-03-07T07:31:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.222+0000 7f8c51e00640 1 -- 172.21.15.84:0/3452836499 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c0b0850 con 0x7f8c4c15c1f0 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c51e00640 1 --2- 172.21.15.84:0/3452836499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c15c1f0 0x7f8c4c0b1330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009870 tx=0x7f8c4001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fa71bc44984487b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c50a00640 1 -- 172.21.15.84:0/3452836499 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400b0070 con 0x7f8c4c15c1f0 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c50a00640 1 -- 172.21.15.84:0/3452836499 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c400ab600 con 0x7f8c4c15c1f0 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c50a00640 1 -- 172.21.15.84:0/3452836499 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400ab9d0 con 0x7f8c4c15c1f0 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c54800640 1 -- 172.21.15.84:0/3452836499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c15c1f0 msgr2=0x7f8c4c0b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c54800640 1 --2- 172.21.15.84:0/3452836499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c15c1f0 0x7f8c4c0b1330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009870 tx=0x7f8c4001c4d0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c54800640 1 -- 172.21.15.84:0/3452836499 shutdown_connections 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c54800640 1 --2- 172.21.15.84:0/3452836499 >> v2:172.21.15.161:3300/0 conn(0x7f8c4c0cf100 0x7f8c4c0d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c54800640 1 --2- 172.21.15.84:0/3452836499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c15c1f0 0x7f8c4c0b1330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c54800640 1 -- 172.21.15.84:0/3452836499 >> 172.21.15.84:0/3452836499 conn(0x7f8c4c0b1ed0 msgr2=0x7f8c4c0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c54800640 1 -- 172.21.15.84:0/3452836499 shutdown_connections 2024-03-07T07:31:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.226+0000 7f8c54800640 1 -- 172.21.15.84:0/3452836499 wait complete. 2024-03-07T07:31:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 Processor -- start 2024-03-07T07:31:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 -- start start 2024-03-07T07:31:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c4c0b3a00 0x7f8c4c147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c0cf100 0x7f8c4c0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c4c15c1f0 0x7f8c4c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c168e60 con 0x7f8c4c0b3a00 2024-03-07T07:31:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c168ce0 con 0x7f8c4c15c1f0 2024-03-07T07:31:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c168fe0 con 0x7f8c4c0cf100 2024-03-07T07:31:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c4c0b3a00 0x7f8c4c147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c4c0b3a00 0x7f8c4c147c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50158/0 (socket says 172.21.15.84:50158) 2024-03-07T07:31:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51e00640 1 -- 172.21.15.84:0/2151793613 learned_addr learned my addr 172.21.15.84:0/2151793613 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51400640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c0cf100 0x7f8c4c0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c52800640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c4c15c1f0 0x7f8c4c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51400640 1 -- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c4c15c1f0 msgr2=0x7f8c4c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51400640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c4c15c1f0 0x7f8c4c0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51400640 1 -- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c4c0b3a00 msgr2=0x7f8c4c147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51400640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c4c0b3a00 0x7f8c4c147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51400640 1 -- 172.21.15.84:0/2151793613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c0b6010 con 0x7f8c4c0cf100 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51e00640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c4c0b3a00 0x7f8c4c147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c51400640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c0cf100 0x7f8c4c0ccdc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00e870 tx=0x7f8c3c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c46000640 1 -- 172.21.15.84:0/2151793613 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c017070 con 0x7f8c4c0cf100 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c46000640 1 -- 172.21.15.84:0/2151793613 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c00c940 con 0x7f8c4c0cf100 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c46000640 1 -- 172.21.15.84:0/2151793613 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00ccf0 con 0x7f8c4c0cf100 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c0b5400 con 0x7f8c4c0cf100 2024-03-07T07:31:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.230+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4c0b59c0 con 0x7f8c4c0cf100 2024-03-07T07:31:26.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.234+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4c062d40 con 0x7f8c4c0cf100 2024-03-07T07:31:26.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.234+0000 7f8c46000640 1 -- 172.21.15.84:0/2151793613 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f8c3c01a070 con 0x7f8c4c0cf100 2024-03-07T07:31:26.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.234+0000 7f8c46000640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8c30066f90 0x7f8c30069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.234+0000 7f8c46000640 1 -- 172.21.15.84:0/2151793613 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c3c084f30 con 0x7f8c4c0cf100 2024-03-07T07:31:26.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.234+0000 7f8c51e00640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8c30066f90 0x7f8c30069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.234+0000 7f8c51e00640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8c30066f90 0x7f8c30069450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009870 tx=0x7f8c400a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.242+0000 7f8c46000640 1 -- 172.21.15.84:0/2151793613 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f8c3c0558e0 con 0x7f8c4c0cf100 2024-03-07T07:31:26.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe52ea00640 1 Processor -- start 2024-03-07T07:31:26.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe52ea00640 1 -- start start 2024-03-07T07:31:26.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe52ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe528165fc0 0x7fe5280b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe52ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe52ea00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5280b4a90 con 0x7fe528162370 2024-03-07T07:31:26.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe52ea00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe528070e80 con 0x7fe528165fc0 2024-03-07T07:31:26.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe52ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280b4d70 con 0x7fe5280704f0 2024-03-07T07:31:26.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe527400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe528165fc0 0x7fe5280b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe527400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe528165fc0 0x7fe5280b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51254/0 (socket says 172.21.15.84:51254) 2024-03-07T07:31:26.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe527400640 1 -- 172.21.15.84:0/2426954076 learned_addr learned my addr 172.21.15.84:0/2426954076 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe527e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe528162370 0x7fe5280ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41430/0 (socket says 172.21.15.84:41430) 2024-03-07T07:31:26.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe52ca00640 1 --2- 172.21.15.84:0/2426954076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe527400640 1 -- 172.21.15.84:0/2426954076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 msgr2=0x7fe528070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:26.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe527400640 1 --2- 172.21.15.84:0/2426954076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe527400640 1 -- 172.21.15.84:0/2426954076 >> v1:172.21.15.161:6789/0 conn(0x7fe528162370 legacy=0x7fe5280ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.270+0000 7fe527400640 1 -- 172.21.15.84:0/2426954076 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5280b5050 con 0x7fe528165fc0 2024-03-07T07:31:26.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe527400640 1 --2- 172.21.15.84:0/2426954076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 0x7fe5280b4400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe514009870 tx=0x7fe51401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=315ce0fb4bfa7122 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe526a00640 1 -- 172.21.15.84:0/2426954076 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140ab650 con 0x7fe528165fc0 2024-03-07T07:31:26.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe526a00640 1 -- 172.21.15.84:0/2426954076 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5140b0070 con 0x7fe528165fc0 2024-03-07T07:31:26.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe526a00640 1 -- 172.21.15.84:0/2426954076 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140aba10 con 0x7fe528165fc0 2024-03-07T07:31:26.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe52ea00640 1 -- 172.21.15.84:0/2426954076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 msgr2=0x7fe5280b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2426954076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 0x7fe5280b4400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe514009870 tx=0x7fe51401c560 comp rx=0 tx=0).stop 2024-03-07T07:31:26.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe52ea00640 1 -- 172.21.15.84:0/2426954076 shutdown_connections 2024-03-07T07:31:26.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2426954076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2426954076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 0x7fe5280b4400 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe52ea00640 1 -- 172.21.15.84:0/2426954076 >> 172.21.15.84:0/2426954076 conn(0x7fe52806b0f0 msgr2=0x7fe52806b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe52ea00640 1 -- 172.21.15.84:0/2426954076 shutdown_connections 2024-03-07T07:31:26.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.274+0000 7fe52ea00640 1 -- 172.21.15.84:0/2426954076 wait complete. 2024-03-07T07:31:26.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ea00640 1 Processor -- start 2024-03-07T07:31:26.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ea00640 1 -- start start 2024-03-07T07:31:26.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe528162370 0x7fe528160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 0x7fe528167e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280b6340 con 0x7fe528162370 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ea00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe528162750 con 0x7fe528165fc0 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280b64c0 con 0x7fe5280704f0 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe528162370 0x7fe528160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46308/0 (socket says 172.21.15.84:46308) 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 -- 172.21.15.84:0/2227624558 learned_addr learned my addr 172.21.15.84:0/2227624558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe52ca00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 0x7fe528167e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 -- 172.21.15.84:0/2227624558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 msgr2=0x7fe528167e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 0x7fe528167e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 -- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe528162370 msgr2=0x7fe528160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe528162370 0x7fe528160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 -- 172.21.15.84:0/2227624558 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe528158100 con 0x7fe5280704f0 2024-03-07T07:31:26.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.278+0000 7fe527e00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528158350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe51800c420 tx=0x7fe51800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe51fe00640 1 -- 172.21.15.84:0/2227624558 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5180074e0 con 0x7fe5280704f0 2024-03-07T07:31:26.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe51fe00640 1 -- 172.21.15.84:0/2227624558 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5180076a0 con 0x7fe5280704f0 2024-03-07T07:31:26.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe51fe00640 1 -- 172.21.15.84:0/2227624558 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518004a30 con 0x7fe5280704f0 2024-03-07T07:31:26.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5281610d0 con 0x7fe5280704f0 2024-03-07T07:31:26.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe528161690 con 0x7fe5280704f0 2024-03-07T07:31:26.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe528062d40 con 0x7fe5280704f0 2024-03-07T07:31:26.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe51fe00640 1 -- 172.21.15.84:0/2227624558 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe51801a020 con 0x7fe5280704f0 2024-03-07T07:31:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe51fe00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe508066f90 0x7fe508069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe51fe00640 1 -- 172.21.15.84:0/2227624558 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5180846a0 con 0x7fe5280704f0 2024-03-07T07:31:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.282+0000 7fe527400640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe508066f90 0x7fe508069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.286+0000 7fe527400640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe508066f90 0x7fe508069450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe5140af000 tx=0x7fe5140a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.290+0000 7fe51fe00640 1 -- 172.21.15.84:0/2227624558 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe528158100 con 0x7fe5280704f0 2024-03-07T07:31:26.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.402+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efca40b3640 con 0x7efca4147d10 2024-03-07T07:31:26.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.402+0000 7efc9a000640 1 -- 172.21.15.84:0/3415504177 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efca4141bf0 con 0x7efca4147d10 2024-03-07T07:31:26.406 INFO:teuthology.orchestra.run.smithi084.stdout:64424509446 2024-03-07T07:31:26.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7efc84066f60 msgr2=0x7efc84069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7efc84066f60 0x7efc84069420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc94009ab0 tx=0x7efc94009240 comp rx=0 tx=0).stop 2024-03-07T07:31:26.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4147d10 msgr2=0x7efca40cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4147d10 0x7efca40cd5d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00eed0 tx=0x7efc9c00b480 comp rx=0 tx=0).stop 2024-03-07T07:31:26.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 shutdown_connections 2024-03-07T07:31:26.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7efc84066f60 0x7efc84069420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca4147d10 0x7efca40cd5d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca40b3a00 0x7efca415dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 --2- 172.21.15.84:0/3415504177 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca4071600 0x7efca4142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 >> 172.21.15.84:0/3415504177 conn(0x7efca40b1ed0 msgr2=0x7efca406b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 shutdown_connections 2024-03-07T07:31:26.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.406+0000 7efca9000640 1 -- 172.21.15.84:0/3415504177 wait complete. 2024-03-07T07:31:26.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.410+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c4c15c870 con 0x7f8c4c0cf100 2024-03-07T07:31:26.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.410+0000 7f8c46000640 1 -- 172.21.15.84:0/2151793613 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c3c059980 con 0x7f8c4c0cf100 2024-03-07T07:31:26.414 INFO:teuthology.orchestra.run.smithi084.stdout:64424509447 2024-03-07T07:31:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.410+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8c30066f90 msgr2=0x7f8c30069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.410+0000 7f8c54800640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8c30066f90 0x7f8c30069450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009870 tx=0x7f8c400a6000 comp rx=0 tx=0).stop 2024-03-07T07:31:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.410+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c0cf100 msgr2=0x7f8c4c0ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.410+0000 7f8c54800640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c0cf100 0x7f8c4c0ccdc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00e870 tx=0x7f8c3c00ed30 comp rx=0 tx=0).stop 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.414+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 shutdown_connections 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.414+0000 7f8c54800640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8c30066f90 0x7f8c30069450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.414+0000 7f8c54800640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c4c15c1f0 0x7f8c4c0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.414+0000 7f8c54800640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c4c0cf100 0x7f8c4c0ccdc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.414+0000 7f8c54800640 1 --2- 172.21.15.84:0/2151793613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c4c0b3a00 0x7f8c4c147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.414+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 >> 172.21.15.84:0/2151793613 conn(0x7f8c4c0b1ed0 msgr2=0x7f8c4c0b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.414+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 shutdown_connections 2024-03-07T07:31:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.414+0000 7f8c54800640 1 -- 172.21.15.84:0/2151793613 wait complete. 2024-03-07T07:31:26.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-03-07T07:31:26.435 DEBUG:teuthology.parallel:result is None 2024-03-07T07:31:26.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-03-07T07:31:26.437 DEBUG:teuthology.parallel:result is None 2024-03-07T07:31:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.458+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5280cd3c0 con 0x7fe5280704f0 2024-03-07T07:31:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe51fe00640 1 -- 172.21.15.84:0/2227624558 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe518055050 con 0x7fe5280704f0 2024-03-07T07:31:26.465 INFO:teuthology.orchestra.run.smithi084.stdout:64424509447 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe508066f90 msgr2=0x7fe508069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe508066f90 0x7fe508069450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe5140af000 tx=0x7fe5140a7000 comp rx=0 tx=0).stop 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 msgr2=0x7fe528158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528158350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe51800c420 tx=0x7fe51800c8e0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 shutdown_connections 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe508066f90 0x7fe508069450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528165fc0 0x7fe528167e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe528162370 0x7fe528160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 --2- 172.21.15.84:0/2227624558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5280704f0 0x7fe528158350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 >> 172.21.15.84:0/2227624558 conn(0x7fe52806b0f0 msgr2=0x7fe528165810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 shutdown_connections 2024-03-07T07:31:26.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.462+0000 7fe52ea00640 1 -- 172.21.15.84:0/2227624558 wait complete. 2024-03-07T07:31:26.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-03-07T07:31:26.485 DEBUG:teuthology.parallel:result is None 2024-03-07T07:31:26.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.482+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f29d0068200 con 0x7f29d013d090 2024-03-07T07:31:26.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.482+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4a3c072210 con 0x7f4a3c153190 2024-03-07T07:31:26.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.482+0000 7f29cd600640 1 -- 172.21.15.84:0/724482413 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29c8058f10 con 0x7f29d013d090 2024-03-07T07:31:26.488 INFO:teuthology.orchestra.run.smithi084.stdout:64424509447 2024-03-07T07:31:26.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.482+0000 7f4a32000640 1 -- 172.21.15.84:0/600509945 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a340565b0 con 0x7f4a3c153190 2024-03-07T07:31:26.489 INFO:teuthology.orchestra.run.smithi084.stdout:60129542151 2024-03-07T07:31:26.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f29b0066f90 msgr2=0x7f29b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f29b0066f90 0x7f29b0069450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29c4005890 tx=0x7f29c4009040 comp rx=0 tx=0).stop 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d013d090 msgr2=0x7f29d015e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d013d090 0x7f29d015e900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f29d015b340 tx=0x7f29c800cb70 comp rx=0 tx=0).stop 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 shutdown_connections 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f29b0066f90 0x7f29b0069450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29d013d090 0x7f29d015e900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d00d0750 0x7f29d013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 --2- 172.21.15.84:0/724482413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29d00d0370 0x7f29d0152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 >> 172.21.15.84:0/724482413 conn(0x7f29d006b0f0 msgr2=0x7f29d00b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 shutdown_connections 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4a1c066f60 msgr2=0x7f4a1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4a1c066f60 0x7f4a1c069420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0011f0 tx=0x7f4a2c009040 comp rx=0 tx=0).stop 2024-03-07T07:31:26.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f29d8000640 1 -- 172.21.15.84:0/724482413 wait complete. 2024-03-07T07:31:26.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a3c153190 msgr2=0x7f4a3c0ab3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a3c153190 0x7f4a3c0ab3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400cc90 tx=0x7f4a3400a650 comp rx=0 tx=0).stop 2024-03-07T07:31:26.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 shutdown_connections 2024-03-07T07:31:26.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4a1c066f60 0x7f4a1c069420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a3c153190 0x7f4a3c0ab3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0cd540 0x7f4a3c0aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 --2- 172.21.15.84:0/600509945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a3c070df0 0x7f4a3c14f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 >> 172.21.15.84:0/600509945 conn(0x7f4a3c0b37a0 msgr2=0x7f4a3c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 shutdown_connections 2024-03-07T07:31:26.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.486+0000 7f4a40e00640 1 -- 172.21.15.84:0/600509945 wait complete. 2024-03-07T07:31:26.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-03-07T07:31:26.511 DEBUG:teuthology.parallel:result is None 2024-03-07T07:31:26.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-03-07T07:31:26.511 DEBUG:teuthology.parallel:result is None 2024-03-07T07:31:26.512 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-07T07:31:26.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:31:26.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f621da00640 1 Processor -- start 2024-03-07T07:31:26.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f621da00640 1 -- start start 2024-03-07T07:31:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f621da00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070750 0x7f621815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f621da00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6218159c60 0x7f62180ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f621da00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62180aee40 con 0x7f6218070b30 2024-03-07T07:31:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f621da00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621815fa90 con 0x7f6218159c60 2024-03-07T07:31:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f621da00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62180aebe0 con 0x7f6218070750 2024-03-07T07:31:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f6216a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070750 0x7f621815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f6216a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070750 0x7f621815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46316/0 (socket says 172.21.15.84:46316) 2024-03-07T07:31:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f6216a00640 1 -- 172.21.15.84:0/178701037 learned_addr learned my addr 172.21.15.84:0/178701037 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f6217400640 1 --2- 172.21.15.84:0/178701037 >> v2:172.21.15.161:3300/0 conn(0x7f6218159c60 0x7f62180ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f6216a00640 1 -- 172.21.15.84:0/178701037 >> v2:172.21.15.161:3300/0 conn(0x7f6218159c60 msgr2=0x7f62180ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f6216a00640 1 --2- 172.21.15.84:0/178701037 >> v2:172.21.15.161:3300/0 conn(0x7f6218159c60 0x7f62180ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f6216a00640 1 -- 172.21.15.84:0/178701037 >> v1:172.21.15.161:6789/0 conn(0x7f6218070b30 legacy=0x7f6218159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.682+0000 7f6216a00640 1 -- 172.21.15.84:0/178701037 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62180af120 con 0x7f6218070750 2024-03-07T07:31:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f6216a00640 1 --2- 172.21.15.84:0/178701037 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070750 0x7f621815d020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6208009e50 tx=0x7f620801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c04b7dae39c510 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f6215600640 1 -- 172.21.15.84:0/178701037 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080a5750 con 0x7f6218070750 2024-03-07T07:31:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f6215600640 1 -- 172.21.15.84:0/178701037 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080a58f0 con 0x7f6218070750 2024-03-07T07:31:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f6215600640 1 -- 172.21.15.84:0/178701037 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080a5cc0 con 0x7f6218070750 2024-03-07T07:31:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f621da00640 1 -- 172.21.15.84:0/178701037 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070750 msgr2=0x7f621815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f621da00640 1 --2- 172.21.15.84:0/178701037 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070750 0x7f621815d020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6208009e50 tx=0x7f620801c9a0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f621da00640 1 -- 172.21.15.84:0/178701037 shutdown_connections 2024-03-07T07:31:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f621da00640 1 --2- 172.21.15.84:0/178701037 >> v2:172.21.15.161:3300/0 conn(0x7f6218159c60 0x7f62180ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f621da00640 1 --2- 172.21.15.84:0/178701037 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070750 0x7f621815d020 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f621da00640 1 -- 172.21.15.84:0/178701037 >> 172.21.15.84:0/178701037 conn(0x7f621806b0f0 msgr2=0x7f621806b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f621da00640 1 -- 172.21.15.84:0/178701037 shutdown_connections 2024-03-07T07:31:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.686+0000 7f621da00640 1 -- 172.21.15.84:0/178701037 wait complete. 2024-03-07T07:31:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 Processor -- start 2024-03-07T07:31:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 -- start start 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6218070750 0x7f62180b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070b30 0x7f6218154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6218159c60 0x7f62181551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62180b55e0 con 0x7f6218070750 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62180b5460 con 0x7f6218159c60 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62180b5760 con 0x7f6218070b30 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6218070750 0x7f62180b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6218070750 0x7f62180b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50170/0 (socket says 172.21.15.84:50170) 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 -- 172.21.15.84:0/692611100 learned_addr learned my addr 172.21.15.84:0/692611100 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216000640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070b30 0x7f6218154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6217400640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6218159c60 0x7f62181551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 -- 172.21.15.84:0/692611100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070b30 msgr2=0x7f6218154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070b30 0x7f6218154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 -- 172.21.15.84:0/692611100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6218159c60 msgr2=0x7f62181551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6218159c60 0x7f62181551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 -- 172.21.15.84:0/692611100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6218153bd0 con 0x7f6218070750 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f6216a00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6218070750 0x7f62180b1ba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f620801a5d0 tx=0x7f6208019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f620ea00640 1 -- 172.21.15.84:0/692611100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080bc020 con 0x7f6218070750 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f620ea00640 1 -- 172.21.15.84:0/692611100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080b8670 con 0x7f6218070750 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6218153eb0 con 0x7f6218070750 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f620ea00640 1 -- 172.21.15.84:0/692611100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080b8a40 con 0x7f6218070750 2024-03-07T07:31:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6218154470 con 0x7f6218070750 2024-03-07T07:31:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.690+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6218062d40 con 0x7f6218070750 2024-03-07T07:31:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.694+0000 7f620ea00640 1 -- 172.21.15.84:0/692611100 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f62080bf020 con 0x7f6218070750 2024-03-07T07:31:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.694+0000 7f620ea00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f61f8066f60 0x7f61f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.694+0000 7f620ea00640 1 -- 172.21.15.84:0/692611100 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f620811ffd0 con 0x7f6218070750 2024-03-07T07:31:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.694+0000 7f6216000640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f61f8066f60 0x7f61f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.694+0000 7f6216000640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f61f8066f60 0x7f61f8069420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f62181501d0 tx=0x7f6204009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.698+0000 7f620ea00640 1 -- 172.21.15.84:0/692611100 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f62080c6030 con 0x7f6218070750 2024-03-07T07:31:26.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.850+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6218074770 con 0x7f61f8066f60 2024-03-07T07:31:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f620ea00640 1 -- 172.21.15.84:0/692611100 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251833 (secure 0 0 0) 0x7f6218074770 con 0x7f61f8066f60 2024-03-07T07:31:26.863 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:31:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f61f8066f60 msgr2=0x7f61f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f61f8066f60 0x7f61f8069420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f62181501d0 tx=0x7f6204009040 comp rx=0 tx=0).stop 2024-03-07T07:31:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6218070750 msgr2=0x7f62180b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6218070750 0x7f62180b1ba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f620801a5d0 tx=0x7f6208019740 comp rx=0 tx=0).stop 2024-03-07T07:31:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 shutdown_connections 2024-03-07T07:31:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f61f8066f60 0x7f61f8069420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6218159c60 0x7f62181551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6218070b30 0x7f6218154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 --2- 172.21.15.84:0/692611100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6218070750 0x7f62180b1ba0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 >> 172.21.15.84:0/692611100 conn(0x7f621806b0f0 msgr2=0x7f62181526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 shutdown_connections 2024-03-07T07:31:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:26.858+0000 7f621da00640 1 -- 172.21.15.84:0/692611100 wait complete. 2024-03-07T07:31:26.883 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-03-07T07:31:24.882584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219036,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755684,"statfs":{"total":773094113280,"available":772869820416,"internally_reserved":0,"allocated":2924544,"data_stored":1765772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.005357"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507368+0000","last_change":"2024-03-07T07:31:14.022667+0000","last_active":"2024-03-07T07:31:15.507368+0000","last_peered":"2024-03-07T07:31:15.507368+0000","last_clean":"2024-03-07T07:31:15.507368+0000","last_became_active":"2024-03-07T07:31:14.021747+0000","last_became_peered":"2024-03-07T07:31:14.021747+0000","last_unstale":"2024-03-07T07:31:15.507368+0000","last_undegraded":"2024-03-07T07:31:15.507368+0000","last_fullsized":"2024-03-07T07:31:15.507368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:54:30.956919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507636+0000","last_change":"2024-03-07T07:31:14.025493+0000","last_active":"2024-03-07T07:31:15.507636+0000","last_peered":"2024-03-07T07:31:15.507636+0000","last_clean":"2024-03-07T07:31:15.507636+0000","last_became_active":"2024-03-07T07:31:14.025150+0000","last_became_peered":"2024-03-07T07:31:14.025150+0000","last_unstale":"2024-03-07T07:31:15.507636+0000","last_undegraded":"2024-03-07T07:31:15.507636+0000","last_fullsized":"2024-03-07T07:31:15.507636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507618+0000","last_change":"2024-03-07T07:31:14.020208+0000","last_active":"2024-03-07T07:31:15.507618+0000","last_peered":"2024-03-07T07:31:15.507618+0000","last_clean":"2024-03-07T07:31:15.507618+0000","last_became_active":"2024-03-07T07:31:14.019922+0000","last_became_peered":"2024-03-07T07:31:14.019922+0000","last_unstale":"2024-03-07T07:31:15.507618+0000","last_undegraded":"2024-03-07T07:31:15.507618+0000","last_fullsized":"2024-03-07T07:31:15.507618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004299+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:15.004299+0000","last_peered":"2024-03-07T07:31:15.004299+0000","last_clean":"2024-03-07T07:31:15.004299+0000","last_became_active":"2024-03-07T07:31:14.014792+0000","last_became_peered":"2024-03-07T07:31:14.014792+0000","last_unstale":"2024-03-07T07:31:15.004299+0000","last_undegraded":"2024-03-07T07:31:15.004299+0000","last_fullsized":"2024-03-07T07:31:15.004299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506999+0000","last_change":"2024-03-07T07:31:14.020574+0000","last_active":"2024-03-07T07:31:15.506999+0000","last_peered":"2024-03-07T07:31:15.506999+0000","last_clean":"2024-03-07T07:31:15.506999+0000","last_became_active":"2024-03-07T07:31:14.020305+0000","last_became_peered":"2024-03-07T07:31:14.020305+0000","last_unstale":"2024-03-07T07:31:15.506999+0000","last_undegraded":"2024-03-07T07:31:15.506999+0000","last_fullsized":"2024-03-07T07:31:15.506999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004168+0000","last_change":"2024-03-07T07:31:14.014335+0000","last_active":"2024-03-07T07:31:15.004168+0000","last_peered":"2024-03-07T07:31:15.004168+0000","last_clean":"2024-03-07T07:31:15.004168+0000","last_became_active":"2024-03-07T07:31:14.013975+0000","last_became_peered":"2024-03-07T07:31:14.013975+0000","last_unstale":"2024-03-07T07:31:15.004168+0000","last_undegraded":"2024-03-07T07:31:15.004168+0000","last_fullsized":"2024-03-07T07:31:15.004168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:56.429772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506827+0000","last_change":"2024-03-07T07:31:14.021322+0000","last_active":"2024-03-07T07:31:15.506827+0000","last_peered":"2024-03-07T07:31:15.506827+0000","last_clean":"2024-03-07T07:31:15.506827+0000","last_became_active":"2024-03-07T07:31:14.021007+0000","last_became_peered":"2024-03-07T07:31:14.021007+0000","last_unstale":"2024-03-07T07:31:15.506827+0000","last_undegraded":"2024-03-07T07:31:15.506827+0000","last_fullsized":"2024-03-07T07:31:15.506827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507184+0000","last_change":"2024-03-07T07:31:14.027374+0000","last_active":"2024-03-07T07:31:15.507184+0000","last_peered":"2024-03-07T07:31:15.507184+0000","last_clean":"2024-03-07T07:31:15.507184+0000","last_became_active":"2024-03-07T07:31:14.027198+0000","last_became_peered":"2024-03-07T07:31:14.027198+0000","last_unstale":"2024-03-07T07:31:15.507184+0000","last_undegraded":"2024-03-07T07:31:15.507184+0000","last_fullsized":"2024-03-07T07:31:15.507184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005832+0000","last_change":"2024-03-07T07:31:14.011155+0000","last_active":"2024-03-07T07:31:15.005832+0000","last_peered":"2024-03-07T07:31:15.005832+0000","last_clean":"2024-03-07T07:31:15.005832+0000","last_became_active":"2024-03-07T07:31:14.010799+0000","last_became_peered":"2024-03-07T07:31:14.010799+0000","last_unstale":"2024-03-07T07:31:15.005832+0000","last_undegraded":"2024-03-07T07:31:15.005832+0000","last_fullsized":"2024-03-07T07:31:15.005832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507307+0000","last_change":"2024-03-07T07:31:14.002815+0000","last_active":"2024-03-07T07:31:15.507307+0000","last_peered":"2024-03-07T07:31:15.507307+0000","last_clean":"2024-03-07T07:31:15.507307+0000","last_became_active":"2024-03-07T07:31:14.002600+0000","last_became_peered":"2024-03-07T07:31:14.002600+0000","last_unstale":"2024-03-07T07:31:15.507307+0000","last_undegraded":"2024-03-07T07:31:15.507307+0000","last_fullsized":"2024-03-07T07:31:15.507307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:16:51.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507108+0000","last_change":"2024-03-07T07:31:14.020556+0000","last_active":"2024-03-07T07:31:15.507108+0000","last_peered":"2024-03-07T07:31:15.507108+0000","last_clean":"2024-03-07T07:31:15.507108+0000","last_became_active":"2024-03-07T07:31:14.020256+0000","last_became_peered":"2024-03-07T07:31:14.020256+0000","last_unstale":"2024-03-07T07:31:15.507108+0000","last_undegraded":"2024-03-07T07:31:15.507108+0000","last_fullsized":"2024-03-07T07:31:15.507108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506985+0000","last_change":"2024-03-07T07:31:14.014180+0000","last_active":"2024-03-07T07:31:15.506985+0000","last_peered":"2024-03-07T07:31:15.506985+0000","last_clean":"2024-03-07T07:31:15.506985+0000","last_became_active":"2024-03-07T07:31:14.013845+0000","last_became_peered":"2024-03-07T07:31:14.013845+0000","last_unstale":"2024-03-07T07:31:15.506985+0000","last_undegraded":"2024-03-07T07:31:15.506985+0000","last_fullsized":"2024-03-07T07:31:15.506985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507185+0000","last_change":"2024-03-07T07:31:14.027721+0000","last_active":"2024-03-07T07:31:15.507185+0000","last_peered":"2024-03-07T07:31:15.507185+0000","last_clean":"2024-03-07T07:31:15.507185+0000","last_became_active":"2024-03-07T07:31:14.024529+0000","last_became_peered":"2024-03-07T07:31:14.024529+0000","last_unstale":"2024-03-07T07:31:15.507185+0000","last_undegraded":"2024-03-07T07:31:15.507185+0000","last_fullsized":"2024-03-07T07:31:15.507185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:16:31.787880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506638+0000","last_change":"2024-03-07T07:31:14.023955+0000","last_active":"2024-03-07T07:31:15.506638+0000","last_peered":"2024-03-07T07:31:15.506638+0000","last_clean":"2024-03-07T07:31:15.506638+0000","last_became_active":"2024-03-07T07:31:14.023578+0000","last_became_peered":"2024-03-07T07:31:14.023578+0000","last_unstale":"2024-03-07T07:31:15.506638+0000","last_undegraded":"2024-03-07T07:31:15.506638+0000","last_fullsized":"2024-03-07T07:31:15.506638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:10:18.829790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507161+0000","last_change":"2024-03-07T07:31:14.027411+0000","last_active":"2024-03-07T07:31:15.507161+0000","last_peered":"2024-03-07T07:31:15.507161+0000","last_clean":"2024-03-07T07:31:15.507161+0000","last_became_active":"2024-03-07T07:31:14.026679+0000","last_became_peered":"2024-03-07T07:31:14.026679+0000","last_unstale":"2024-03-07T07:31:15.507161+0000","last_undegraded":"2024-03-07T07:31:15.507161+0000","last_fullsized":"2024-03-07T07:31:15.507161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324002+0000","last_change":"2024-03-07T07:31:14.004296+0000","last_active":"2024-03-07T07:31:15.324002+0000","last_peered":"2024-03-07T07:31:15.324002+0000","last_clean":"2024-03-07T07:31:15.324002+0000","last_became_active":"2024-03-07T07:31:14.003978+0000","last_became_peered":"2024-03-07T07:31:14.003978+0000","last_unstale":"2024-03-07T07:31:15.324002+0000","last_undegraded":"2024-03-07T07:31:15.324002+0000","last_fullsized":"2024-03-07T07:31:15.324002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:16:51.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324577+0000","last_change":"2024-03-07T07:31:14.026782+0000","last_active":"2024-03-07T07:31:15.324577+0000","last_peered":"2024-03-07T07:31:15.324577+0000","last_clean":"2024-03-07T07:31:15.324577+0000","last_became_active":"2024-03-07T07:31:14.026435+0000","last_became_peered":"2024-03-07T07:31:14.026435+0000","last_unstale":"2024-03-07T07:31:15.324577+0000","last_undegraded":"2024-03-07T07:31:15.324577+0000","last_fullsized":"2024-03-07T07:31:15.324577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:00:18.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.508054+0000","last_change":"2024-03-07T07:31:14.022236+0000","last_active":"2024-03-07T07:31:15.508054+0000","last_peered":"2024-03-07T07:31:15.508054+0000","last_clean":"2024-03-07T07:31:15.508054+0000","last_became_active":"2024-03-07T07:31:14.021958+0000","last_became_peered":"2024-03-07T07:31:14.021958+0000","last_unstale":"2024-03-07T07:31:15.508054+0000","last_undegraded":"2024-03-07T07:31:15.508054+0000","last_fullsized":"2024-03-07T07:31:15.508054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324612+0000","last_change":"2024-03-07T07:31:14.018840+0000","last_active":"2024-03-07T07:31:15.324612+0000","last_peered":"2024-03-07T07:31:15.324612+0000","last_clean":"2024-03-07T07:31:15.324612+0000","last_became_active":"2024-03-07T07:31:14.015465+0000","last_became_peered":"2024-03-07T07:31:14.015465+0000","last_unstale":"2024-03-07T07:31:15.324612+0000","last_undegraded":"2024-03-07T07:31:15.324612+0000","last_fullsized":"2024-03-07T07:31:15.324612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:13:28.854524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507008+0000","last_change":"2024-03-07T07:31:14.003946+0000","last_active":"2024-03-07T07:31:15.507008+0000","last_peered":"2024-03-07T07:31:15.507008+0000","last_clean":"2024-03-07T07:31:15.507008+0000","last_became_active":"2024-03-07T07:31:14.003724+0000","last_became_peered":"2024-03-07T07:31:14.003724+0000","last_unstale":"2024-03-07T07:31:15.507008+0000","last_undegraded":"2024-03-07T07:31:15.507008+0000","last_fullsized":"2024-03-07T07:31:15.507008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004139+0000","last_change":"2024-03-07T07:31:14.001532+0000","last_active":"2024-03-07T07:31:15.004139+0000","last_peered":"2024-03-07T07:31:15.004139+0000","last_clean":"2024-03-07T07:31:15.004139+0000","last_became_active":"2024-03-07T07:31:14.001153+0000","last_became_peered":"2024-03-07T07:31:14.001153+0000","last_unstale":"2024-03-07T07:31:15.004139+0000","last_undegraded":"2024-03-07T07:31:15.004139+0000","last_fullsized":"2024-03-07T07:31:15.004139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:49:34.177805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005389+0000","last_change":"2024-03-07T07:31:14.019962+0000","last_active":"2024-03-07T07:31:15.005389+0000","last_peered":"2024-03-07T07:31:15.005389+0000","last_clean":"2024-03-07T07:31:15.005389+0000","last_became_active":"2024-03-07T07:31:14.019664+0000","last_became_peered":"2024-03-07T07:31:14.019664+0000","last_unstale":"2024-03-07T07:31:15.005389+0000","last_undegraded":"2024-03-07T07:31:15.005389+0000","last_fullsized":"2024-03-07T07:31:15.005389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507316+0000","last_change":"2024-03-07T07:31:14.010768+0000","last_active":"2024-03-07T07:31:15.507316+0000","last_peered":"2024-03-07T07:31:15.507316+0000","last_clean":"2024-03-07T07:31:15.507316+0000","last_became_active":"2024-03-07T07:31:14.010406+0000","last_became_peered":"2024-03-07T07:31:14.010406+0000","last_unstale":"2024-03-07T07:31:15.507316+0000","last_undegraded":"2024-03-07T07:31:15.507316+0000","last_fullsized":"2024-03-07T07:31:15.507316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324007+0000","last_change":"2024-03-07T07:31:14.019616+0000","last_active":"2024-03-07T07:31:15.324007+0000","last_peered":"2024-03-07T07:31:15.324007+0000","last_clean":"2024-03-07T07:31:15.324007+0000","last_became_active":"2024-03-07T07:31:14.019246+0000","last_became_peered":"2024-03-07T07:31:14.019246+0000","last_unstale":"2024-03-07T07:31:15.324007+0000","last_undegraded":"2024-03-07T07:31:15.324007+0000","last_fullsized":"2024-03-07T07:31:15.324007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:54:43.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507717+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:15.507717+0000","last_peered":"2024-03-07T07:31:15.507717+0000","last_clean":"2024-03-07T07:31:15.507717+0000","last_became_active":"2024-03-07T07:31:14.014755+0000","last_became_peered":"2024-03-07T07:31:14.014755+0000","last_unstale":"2024-03-07T07:31:15.507717+0000","last_undegraded":"2024-03-07T07:31:15.507717+0000","last_fullsized":"2024-03-07T07:31:15.507717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004465+0000","last_change":"2024-03-07T07:31:14.017123+0000","last_active":"2024-03-07T07:31:15.004465+0000","last_peered":"2024-03-07T07:31:15.004465+0000","last_clean":"2024-03-07T07:31:15.004465+0000","last_became_active":"2024-03-07T07:31:14.016071+0000","last_became_peered":"2024-03-07T07:31:14.016071+0000","last_unstale":"2024-03-07T07:31:15.004465+0000","last_undegraded":"2024-03-07T07:31:15.004465+0000","last_fullsized":"2024-03-07T07:31:15.004465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.508369+0000","last_change":"2024-03-07T07:31:14.024590+0000","last_active":"2024-03-07T07:31:15.508369+0000","last_peered":"2024-03-07T07:31:15.508369+0000","last_clean":"2024-03-07T07:31:15.508369+0000","last_became_active":"2024-03-07T07:31:14.024260+0000","last_became_peered":"2024-03-07T07:31:14.024260+0000","last_unstale":"2024-03-07T07:31:15.508369+0000","last_undegraded":"2024-03-07T07:31:15.508369+0000","last_fullsized":"2024-03-07T07:31:15.508369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:12:29.984408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507396+0000","last_change":"2024-03-07T07:31:14.029144+0000","last_active":"2024-03-07T07:31:15.507396+0000","last_peered":"2024-03-07T07:31:15.507396+0000","last_clean":"2024-03-07T07:31:15.507396+0000","last_became_active":"2024-03-07T07:31:14.027597+0000","last_became_peered":"2024-03-07T07:31:14.027597+0000","last_unstale":"2024-03-07T07:31:15.507396+0000","last_undegraded":"2024-03-07T07:31:15.507396+0000","last_fullsized":"2024-03-07T07:31:15.507396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:17:16.143558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507342+0000","last_change":"2024-03-07T07:31:14.025908+0000","last_active":"2024-03-07T07:31:15.507342+0000","last_peered":"2024-03-07T07:31:15.507342+0000","last_clean":"2024-03-07T07:31:15.507342+0000","last_became_active":"2024-03-07T07:31:14.025639+0000","last_became_peered":"2024-03-07T07:31:14.025639+0000","last_unstale":"2024-03-07T07:31:15.507342+0000","last_undegraded":"2024-03-07T07:31:15.507342+0000","last_fullsized":"2024-03-07T07:31:15.507342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324107+0000","last_change":"2024-03-07T07:31:14.018277+0000","last_active":"2024-03-07T07:31:15.324107+0000","last_peered":"2024-03-07T07:31:15.324107+0000","last_clean":"2024-03-07T07:31:15.324107+0000","last_became_active":"2024-03-07T07:31:14.017969+0000","last_became_peered":"2024-03-07T07:31:14.017969+0000","last_unstale":"2024-03-07T07:31:15.324107+0000","last_undegraded":"2024-03-07T07:31:15.324107+0000","last_fullsized":"2024-03-07T07:31:15.324107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:01.505914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506523+0000","last_change":"2024-03-07T07:31:14.009930+0000","last_active":"2024-03-07T07:31:15.506523+0000","last_peered":"2024-03-07T07:31:15.506523+0000","last_clean":"2024-03-07T07:31:15.506523+0000","last_became_active":"2024-03-07T07:31:14.009559+0000","last_became_peered":"2024-03-07T07:31:14.009559+0000","last_unstale":"2024-03-07T07:31:15.506523+0000","last_undegraded":"2024-03-07T07:31:15.506523+0000","last_fullsized":"2024-03-07T07:31:15.506523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004185+0000","last_change":"2024-03-07T07:31:14.025073+0000","last_active":"2024-03-07T07:31:15.004185+0000","last_peered":"2024-03-07T07:31:15.004185+0000","last_clean":"2024-03-07T07:31:15.004185+0000","last_became_active":"2024-03-07T07:31:14.024374+0000","last_became_peered":"2024-03-07T07:31:14.024374+0000","last_unstale":"2024-03-07T07:31:15.004185+0000","last_undegraded":"2024-03-07T07:31:15.004185+0000","last_fullsized":"2024-03-07T07:31:15.004185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005472+0000","last_change":"2024-03-07T07:31:14.009391+0000","last_active":"2024-03-07T07:31:15.005472+0000","last_peered":"2024-03-07T07:31:15.005472+0000","last_clean":"2024-03-07T07:31:15.005472+0000","last_became_active":"2024-03-07T07:31:14.009148+0000","last_became_peered":"2024-03-07T07:31:14.009148+0000","last_unstale":"2024-03-07T07:31:15.005472+0000","last_undegraded":"2024-03-07T07:31:15.005472+0000","last_fullsized":"2024-03-07T07:31:15.005472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507426+0000","last_change":"2024-03-07T07:31:13.010423+0000","last_active":"2024-03-07T07:31:15.507426+0000","last_peered":"2024-03-07T07:31:15.507426+0000","last_clean":"2024-03-07T07:31:15.507426+0000","last_became_active":"2024-03-07T07:31:13.010096+0000","last_became_peered":"2024-03-07T07:31:13.010096+0000","last_unstale":"2024-03-07T07:31:15.507426+0000","last_undegraded":"2024-03-07T07:31:15.507426+0000","last_fullsized":"2024-03-07T07:31:15.507426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004206+0000","last_change":"2024-03-07T07:31:14.008786+0000","last_active":"2024-03-07T07:31:15.004206+0000","last_peered":"2024-03-07T07:31:15.004206+0000","last_clean":"2024-03-07T07:31:15.004206+0000","last_became_active":"2024-03-07T07:31:14.007354+0000","last_became_peered":"2024-03-07T07:31:14.007354+0000","last_unstale":"2024-03-07T07:31:15.004206+0000","last_undegraded":"2024-03-07T07:31:15.004206+0000","last_fullsized":"2024-03-07T07:31:15.004206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:12:29.984408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324386+0000","last_change":"2024-03-07T07:31:13.006659+0000","last_active":"2024-03-07T07:31:15.324386+0000","last_peered":"2024-03-07T07:31:15.324386+0000","last_clean":"2024-03-07T07:31:15.324386+0000","last_became_active":"2024-03-07T07:31:13.005927+0000","last_became_peered":"2024-03-07T07:31:13.005927+0000","last_unstale":"2024-03-07T07:31:15.324386+0000","last_undegraded":"2024-03-07T07:31:15.324386+0000","last_fullsized":"2024-03-07T07:31:15.324386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506797+0000","last_change":"2024-03-07T07:31:13.003135+0000","last_active":"2024-03-07T07:31:15.506797+0000","last_peered":"2024-03-07T07:31:15.506797+0000","last_clean":"2024-03-07T07:31:15.506797+0000","last_became_active":"2024-03-07T07:31:13.002843+0000","last_became_peered":"2024-03-07T07:31:13.002843+0000","last_unstale":"2024-03-07T07:31:15.506797+0000","last_undegraded":"2024-03-07T07:31:15.506797+0000","last_fullsized":"2024-03-07T07:31:15.506797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:45.950345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507401+0000","last_change":"2024-03-07T07:31:14.031819+0000","last_active":"2024-03-07T07:31:15.507401+0000","last_peered":"2024-03-07T07:31:15.507401+0000","last_clean":"2024-03-07T07:31:15.507401+0000","last_became_active":"2024-03-07T07:31:14.031513+0000","last_became_peered":"2024-03-07T07:31:14.031513+0000","last_unstale":"2024-03-07T07:31:15.507401+0000","last_undegraded":"2024-03-07T07:31:15.507401+0000","last_fullsized":"2024-03-07T07:31:15.507401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324216+0000","last_change":"2024-03-07T07:31:13.006518+0000","last_active":"2024-03-07T07:31:15.324216+0000","last_peered":"2024-03-07T07:31:15.324216+0000","last_clean":"2024-03-07T07:31:15.324216+0000","last_became_active":"2024-03-07T07:31:13.005662+0000","last_became_peered":"2024-03-07T07:31:13.005662+0000","last_unstale":"2024-03-07T07:31:15.324216+0000","last_undegraded":"2024-03-07T07:31:15.324216+0000","last_fullsized":"2024-03-07T07:31:15.324216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004066+0000","last_change":"2024-03-07T07:31:14.006625+0000","last_active":"2024-03-07T07:31:15.004066+0000","last_peered":"2024-03-07T07:31:15.004066+0000","last_clean":"2024-03-07T07:31:15.004066+0000","last_became_active":"2024-03-07T07:31:14.006314+0000","last_became_peered":"2024-03-07T07:31:14.006314+0000","last_unstale":"2024-03-07T07:31:15.004066+0000","last_undegraded":"2024-03-07T07:31:15.004066+0000","last_fullsized":"2024-03-07T07:31:15.004066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:16:31.787880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005853+0000","last_change":"2024-03-07T07:31:13.014357+0000","last_active":"2024-03-07T07:31:15.005853+0000","last_peered":"2024-03-07T07:31:15.005853+0000","last_clean":"2024-03-07T07:31:15.005853+0000","last_became_active":"2024-03-07T07:31:13.014065+0000","last_became_peered":"2024-03-07T07:31:13.014065+0000","last_unstale":"2024-03-07T07:31:15.005853+0000","last_undegraded":"2024-03-07T07:31:15.005853+0000","last_fullsized":"2024-03-07T07:31:15.005853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004535+0000","last_change":"2024-03-07T07:31:14.016928+0000","last_active":"2024-03-07T07:31:15.004535+0000","last_peered":"2024-03-07T07:31:15.004535+0000","last_clean":"2024-03-07T07:31:15.004535+0000","last_became_active":"2024-03-07T07:31:14.016029+0000","last_became_peered":"2024-03-07T07:31:14.016029+0000","last_unstale":"2024-03-07T07:31:15.004535+0000","last_undegraded":"2024-03-07T07:31:15.004535+0000","last_fullsized":"2024-03-07T07:31:15.004535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507244+0000","last_change":"2024-03-07T07:31:13.017045+0000","last_active":"2024-03-07T07:31:15.507244+0000","last_peered":"2024-03-07T07:31:15.507244+0000","last_clean":"2024-03-07T07:31:15.507244+0000","last_became_active":"2024-03-07T07:31:13.016712+0000","last_became_peered":"2024-03-07T07:31:13.016712+0000","last_unstale":"2024-03-07T07:31:15.507244+0000","last_undegraded":"2024-03-07T07:31:15.507244+0000","last_fullsized":"2024-03-07T07:31:15.507244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507993+0000","last_change":"2024-03-07T07:31:14.011291+0000","last_active":"2024-03-07T07:31:15.507993+0000","last_peered":"2024-03-07T07:31:15.507993+0000","last_clean":"2024-03-07T07:31:15.507993+0000","last_became_active":"2024-03-07T07:31:14.010987+0000","last_became_peered":"2024-03-07T07:31:14.010987+0000","last_unstale":"2024-03-07T07:31:15.507993+0000","last_undegraded":"2024-03-07T07:31:15.507993+0000","last_fullsized":"2024-03-07T07:31:15.507993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:56:52.711355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507937+0000","last_change":"2024-03-07T07:31:13.004264+0000","last_active":"2024-03-07T07:31:15.507937+0000","last_peered":"2024-03-07T07:31:15.507937+0000","last_clean":"2024-03-07T07:31:15.507937+0000","last_became_active":"2024-03-07T07:31:13.003883+0000","last_became_peered":"2024-03-07T07:31:13.003883+0000","last_unstale":"2024-03-07T07:31:15.507937+0000","last_undegraded":"2024-03-07T07:31:15.507937+0000","last_fullsized":"2024-03-07T07:31:15.507937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:45.919382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324252+0000","last_change":"2024-03-07T07:31:14.007051+0000","last_active":"2024-03-07T07:31:15.324252+0000","last_peered":"2024-03-07T07:31:15.324252+0000","last_clean":"2024-03-07T07:31:15.324252+0000","last_became_active":"2024-03-07T07:31:14.005904+0000","last_became_peered":"2024-03-07T07:31:14.005904+0000","last_unstale":"2024-03-07T07:31:15.324252+0000","last_undegraded":"2024-03-07T07:31:15.324252+0000","last_fullsized":"2024-03-07T07:31:15.324252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:57:16.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004295+0000","last_change":"2024-03-07T07:31:12.997602+0000","last_active":"2024-03-07T07:31:15.004295+0000","last_peered":"2024-03-07T07:31:15.004295+0000","last_clean":"2024-03-07T07:31:15.004295+0000","last_became_active":"2024-03-07T07:31:12.997204+0000","last_became_peered":"2024-03-07T07:31:12.997204+0000","last_unstale":"2024-03-07T07:31:15.004295+0000","last_undegraded":"2024-03-07T07:31:15.004295+0000","last_fullsized":"2024-03-07T07:31:15.004295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507181+0000","last_change":"2024-03-07T07:31:14.028791+0000","last_active":"2024-03-07T07:31:15.507181+0000","last_peered":"2024-03-07T07:31:15.507181+0000","last_clean":"2024-03-07T07:31:15.507181+0000","last_became_active":"2024-03-07T07:31:14.028591+0000","last_became_peered":"2024-03-07T07:31:14.028591+0000","last_unstale":"2024-03-07T07:31:15.507181+0000","last_undegraded":"2024-03-07T07:31:15.507181+0000","last_fullsized":"2024-03-07T07:31:15.507181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:56:52.711355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506774+0000","last_change":"2024-03-07T07:31:13.011937+0000","last_active":"2024-03-07T07:31:15.506774+0000","last_peered":"2024-03-07T07:31:15.506774+0000","last_clean":"2024-03-07T07:31:15.506774+0000","last_became_active":"2024-03-07T07:31:13.011577+0000","last_became_peered":"2024-03-07T07:31:13.011577+0000","last_unstale":"2024-03-07T07:31:15.506774+0000","last_undegraded":"2024-03-07T07:31:15.506774+0000","last_fullsized":"2024-03-07T07:31:15.506774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506742+0000","last_change":"2024-03-07T07:31:14.028636+0000","last_active":"2024-03-07T07:31:15.506742+0000","last_peered":"2024-03-07T07:31:15.506742+0000","last_clean":"2024-03-07T07:31:15.506742+0000","last_became_active":"2024-03-07T07:31:14.024496+0000","last_became_peered":"2024-03-07T07:31:14.024496+0000","last_unstale":"2024-03-07T07:31:15.506742+0000","last_undegraded":"2024-03-07T07:31:15.506742+0000","last_fullsized":"2024-03-07T07:31:15.506742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:10:02.515660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324494+0000","last_change":"2024-03-07T07:31:13.000961+0000","last_active":"2024-03-07T07:31:15.324494+0000","last_peered":"2024-03-07T07:31:15.324494+0000","last_clean":"2024-03-07T07:31:15.324494+0000","last_became_active":"2024-03-07T07:31:13.000129+0000","last_became_peered":"2024-03-07T07:31:13.000129+0000","last_unstale":"2024-03-07T07:31:15.324494+0000","last_undegraded":"2024-03-07T07:31:15.324494+0000","last_fullsized":"2024-03-07T07:31:15.324494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:58.045352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324283+0000","last_change":"2024-03-07T07:31:14.022537+0000","last_active":"2024-03-07T07:31:15.324283+0000","last_peered":"2024-03-07T07:31:15.324283+0000","last_clean":"2024-03-07T07:31:15.324283+0000","last_became_active":"2024-03-07T07:31:14.022221+0000","last_became_peered":"2024-03-07T07:31:14.022221+0000","last_unstale":"2024-03-07T07:31:15.324283+0000","last_undegraded":"2024-03-07T07:31:15.324283+0000","last_fullsized":"2024-03-07T07:31:15.324283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:42.196434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506798+0000","last_change":"2024-03-07T07:31:13.009533+0000","last_active":"2024-03-07T07:31:15.506798+0000","last_peered":"2024-03-07T07:31:15.506798+0000","last_clean":"2024-03-07T07:31:15.506798+0000","last_became_active":"2024-03-07T07:31:13.009224+0000","last_became_peered":"2024-03-07T07:31:13.009224+0000","last_unstale":"2024-03-07T07:31:15.506798+0000","last_undegraded":"2024-03-07T07:31:15.506798+0000","last_fullsized":"2024-03-07T07:31:15.506798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:40.675440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005317+0000","last_change":"2024-03-07T07:31:14.015133+0000","last_active":"2024-03-07T07:31:15.005317+0000","last_peered":"2024-03-07T07:31:15.005317+0000","last_clean":"2024-03-07T07:31:15.005317+0000","last_became_active":"2024-03-07T07:31:14.014859+0000","last_became_peered":"2024-03-07T07:31:14.014859+0000","last_unstale":"2024-03-07T07:31:15.005317+0000","last_undegraded":"2024-03-07T07:31:15.005317+0000","last_fullsized":"2024-03-07T07:31:15.005317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.003867+0000","last_change":"2024-03-07T07:31:13.000976+0000","last_active":"2024-03-07T07:31:15.003867+0000","last_peered":"2024-03-07T07:31:15.003867+0000","last_clean":"2024-03-07T07:31:15.003867+0000","last_became_active":"2024-03-07T07:31:13.000624+0000","last_became_peered":"2024-03-07T07:31:13.000624+0000","last_unstale":"2024-03-07T07:31:15.003867+0000","last_undegraded":"2024-03-07T07:31:15.003867+0000","last_fullsized":"2024-03-07T07:31:15.003867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:34.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324076+0000","last_change":"2024-03-07T07:31:14.008321+0000","last_active":"2024-03-07T07:31:15.324076+0000","last_peered":"2024-03-07T07:31:15.324076+0000","last_clean":"2024-03-07T07:31:15.324076+0000","last_became_active":"2024-03-07T07:31:14.008039+0000","last_became_peered":"2024-03-07T07:31:14.008039+0000","last_unstale":"2024-03-07T07:31:15.324076+0000","last_undegraded":"2024-03-07T07:31:15.324076+0000","last_fullsized":"2024-03-07T07:31:15.324076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:54:30.956919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507471+0000","last_change":"2024-03-07T07:31:13.008580+0000","last_active":"2024-03-07T07:31:15.507471+0000","last_peered":"2024-03-07T07:31:15.507471+0000","last_clean":"2024-03-07T07:31:15.507471+0000","last_became_active":"2024-03-07T07:31:13.008276+0000","last_became_peered":"2024-03-07T07:31:13.008276+0000","last_unstale":"2024-03-07T07:31:15.507471+0000","last_undegraded":"2024-03-07T07:31:15.507471+0000","last_fullsized":"2024-03-07T07:31:15.507471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004627+0000","last_change":"2024-03-07T07:31:14.003764+0000","last_active":"2024-03-07T07:31:15.004627+0000","last_peered":"2024-03-07T07:31:15.004627+0000","last_clean":"2024-03-07T07:31:15.004627+0000","last_became_active":"2024-03-07T07:31:14.002976+0000","last_became_peered":"2024-03-07T07:31:14.002976+0000","last_unstale":"2024-03-07T07:31:15.004627+0000","last_undegraded":"2024-03-07T07:31:15.004627+0000","last_fullsized":"2024-03-07T07:31:15.004627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:31.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004481+0000","last_change":"2024-03-07T07:31:13.010016+0000","last_active":"2024-03-07T07:31:15.004481+0000","last_peered":"2024-03-07T07:31:15.004481+0000","last_clean":"2024-03-07T07:31:15.004481+0000","last_became_active":"2024-03-07T07:31:13.009751+0000","last_became_peered":"2024-03-07T07:31:13.009751+0000","last_unstale":"2024-03-07T07:31:15.004481+0000","last_undegraded":"2024-03-07T07:31:15.004481+0000","last_fullsized":"2024-03-07T07:31:15.004481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:48:10.630881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507467+0000","last_change":"2024-03-07T07:31:14.013078+0000","last_active":"2024-03-07T07:31:15.507467+0000","last_peered":"2024-03-07T07:31:15.507467+0000","last_clean":"2024-03-07T07:31:15.507467+0000","last_became_active":"2024-03-07T07:31:14.012816+0000","last_became_peered":"2024-03-07T07:31:14.012816+0000","last_unstale":"2024-03-07T07:31:15.507467+0000","last_undegraded":"2024-03-07T07:31:15.507467+0000","last_fullsized":"2024-03-07T07:31:15.507467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:01.505914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507560+0000","last_change":"2024-03-07T07:31:13.016042+0000","last_active":"2024-03-07T07:31:15.507560+0000","last_peered":"2024-03-07T07:31:15.507560+0000","last_clean":"2024-03-07T07:31:15.507560+0000","last_became_active":"2024-03-07T07:31:13.015749+0000","last_became_peered":"2024-03-07T07:31:13.015749+0000","last_unstale":"2024-03-07T07:31:15.507560+0000","last_undegraded":"2024-03-07T07:31:15.507560+0000","last_fullsized":"2024-03-07T07:31:15.507560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:37:21.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507367+0000","last_change":"2024-03-07T07:31:14.015090+0000","last_active":"2024-03-07T07:31:15.507367+0000","last_peered":"2024-03-07T07:31:15.507367+0000","last_clean":"2024-03-07T07:31:15.507367+0000","last_became_active":"2024-03-07T07:31:14.014806+0000","last_became_peered":"2024-03-07T07:31:14.014806+0000","last_unstale":"2024-03-07T07:31:15.507367+0000","last_undegraded":"2024-03-07T07:31:15.507367+0000","last_fullsized":"2024-03-07T07:31:15.507367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:54:43.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507597+0000","last_change":"2024-03-07T07:31:13.002882+0000","last_active":"2024-03-07T07:31:15.507597+0000","last_peered":"2024-03-07T07:31:15.507597+0000","last_clean":"2024-03-07T07:31:15.507597+0000","last_became_active":"2024-03-07T07:31:13.002570+0000","last_became_peered":"2024-03-07T07:31:13.002570+0000","last_unstale":"2024-03-07T07:31:15.507597+0000","last_undegraded":"2024-03-07T07:31:15.507597+0000","last_fullsized":"2024-03-07T07:31:15.507597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:45:09.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324540+0000","last_change":"2024-03-07T07:31:14.008276+0000","last_active":"2024-03-07T07:31:15.324540+0000","last_peered":"2024-03-07T07:31:15.324540+0000","last_clean":"2024-03-07T07:31:15.324540+0000","last_became_active":"2024-03-07T07:31:14.007776+0000","last_became_peered":"2024-03-07T07:31:14.007776+0000","last_unstale":"2024-03-07T07:31:15.324540+0000","last_undegraded":"2024-03-07T07:31:15.324540+0000","last_fullsized":"2024-03-07T07:31:15.324540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:31:10.904651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005322+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:31:15.005322+0000","last_peered":"2024-03-07T07:31:15.005322+0000","last_clean":"2024-03-07T07:31:15.005322+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:31:15.005322+0000","last_undegraded":"2024-03-07T07:31:15.005322+0000","last_fullsized":"2024-03-07T07:31:15.005322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324287+0000","last_change":"2024-03-07T07:31:13.008377+0000","last_active":"2024-03-07T07:31:15.324287+0000","last_peered":"2024-03-07T07:31:15.324287+0000","last_clean":"2024-03-07T07:31:15.324287+0000","last_became_active":"2024-03-07T07:31:13.007831+0000","last_became_peered":"2024-03-07T07:31:13.007831+0000","last_unstale":"2024-03-07T07:31:15.324287+0000","last_undegraded":"2024-03-07T07:31:15.324287+0000","last_fullsized":"2024-03-07T07:31:15.324287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:04.756437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004221+0000","last_change":"2024-03-07T07:31:14.011057+0000","last_active":"2024-03-07T07:31:15.004221+0000","last_peered":"2024-03-07T07:31:15.004221+0000","last_clean":"2024-03-07T07:31:15.004221+0000","last_became_active":"2024-03-07T07:31:14.008674+0000","last_became_peered":"2024-03-07T07:31:14.008674+0000","last_unstale":"2024-03-07T07:31:15.004221+0000","last_undegraded":"2024-03-07T07:31:15.004221+0000","last_fullsized":"2024-03-07T07:31:15.004221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:13:13.737562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324150+0000","last_change":"2024-03-07T07:31:13.008418+0000","last_active":"2024-03-07T07:31:15.324150+0000","last_peered":"2024-03-07T07:31:15.324150+0000","last_clean":"2024-03-07T07:31:15.324150+0000","last_became_active":"2024-03-07T07:31:13.008022+0000","last_became_peered":"2024-03-07T07:31:13.008022+0000","last_unstale":"2024-03-07T07:31:15.324150+0000","last_undegraded":"2024-03-07T07:31:15.324150+0000","last_fullsized":"2024-03-07T07:31:15.324150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506707+0000","last_change":"2024-03-07T07:31:14.021608+0000","last_active":"2024-03-07T07:31:15.506707+0000","last_peered":"2024-03-07T07:31:15.506707+0000","last_clean":"2024-03-07T07:31:15.506707+0000","last_became_active":"2024-03-07T07:31:14.021264+0000","last_became_peered":"2024-03-07T07:31:14.021264+0000","last_unstale":"2024-03-07T07:31:15.506707+0000","last_undegraded":"2024-03-07T07:31:15.506707+0000","last_fullsized":"2024-03-07T07:31:15.506707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:09.493361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506600+0000","last_change":"2024-03-07T07:31:13.012807+0000","last_active":"2024-03-07T07:31:15.506600+0000","last_peered":"2024-03-07T07:31:15.506600+0000","last_clean":"2024-03-07T07:31:15.506600+0000","last_became_active":"2024-03-07T07:31:13.011968+0000","last_became_peered":"2024-03-07T07:31:13.011968+0000","last_unstale":"2024-03-07T07:31:15.506600+0000","last_undegraded":"2024-03-07T07:31:15.506600+0000","last_fullsized":"2024-03-07T07:31:15.506600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:23.206739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507191+0000","last_change":"2024-03-07T07:31:14.013203+0000","last_active":"2024-03-07T07:31:15.507191+0000","last_peered":"2024-03-07T07:31:15.507191+0000","last_clean":"2024-03-07T07:31:15.507191+0000","last_became_active":"2024-03-07T07:31:14.012147+0000","last_became_peered":"2024-03-07T07:31:14.012147+0000","last_unstale":"2024-03-07T07:31:15.507191+0000","last_undegraded":"2024-03-07T07:31:15.507191+0000","last_fullsized":"2024-03-07T07:31:15.507191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324586+0000","last_change":"2024-03-07T07:31:13.004811+0000","last_active":"2024-03-07T07:31:15.324586+0000","last_peered":"2024-03-07T07:31:15.324586+0000","last_clean":"2024-03-07T07:31:15.324586+0000","last_became_active":"2024-03-07T07:31:13.001378+0000","last_became_peered":"2024-03-07T07:31:13.001378+0000","last_unstale":"2024-03-07T07:31:15.324586+0000","last_undegraded":"2024-03-07T07:31:15.324586+0000","last_fullsized":"2024-03-07T07:31:15.324586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:30.900538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507068+0000","last_change":"2024-03-07T07:31:14.001567+0000","last_active":"2024-03-07T07:31:15.507068+0000","last_peered":"2024-03-07T07:31:15.507068+0000","last_clean":"2024-03-07T07:31:15.507068+0000","last_became_active":"2024-03-07T07:31:14.001209+0000","last_became_peered":"2024-03-07T07:31:14.001209+0000","last_unstale":"2024-03-07T07:31:15.507068+0000","last_undegraded":"2024-03-07T07:31:15.507068+0000","last_fullsized":"2024-03-07T07:31:15.507068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507268+0000","last_change":"2024-03-07T07:31:13.009741+0000","last_active":"2024-03-07T07:31:15.507268+0000","last_peered":"2024-03-07T07:31:15.507268+0000","last_clean":"2024-03-07T07:31:15.507268+0000","last_became_active":"2024-03-07T07:31:13.009377+0000","last_became_peered":"2024-03-07T07:31:13.009377+0000","last_unstale":"2024-03-07T07:31:15.507268+0000","last_undegraded":"2024-03-07T07:31:15.507268+0000","last_fullsized":"2024-03-07T07:31:15.507268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:23.206739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004256+0000","last_change":"2024-03-07T07:31:14.029593+0000","last_active":"2024-03-07T07:31:15.004256+0000","last_peered":"2024-03-07T07:31:15.004256+0000","last_clean":"2024-03-07T07:31:15.004256+0000","last_became_active":"2024-03-07T07:31:14.029271+0000","last_became_peered":"2024-03-07T07:31:14.029271+0000","last_unstale":"2024-03-07T07:31:15.004256+0000","last_undegraded":"2024-03-07T07:31:15.004256+0000","last_fullsized":"2024-03-07T07:31:15.004256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324639+0000","last_change":"2024-03-07T07:31:12.999335+0000","last_active":"2024-03-07T07:31:15.324639+0000","last_peered":"2024-03-07T07:31:15.324639+0000","last_clean":"2024-03-07T07:31:15.324639+0000","last_became_active":"2024-03-07T07:31:12.998960+0000","last_became_peered":"2024-03-07T07:31:12.998960+0000","last_unstale":"2024-03-07T07:31:15.324639+0000","last_undegraded":"2024-03-07T07:31:15.324639+0000","last_fullsized":"2024-03-07T07:31:15.324639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:36.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507521+0000","last_change":"2024-03-07T07:31:14.023039+0000","last_active":"2024-03-07T07:31:15.507521+0000","last_peered":"2024-03-07T07:31:15.507521+0000","last_clean":"2024-03-07T07:31:15.507521+0000","last_became_active":"2024-03-07T07:31:14.022753+0000","last_became_peered":"2024-03-07T07:31:14.022753+0000","last_unstale":"2024-03-07T07:31:15.507521+0000","last_undegraded":"2024-03-07T07:31:15.507521+0000","last_fullsized":"2024-03-07T07:31:15.507521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:49:34.177805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004648+0000","last_change":"2024-03-07T07:31:13.004776+0000","last_active":"2024-03-07T07:31:15.004648+0000","last_peered":"2024-03-07T07:31:15.004648+0000","last_clean":"2024-03-07T07:31:15.004648+0000","last_became_active":"2024-03-07T07:31:13.004179+0000","last_became_peered":"2024-03-07T07:31:13.004179+0000","last_unstale":"2024-03-07T07:31:15.004648+0000","last_undegraded":"2024-03-07T07:31:15.004648+0000","last_fullsized":"2024-03-07T07:31:15.004648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:20:31.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004577+0000","last_change":"2024-03-07T07:31:14.018269+0000","last_active":"2024-03-07T07:31:15.004577+0000","last_peered":"2024-03-07T07:31:15.004577+0000","last_clean":"2024-03-07T07:31:15.004577+0000","last_became_active":"2024-03-07T07:31:14.017951+0000","last_became_peered":"2024-03-07T07:31:14.017951+0000","last_unstale":"2024-03-07T07:31:15.004577+0000","last_undegraded":"2024-03-07T07:31:15.004577+0000","last_fullsized":"2024-03-07T07:31:15.004577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:47.090004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324673+0000","last_change":"2024-03-07T07:31:13.014574+0000","last_active":"2024-03-07T07:31:15.324673+0000","last_peered":"2024-03-07T07:31:15.324673+0000","last_clean":"2024-03-07T07:31:15.324673+0000","last_became_active":"2024-03-07T07:31:13.014264+0000","last_became_peered":"2024-03-07T07:31:13.014264+0000","last_unstale":"2024-03-07T07:31:15.324673+0000","last_undegraded":"2024-03-07T07:31:15.324673+0000","last_fullsized":"2024-03-07T07:31:15.324673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004522+0000","last_change":"2024-03-07T07:31:14.013847+0000","last_active":"2024-03-07T07:31:15.004522+0000","last_peered":"2024-03-07T07:31:15.004522+0000","last_clean":"2024-03-07T07:31:15.004522+0000","last_became_active":"2024-03-07T07:31:14.013485+0000","last_became_peered":"2024-03-07T07:31:14.013485+0000","last_unstale":"2024-03-07T07:31:15.004522+0000","last_undegraded":"2024-03-07T07:31:15.004522+0000","last_fullsized":"2024-03-07T07:31:15.004522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:20:38.979357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506657+0000","last_change":"2024-03-07T07:31:13.010611+0000","last_active":"2024-03-07T07:31:15.506657+0000","last_peered":"2024-03-07T07:31:15.506657+0000","last_clean":"2024-03-07T07:31:15.506657+0000","last_became_active":"2024-03-07T07:31:13.005305+0000","last_became_peered":"2024-03-07T07:31:13.005305+0000","last_unstale":"2024-03-07T07:31:15.506657+0000","last_undegraded":"2024-03-07T07:31:15.506657+0000","last_fullsized":"2024-03-07T07:31:15.506657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:10.661050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324091+0000","last_change":"2024-03-07T07:31:14.021524+0000","last_active":"2024-03-07T07:31:15.324091+0000","last_peered":"2024-03-07T07:31:15.324091+0000","last_clean":"2024-03-07T07:31:15.324091+0000","last_became_active":"2024-03-07T07:31:14.021248+0000","last_became_peered":"2024-03-07T07:31:14.021248+0000","last_unstale":"2024-03-07T07:31:15.324091+0000","last_undegraded":"2024-03-07T07:31:15.324091+0000","last_fullsized":"2024-03-07T07:31:15.324091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:10:35.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004002+0000","last_change":"2024-03-07T07:31:13.002330+0000","last_active":"2024-03-07T07:31:15.004002+0000","last_peered":"2024-03-07T07:31:15.004002+0000","last_clean":"2024-03-07T07:31:15.004002+0000","last_became_active":"2024-03-07T07:31:13.002030+0000","last_became_peered":"2024-03-07T07:31:13.002030+0000","last_unstale":"2024-03-07T07:31:15.004002+0000","last_undegraded":"2024-03-07T07:31:15.004002+0000","last_fullsized":"2024-03-07T07:31:15.004002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:16:54.530906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.003974+0000","last_change":"2024-03-07T07:31:14.012840+0000","last_active":"2024-03-07T07:31:15.003974+0000","last_peered":"2024-03-07T07:31:15.003974+0000","last_clean":"2024-03-07T07:31:15.003974+0000","last_became_active":"2024-03-07T07:31:14.009043+0000","last_became_peered":"2024-03-07T07:31:14.009043+0000","last_unstale":"2024-03-07T07:31:15.003974+0000","last_undegraded":"2024-03-07T07:31:15.003974+0000","last_fullsized":"2024-03-07T07:31:15.003974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:17:16.143558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506843+0000","last_change":"2024-03-07T07:31:13.008737+0000","last_active":"2024-03-07T07:31:15.506843+0000","last_peered":"2024-03-07T07:31:15.506843+0000","last_clean":"2024-03-07T07:31:15.506843+0000","last_became_active":"2024-03-07T07:31:13.008485+0000","last_became_peered":"2024-03-07T07:31:13.008485+0000","last_unstale":"2024-03-07T07:31:15.506843+0000","last_undegraded":"2024-03-07T07:31:15.506843+0000","last_fullsized":"2024-03-07T07:31:15.506843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:34.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506665+0000","last_change":"2024-03-07T07:31:14.012842+0000","last_active":"2024-03-07T07:31:15.506665+0000","last_peered":"2024-03-07T07:31:15.506665+0000","last_clean":"2024-03-07T07:31:15.506665+0000","last_became_active":"2024-03-07T07:31:14.012549+0000","last_became_peered":"2024-03-07T07:31:14.012549+0000","last_unstale":"2024-03-07T07:31:15.506665+0000","last_undegraded":"2024-03-07T07:31:15.506665+0000","last_fullsized":"2024-03-07T07:31:15.506665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324173+0000","last_change":"2024-03-07T07:31:13.008117+0000","last_active":"2024-03-07T07:31:15.324173+0000","last_peered":"2024-03-07T07:31:15.324173+0000","last_clean":"2024-03-07T07:31:15.324173+0000","last_became_active":"2024-03-07T07:31:13.006517+0000","last_became_peered":"2024-03-07T07:31:13.006517+0000","last_unstale":"2024-03-07T07:31:15.324173+0000","last_undegraded":"2024-03-07T07:31:15.324173+0000","last_fullsized":"2024-03-07T07:31:15.324173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:17.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324678+0000","last_change":"2024-03-07T07:31:14.011780+0000","last_active":"2024-03-07T07:31:15.324678+0000","last_peered":"2024-03-07T07:31:15.324678+0000","last_clean":"2024-03-07T07:31:15.324678+0000","last_became_active":"2024-03-07T07:31:14.011509+0000","last_became_peered":"2024-03-07T07:31:14.011509+0000","last_unstale":"2024-03-07T07:31:15.324678+0000","last_undegraded":"2024-03-07T07:31:15.324678+0000","last_fullsized":"2024-03-07T07:31:15.324678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:20:14.495243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324463+0000","last_change":"2024-03-07T07:31:14.024307+0000","last_active":"2024-03-07T07:31:15.324463+0000","last_peered":"2024-03-07T07:31:15.324463+0000","last_clean":"2024-03-07T07:31:15.324463+0000","last_became_active":"2024-03-07T07:31:14.024003+0000","last_became_peered":"2024-03-07T07:31:14.024003+0000","last_unstale":"2024-03-07T07:31:15.324463+0000","last_undegraded":"2024-03-07T07:31:15.324463+0000","last_fullsized":"2024-03-07T07:31:15.324463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:15.163371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507245+0000","last_change":"2024-03-07T07:31:13.017220+0000","last_active":"2024-03-07T07:31:15.507245+0000","last_peered":"2024-03-07T07:31:15.507245+0000","last_clean":"2024-03-07T07:31:15.507245+0000","last_became_active":"2024-03-07T07:31:13.016766+0000","last_became_peered":"2024-03-07T07:31:13.016766+0000","last_unstale":"2024-03-07T07:31:15.507245+0000","last_undegraded":"2024-03-07T07:31:15.507245+0000","last_fullsized":"2024-03-07T07:31:15.507245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005588+0000","last_change":"2024-03-07T07:31:14.008305+0000","last_active":"2024-03-07T07:31:15.005588+0000","last_peered":"2024-03-07T07:31:15.005588+0000","last_clean":"2024-03-07T07:31:15.005588+0000","last_became_active":"2024-03-07T07:31:14.006803+0000","last_became_peered":"2024-03-07T07:31:14.006803+0000","last_unstale":"2024-03-07T07:31:15.005588+0000","last_undegraded":"2024-03-07T07:31:15.005588+0000","last_fullsized":"2024-03-07T07:31:15.005588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507223+0000","last_change":"2024-03-07T07:31:13.016945+0000","last_active":"2024-03-07T07:31:15.507223+0000","last_peered":"2024-03-07T07:31:15.507223+0000","last_clean":"2024-03-07T07:31:15.507223+0000","last_became_active":"2024-03-07T07:31:13.016362+0000","last_became_peered":"2024-03-07T07:31:13.016362+0000","last_unstale":"2024-03-07T07:31:15.507223+0000","last_undegraded":"2024-03-07T07:31:15.507223+0000","last_fullsized":"2024-03-07T07:31:15.507223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507857+0000","last_change":"2024-03-07T07:31:14.015081+0000","last_active":"2024-03-07T07:31:15.507857+0000","last_peered":"2024-03-07T07:31:15.507857+0000","last_clean":"2024-03-07T07:31:15.507857+0000","last_became_active":"2024-03-07T07:31:14.014734+0000","last_became_peered":"2024-03-07T07:31:14.014734+0000","last_unstale":"2024-03-07T07:31:15.507857+0000","last_undegraded":"2024-03-07T07:31:15.507857+0000","last_fullsized":"2024-03-07T07:31:15.507857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507737+0000","last_change":"2024-03-07T07:31:13.011989+0000","last_active":"2024-03-07T07:31:15.507737+0000","last_peered":"2024-03-07T07:31:15.507737+0000","last_clean":"2024-03-07T07:31:15.507737+0000","last_became_active":"2024-03-07T07:31:13.011663+0000","last_became_peered":"2024-03-07T07:31:13.011663+0000","last_unstale":"2024-03-07T07:31:15.507737+0000","last_undegraded":"2024-03-07T07:31:15.507737+0000","last_fullsized":"2024-03-07T07:31:15.507737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:50.212787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507644+0000","last_change":"2024-03-07T07:31:14.019436+0000","last_active":"2024-03-07T07:31:15.507644+0000","last_peered":"2024-03-07T07:31:15.507644+0000","last_clean":"2024-03-07T07:31:15.507644+0000","last_became_active":"2024-03-07T07:31:14.019144+0000","last_became_peered":"2024-03-07T07:31:14.019144+0000","last_unstale":"2024-03-07T07:31:15.507644+0000","last_undegraded":"2024-03-07T07:31:15.507644+0000","last_fullsized":"2024-03-07T07:31:15.507644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004520+0000","last_change":"2024-03-07T07:31:12.997330+0000","last_active":"2024-03-07T07:31:15.004520+0000","last_peered":"2024-03-07T07:31:15.004520+0000","last_clean":"2024-03-07T07:31:15.004520+0000","last_became_active":"2024-03-07T07:31:12.997026+0000","last_became_peered":"2024-03-07T07:31:12.997026+0000","last_unstale":"2024-03-07T07:31:15.004520+0000","last_undegraded":"2024-03-07T07:31:15.004520+0000","last_fullsized":"2024-03-07T07:31:15.004520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:04:34.643046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":73109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":662965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":662987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:31:26.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:31:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.054+0000 7f8295800640 1 Processor -- start 2024-03-07T07:31:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.054+0000 7f8295800640 1 -- start start 2024-03-07T07:31:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8295800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f82900aab90 0x7f829015f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8295800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82900731e0 con 0x7f8290072d60 2024-03-07T07:31:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8295800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8290073490 con 0x7f82901586d0 2024-03-07T07:31:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8295800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8290161db0 con 0x7f82900aab90 2024-03-07T07:31:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f828f400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8290072d60 0x7f82900704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33734/0 (socket says 172.21.15.84:33734) 2024-03-07T07:31:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f828f400640 1 -- 172.21.15.84:0/732673475 learned_addr learned my addr 172.21.15.84:0/732673475 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8286000640 1 --2- 172.21.15.84:0/732673475 >> v2:172.21.15.161:3300/0 conn(0x7f82900aab90 0x7f829015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8286000640 1 -- 172.21.15.84:0/732673475 >> v1:172.21.15.161:6789/0 conn(0x7f82901586d0 legacy=0x7f82900aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f828e000640 1 -- 172.21.15.84:0/732673475 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349611015 0 0) 0x7f82900731e0 con 0x7f8290072d60 2024-03-07T07:31:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8286000640 1 -- 172.21.15.84:0/732673475 >> v1:172.21.15.84:6789/0 conn(0x7f8290072d60 legacy=0x7f82900704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8286000640 1 -- 172.21.15.84:0/732673475 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290162090 con 0x7f82900aab90 2024-03-07T07:31:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.058+0000 7f8286000640 1 --2- 172.21.15.84:0/732673475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82900aab90 0x7f829015f250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8278009740 tx=0x7f827801c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b744b61fa311ce6e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f828e000640 1 -- 172.21.15.84:0/732673475 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b0070 con 0x7f82900aab90 2024-03-07T07:31:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f828e000640 1 -- 172.21.15.84:0/732673475 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780a4e50 con 0x7f82900aab90 2024-03-07T07:31:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f828e000640 1 -- 172.21.15.84:0/732673475 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780ab820 con 0x7f82900aab90 2024-03-07T07:31:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- 172.21.15.84:0/732673475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82900aab90 msgr2=0x7f829015f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 --2- 172.21.15.84:0/732673475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82900aab90 0x7f829015f250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8278009740 tx=0x7f827801c2d0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- 172.21.15.84:0/732673475 shutdown_connections 2024-03-07T07:31:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 --2- 172.21.15.84:0/732673475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82900aab90 0x7f829015f250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- 172.21.15.84:0/732673475 >> 172.21.15.84:0/732673475 conn(0x7f8290072240 msgr2=0x7f8290072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- 172.21.15.84:0/732673475 shutdown_connections 2024-03-07T07:31:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- 172.21.15.84:0/732673475 wait complete. 2024-03-07T07:31:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 Processor -- start 2024-03-07T07:31:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- start start 2024-03-07T07:31:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8290072d60 0x7f8290140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900aab90 0x7f8290138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82901586d0 0x7f8290157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290158c30 con 0x7f82900aab90 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290158ab0 con 0x7f8290072d60 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8295800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829016c0c0 con 0x7f82901586d0 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8286000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900aab90 0x7f8290138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8286000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900aab90 0x7f8290138ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50174/0 (socket says 172.21.15.84:50174) 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f8286000640 1 -- 172.21.15.84:0/4022777301 learned_addr learned my addr 172.21.15.84:0/4022777301 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f828ea00640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8290072d60 0x7f8290140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.062+0000 7f828f400640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82901586d0 0x7f8290157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8286000640 1 -- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82901586d0 msgr2=0x7f8290157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8286000640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82901586d0 0x7f8290157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8286000640 1 -- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8290072d60 msgr2=0x7f8290140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8286000640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8290072d60 0x7f8290140390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8286000640 1 -- 172.21.15.84:0/4022777301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829013f2f0 con 0x7f82900aab90 2024-03-07T07:31:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f828ea00640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8290072d60 0x7f8290140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8286000640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900aab90 0x7f8290138ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8278009740 tx=0x7f827801ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8287400640 1 -- 172.21.15.84:0/4022777301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b0050 con 0x7f82900aab90 2024-03-07T07:31:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8287400640 1 -- 172.21.15.84:0/4022777301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780bc070 con 0x7f82900aab90 2024-03-07T07:31:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8287400640 1 -- 172.21.15.84:0/4022777301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b78b0 con 0x7f82900aab90 2024-03-07T07:31:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829013f5d0 con 0x7f82900aab90 2024-03-07T07:31:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829013fb90 con 0x7f82900aab90 2024-03-07T07:31:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8290062d40 con 0x7f82900aab90 2024-03-07T07:31:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8287400640 1 -- 172.21.15.84:0/4022777301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f82780b7a50 con 0x7f82900aab90 2024-03-07T07:31:27.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8287400640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f826c066f90 0x7f826c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f8287400640 1 -- 172.21.15.84:0/4022777301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f827811f740 con 0x7f82900aab90 2024-03-07T07:31:27.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.066+0000 7f828ea00640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f826c066f90 0x7f826c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.070+0000 7f828ea00640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f826c066f90 0x7f826c069450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82800012f0 tx=0x7f8280009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.070+0000 7f8287400640 1 -- 172.21.15.84:0/4022777301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f8278015f50 con 0x7f82900aab90 2024-03-07T07:31:27.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.222+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8290067400 con 0x7f826c066f90 2024-03-07T07:31:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.230+0000 7f8287400640 1 -- 172.21.15.84:0/4022777301 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251831 (secure 0 0 0) 0x7f8290067400 con 0x7f826c066f90 2024-03-07T07:31:27.235 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:27.237 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:31:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f826c066f90 msgr2=0x7f826c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f826c066f90 0x7f826c069450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82800012f0 tx=0x7f8280009040 comp rx=0 tx=0).stop 2024-03-07T07:31:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900aab90 msgr2=0x7f8290138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900aab90 0x7f8290138ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8278009740 tx=0x7f827801ab10 comp rx=0 tx=0).stop 2024-03-07T07:31:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 shutdown_connections 2024-03-07T07:31:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f826c066f90 0x7f826c069450 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82901586d0 0x7f8290157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900aab90 0x7f8290138ff0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 --2- 172.21.15.84:0/4022777301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8290072d60 0x7f8290140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 >> 172.21.15.84:0/4022777301 conn(0x7f8290072240 msgr2=0x7f82900cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 shutdown_connections 2024-03-07T07:31:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.234+0000 7f8295800640 1 -- 172.21.15.84:0/4022777301 wait complete. 2024-03-07T07:31:27.255 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-03-07T07:31:26.883170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219036,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755684,"statfs":{"total":773094113280,"available":772869820416,"internally_reserved":0,"allocated":2924544,"data_stored":1765772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.879977"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507368+0000","last_change":"2024-03-07T07:31:14.022667+0000","last_active":"2024-03-07T07:31:15.507368+0000","last_peered":"2024-03-07T07:31:15.507368+0000","last_clean":"2024-03-07T07:31:15.507368+0000","last_became_active":"2024-03-07T07:31:14.021747+0000","last_became_peered":"2024-03-07T07:31:14.021747+0000","last_unstale":"2024-03-07T07:31:15.507368+0000","last_undegraded":"2024-03-07T07:31:15.507368+0000","last_fullsized":"2024-03-07T07:31:15.507368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:54:30.956919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507636+0000","last_change":"2024-03-07T07:31:14.025493+0000","last_active":"2024-03-07T07:31:15.507636+0000","last_peered":"2024-03-07T07:31:15.507636+0000","last_clean":"2024-03-07T07:31:15.507636+0000","last_became_active":"2024-03-07T07:31:14.025150+0000","last_became_peered":"2024-03-07T07:31:14.025150+0000","last_unstale":"2024-03-07T07:31:15.507636+0000","last_undegraded":"2024-03-07T07:31:15.507636+0000","last_fullsized":"2024-03-07T07:31:15.507636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507618+0000","last_change":"2024-03-07T07:31:14.020208+0000","last_active":"2024-03-07T07:31:15.507618+0000","last_peered":"2024-03-07T07:31:15.507618+0000","last_clean":"2024-03-07T07:31:15.507618+0000","last_became_active":"2024-03-07T07:31:14.019922+0000","last_became_peered":"2024-03-07T07:31:14.019922+0000","last_unstale":"2024-03-07T07:31:15.507618+0000","last_undegraded":"2024-03-07T07:31:15.507618+0000","last_fullsized":"2024-03-07T07:31:15.507618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004299+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:15.004299+0000","last_peered":"2024-03-07T07:31:15.004299+0000","last_clean":"2024-03-07T07:31:15.004299+0000","last_became_active":"2024-03-07T07:31:14.014792+0000","last_became_peered":"2024-03-07T07:31:14.014792+0000","last_unstale":"2024-03-07T07:31:15.004299+0000","last_undegraded":"2024-03-07T07:31:15.004299+0000","last_fullsized":"2024-03-07T07:31:15.004299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506999+0000","last_change":"2024-03-07T07:31:14.020574+0000","last_active":"2024-03-07T07:31:15.506999+0000","last_peered":"2024-03-07T07:31:15.506999+0000","last_clean":"2024-03-07T07:31:15.506999+0000","last_became_active":"2024-03-07T07:31:14.020305+0000","last_became_peered":"2024-03-07T07:31:14.020305+0000","last_unstale":"2024-03-07T07:31:15.506999+0000","last_undegraded":"2024-03-07T07:31:15.506999+0000","last_fullsized":"2024-03-07T07:31:15.506999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:35.135533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004168+0000","last_change":"2024-03-07T07:31:14.014335+0000","last_active":"2024-03-07T07:31:15.004168+0000","last_peered":"2024-03-07T07:31:15.004168+0000","last_clean":"2024-03-07T07:31:15.004168+0000","last_became_active":"2024-03-07T07:31:14.013975+0000","last_became_peered":"2024-03-07T07:31:14.013975+0000","last_unstale":"2024-03-07T07:31:15.004168+0000","last_undegraded":"2024-03-07T07:31:15.004168+0000","last_fullsized":"2024-03-07T07:31:15.004168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:56.429772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506827+0000","last_change":"2024-03-07T07:31:14.021322+0000","last_active":"2024-03-07T07:31:15.506827+0000","last_peered":"2024-03-07T07:31:15.506827+0000","last_clean":"2024-03-07T07:31:15.506827+0000","last_became_active":"2024-03-07T07:31:14.021007+0000","last_became_peered":"2024-03-07T07:31:14.021007+0000","last_unstale":"2024-03-07T07:31:15.506827+0000","last_undegraded":"2024-03-07T07:31:15.506827+0000","last_fullsized":"2024-03-07T07:31:15.506827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507184+0000","last_change":"2024-03-07T07:31:14.027374+0000","last_active":"2024-03-07T07:31:15.507184+0000","last_peered":"2024-03-07T07:31:15.507184+0000","last_clean":"2024-03-07T07:31:15.507184+0000","last_became_active":"2024-03-07T07:31:14.027198+0000","last_became_peered":"2024-03-07T07:31:14.027198+0000","last_unstale":"2024-03-07T07:31:15.507184+0000","last_undegraded":"2024-03-07T07:31:15.507184+0000","last_fullsized":"2024-03-07T07:31:15.507184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:38:46.559080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005832+0000","last_change":"2024-03-07T07:31:14.011155+0000","last_active":"2024-03-07T07:31:15.005832+0000","last_peered":"2024-03-07T07:31:15.005832+0000","last_clean":"2024-03-07T07:31:15.005832+0000","last_became_active":"2024-03-07T07:31:14.010799+0000","last_became_peered":"2024-03-07T07:31:14.010799+0000","last_unstale":"2024-03-07T07:31:15.005832+0000","last_undegraded":"2024-03-07T07:31:15.005832+0000","last_fullsized":"2024-03-07T07:31:15.005832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507307+0000","last_change":"2024-03-07T07:31:14.002815+0000","last_active":"2024-03-07T07:31:15.507307+0000","last_peered":"2024-03-07T07:31:15.507307+0000","last_clean":"2024-03-07T07:31:15.507307+0000","last_became_active":"2024-03-07T07:31:14.002600+0000","last_became_peered":"2024-03-07T07:31:14.002600+0000","last_unstale":"2024-03-07T07:31:15.507307+0000","last_undegraded":"2024-03-07T07:31:15.507307+0000","last_fullsized":"2024-03-07T07:31:15.507307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:16:51.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507108+0000","last_change":"2024-03-07T07:31:14.020556+0000","last_active":"2024-03-07T07:31:15.507108+0000","last_peered":"2024-03-07T07:31:15.507108+0000","last_clean":"2024-03-07T07:31:15.507108+0000","last_became_active":"2024-03-07T07:31:14.020256+0000","last_became_peered":"2024-03-07T07:31:14.020256+0000","last_unstale":"2024-03-07T07:31:15.507108+0000","last_undegraded":"2024-03-07T07:31:15.507108+0000","last_fullsized":"2024-03-07T07:31:15.507108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506985+0000","last_change":"2024-03-07T07:31:14.014180+0000","last_active":"2024-03-07T07:31:15.506985+0000","last_peered":"2024-03-07T07:31:15.506985+0000","last_clean":"2024-03-07T07:31:15.506985+0000","last_became_active":"2024-03-07T07:31:14.013845+0000","last_became_peered":"2024-03-07T07:31:14.013845+0000","last_unstale":"2024-03-07T07:31:15.506985+0000","last_undegraded":"2024-03-07T07:31:15.506985+0000","last_fullsized":"2024-03-07T07:31:15.506985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:54:38.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507185+0000","last_change":"2024-03-07T07:31:14.027721+0000","last_active":"2024-03-07T07:31:15.507185+0000","last_peered":"2024-03-07T07:31:15.507185+0000","last_clean":"2024-03-07T07:31:15.507185+0000","last_became_active":"2024-03-07T07:31:14.024529+0000","last_became_peered":"2024-03-07T07:31:14.024529+0000","last_unstale":"2024-03-07T07:31:15.507185+0000","last_undegraded":"2024-03-07T07:31:15.507185+0000","last_fullsized":"2024-03-07T07:31:15.507185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:16:31.787880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506638+0000","last_change":"2024-03-07T07:31:14.023955+0000","last_active":"2024-03-07T07:31:15.506638+0000","last_peered":"2024-03-07T07:31:15.506638+0000","last_clean":"2024-03-07T07:31:15.506638+0000","last_became_active":"2024-03-07T07:31:14.023578+0000","last_became_peered":"2024-03-07T07:31:14.023578+0000","last_unstale":"2024-03-07T07:31:15.506638+0000","last_undegraded":"2024-03-07T07:31:15.506638+0000","last_fullsized":"2024-03-07T07:31:15.506638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:10:18.829790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507161+0000","last_change":"2024-03-07T07:31:14.027411+0000","last_active":"2024-03-07T07:31:15.507161+0000","last_peered":"2024-03-07T07:31:15.507161+0000","last_clean":"2024-03-07T07:31:15.507161+0000","last_became_active":"2024-03-07T07:31:14.026679+0000","last_became_peered":"2024-03-07T07:31:14.026679+0000","last_unstale":"2024-03-07T07:31:15.507161+0000","last_undegraded":"2024-03-07T07:31:15.507161+0000","last_fullsized":"2024-03-07T07:31:15.507161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:16.045058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324002+0000","last_change":"2024-03-07T07:31:14.004296+0000","last_active":"2024-03-07T07:31:15.324002+0000","last_peered":"2024-03-07T07:31:15.324002+0000","last_clean":"2024-03-07T07:31:15.324002+0000","last_became_active":"2024-03-07T07:31:14.003978+0000","last_became_peered":"2024-03-07T07:31:14.003978+0000","last_unstale":"2024-03-07T07:31:15.324002+0000","last_undegraded":"2024-03-07T07:31:15.324002+0000","last_fullsized":"2024-03-07T07:31:15.324002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:16:51.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324577+0000","last_change":"2024-03-07T07:31:14.026782+0000","last_active":"2024-03-07T07:31:15.324577+0000","last_peered":"2024-03-07T07:31:15.324577+0000","last_clean":"2024-03-07T07:31:15.324577+0000","last_became_active":"2024-03-07T07:31:14.026435+0000","last_became_peered":"2024-03-07T07:31:14.026435+0000","last_unstale":"2024-03-07T07:31:15.324577+0000","last_undegraded":"2024-03-07T07:31:15.324577+0000","last_fullsized":"2024-03-07T07:31:15.324577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:00:18.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.508054+0000","last_change":"2024-03-07T07:31:14.022236+0000","last_active":"2024-03-07T07:31:15.508054+0000","last_peered":"2024-03-07T07:31:15.508054+0000","last_clean":"2024-03-07T07:31:15.508054+0000","last_became_active":"2024-03-07T07:31:14.021958+0000","last_became_peered":"2024-03-07T07:31:14.021958+0000","last_unstale":"2024-03-07T07:31:15.508054+0000","last_undegraded":"2024-03-07T07:31:15.508054+0000","last_fullsized":"2024-03-07T07:31:15.508054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324612+0000","last_change":"2024-03-07T07:31:14.018840+0000","last_active":"2024-03-07T07:31:15.324612+0000","last_peered":"2024-03-07T07:31:15.324612+0000","last_clean":"2024-03-07T07:31:15.324612+0000","last_became_active":"2024-03-07T07:31:14.015465+0000","last_became_peered":"2024-03-07T07:31:14.015465+0000","last_unstale":"2024-03-07T07:31:15.324612+0000","last_undegraded":"2024-03-07T07:31:15.324612+0000","last_fullsized":"2024-03-07T07:31:15.324612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:13:28.854524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507008+0000","last_change":"2024-03-07T07:31:14.003946+0000","last_active":"2024-03-07T07:31:15.507008+0000","last_peered":"2024-03-07T07:31:15.507008+0000","last_clean":"2024-03-07T07:31:15.507008+0000","last_became_active":"2024-03-07T07:31:14.003724+0000","last_became_peered":"2024-03-07T07:31:14.003724+0000","last_unstale":"2024-03-07T07:31:15.507008+0000","last_undegraded":"2024-03-07T07:31:15.507008+0000","last_fullsized":"2024-03-07T07:31:15.507008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004139+0000","last_change":"2024-03-07T07:31:14.001532+0000","last_active":"2024-03-07T07:31:15.004139+0000","last_peered":"2024-03-07T07:31:15.004139+0000","last_clean":"2024-03-07T07:31:15.004139+0000","last_became_active":"2024-03-07T07:31:14.001153+0000","last_became_peered":"2024-03-07T07:31:14.001153+0000","last_unstale":"2024-03-07T07:31:15.004139+0000","last_undegraded":"2024-03-07T07:31:15.004139+0000","last_fullsized":"2024-03-07T07:31:15.004139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:49:34.177805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005389+0000","last_change":"2024-03-07T07:31:14.019962+0000","last_active":"2024-03-07T07:31:15.005389+0000","last_peered":"2024-03-07T07:31:15.005389+0000","last_clean":"2024-03-07T07:31:15.005389+0000","last_became_active":"2024-03-07T07:31:14.019664+0000","last_became_peered":"2024-03-07T07:31:14.019664+0000","last_unstale":"2024-03-07T07:31:15.005389+0000","last_undegraded":"2024-03-07T07:31:15.005389+0000","last_fullsized":"2024-03-07T07:31:15.005389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507316+0000","last_change":"2024-03-07T07:31:14.010768+0000","last_active":"2024-03-07T07:31:15.507316+0000","last_peered":"2024-03-07T07:31:15.507316+0000","last_clean":"2024-03-07T07:31:15.507316+0000","last_became_active":"2024-03-07T07:31:14.010406+0000","last_became_peered":"2024-03-07T07:31:14.010406+0000","last_unstale":"2024-03-07T07:31:15.507316+0000","last_undegraded":"2024-03-07T07:31:15.507316+0000","last_fullsized":"2024-03-07T07:31:15.507316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:53:09.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324007+0000","last_change":"2024-03-07T07:31:14.019616+0000","last_active":"2024-03-07T07:31:15.324007+0000","last_peered":"2024-03-07T07:31:15.324007+0000","last_clean":"2024-03-07T07:31:15.324007+0000","last_became_active":"2024-03-07T07:31:14.019246+0000","last_became_peered":"2024-03-07T07:31:14.019246+0000","last_unstale":"2024-03-07T07:31:15.324007+0000","last_undegraded":"2024-03-07T07:31:15.324007+0000","last_fullsized":"2024-03-07T07:31:15.324007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:54:43.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507717+0000","last_change":"2024-03-07T07:31:14.015083+0000","last_active":"2024-03-07T07:31:15.507717+0000","last_peered":"2024-03-07T07:31:15.507717+0000","last_clean":"2024-03-07T07:31:15.507717+0000","last_became_active":"2024-03-07T07:31:14.014755+0000","last_became_peered":"2024-03-07T07:31:14.014755+0000","last_unstale":"2024-03-07T07:31:15.507717+0000","last_undegraded":"2024-03-07T07:31:15.507717+0000","last_fullsized":"2024-03-07T07:31:15.507717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004465+0000","last_change":"2024-03-07T07:31:14.017123+0000","last_active":"2024-03-07T07:31:15.004465+0000","last_peered":"2024-03-07T07:31:15.004465+0000","last_clean":"2024-03-07T07:31:15.004465+0000","last_became_active":"2024-03-07T07:31:14.016071+0000","last_became_peered":"2024-03-07T07:31:14.016071+0000","last_unstale":"2024-03-07T07:31:15.004465+0000","last_undegraded":"2024-03-07T07:31:15.004465+0000","last_fullsized":"2024-03-07T07:31:15.004465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.508369+0000","last_change":"2024-03-07T07:31:14.024590+0000","last_active":"2024-03-07T07:31:15.508369+0000","last_peered":"2024-03-07T07:31:15.508369+0000","last_clean":"2024-03-07T07:31:15.508369+0000","last_became_active":"2024-03-07T07:31:14.024260+0000","last_became_peered":"2024-03-07T07:31:14.024260+0000","last_unstale":"2024-03-07T07:31:15.508369+0000","last_undegraded":"2024-03-07T07:31:15.508369+0000","last_fullsized":"2024-03-07T07:31:15.508369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:12:29.984408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507396+0000","last_change":"2024-03-07T07:31:14.029144+0000","last_active":"2024-03-07T07:31:15.507396+0000","last_peered":"2024-03-07T07:31:15.507396+0000","last_clean":"2024-03-07T07:31:15.507396+0000","last_became_active":"2024-03-07T07:31:14.027597+0000","last_became_peered":"2024-03-07T07:31:14.027597+0000","last_unstale":"2024-03-07T07:31:15.507396+0000","last_undegraded":"2024-03-07T07:31:15.507396+0000","last_fullsized":"2024-03-07T07:31:15.507396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:17:16.143558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507342+0000","last_change":"2024-03-07T07:31:14.025908+0000","last_active":"2024-03-07T07:31:15.507342+0000","last_peered":"2024-03-07T07:31:15.507342+0000","last_clean":"2024-03-07T07:31:15.507342+0000","last_became_active":"2024-03-07T07:31:14.025639+0000","last_became_peered":"2024-03-07T07:31:14.025639+0000","last_unstale":"2024-03-07T07:31:15.507342+0000","last_undegraded":"2024-03-07T07:31:15.507342+0000","last_fullsized":"2024-03-07T07:31:15.507342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:56:49.445268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324107+0000","last_change":"2024-03-07T07:31:14.018277+0000","last_active":"2024-03-07T07:31:15.324107+0000","last_peered":"2024-03-07T07:31:15.324107+0000","last_clean":"2024-03-07T07:31:15.324107+0000","last_became_active":"2024-03-07T07:31:14.017969+0000","last_became_peered":"2024-03-07T07:31:14.017969+0000","last_unstale":"2024-03-07T07:31:15.324107+0000","last_undegraded":"2024-03-07T07:31:15.324107+0000","last_fullsized":"2024-03-07T07:31:15.324107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:01.505914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506523+0000","last_change":"2024-03-07T07:31:14.009930+0000","last_active":"2024-03-07T07:31:15.506523+0000","last_peered":"2024-03-07T07:31:15.506523+0000","last_clean":"2024-03-07T07:31:15.506523+0000","last_became_active":"2024-03-07T07:31:14.009559+0000","last_became_peered":"2024-03-07T07:31:14.009559+0000","last_unstale":"2024-03-07T07:31:15.506523+0000","last_undegraded":"2024-03-07T07:31:15.506523+0000","last_fullsized":"2024-03-07T07:31:15.506523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004185+0000","last_change":"2024-03-07T07:31:14.025073+0000","last_active":"2024-03-07T07:31:15.004185+0000","last_peered":"2024-03-07T07:31:15.004185+0000","last_clean":"2024-03-07T07:31:15.004185+0000","last_became_active":"2024-03-07T07:31:14.024374+0000","last_became_peered":"2024-03-07T07:31:14.024374+0000","last_unstale":"2024-03-07T07:31:15.004185+0000","last_undegraded":"2024-03-07T07:31:15.004185+0000","last_fullsized":"2024-03-07T07:31:15.004185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005472+0000","last_change":"2024-03-07T07:31:14.009391+0000","last_active":"2024-03-07T07:31:15.005472+0000","last_peered":"2024-03-07T07:31:15.005472+0000","last_clean":"2024-03-07T07:31:15.005472+0000","last_became_active":"2024-03-07T07:31:14.009148+0000","last_became_peered":"2024-03-07T07:31:14.009148+0000","last_unstale":"2024-03-07T07:31:15.005472+0000","last_undegraded":"2024-03-07T07:31:15.005472+0000","last_fullsized":"2024-03-07T07:31:15.005472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:42.702576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507426+0000","last_change":"2024-03-07T07:31:13.010423+0000","last_active":"2024-03-07T07:31:15.507426+0000","last_peered":"2024-03-07T07:31:15.507426+0000","last_clean":"2024-03-07T07:31:15.507426+0000","last_became_active":"2024-03-07T07:31:13.010096+0000","last_became_peered":"2024-03-07T07:31:13.010096+0000","last_unstale":"2024-03-07T07:31:15.507426+0000","last_undegraded":"2024-03-07T07:31:15.507426+0000","last_fullsized":"2024-03-07T07:31:15.507426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004206+0000","last_change":"2024-03-07T07:31:14.008786+0000","last_active":"2024-03-07T07:31:15.004206+0000","last_peered":"2024-03-07T07:31:15.004206+0000","last_clean":"2024-03-07T07:31:15.004206+0000","last_became_active":"2024-03-07T07:31:14.007354+0000","last_became_peered":"2024-03-07T07:31:14.007354+0000","last_unstale":"2024-03-07T07:31:15.004206+0000","last_undegraded":"2024-03-07T07:31:15.004206+0000","last_fullsized":"2024-03-07T07:31:15.004206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:12:29.984408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324386+0000","last_change":"2024-03-07T07:31:13.006659+0000","last_active":"2024-03-07T07:31:15.324386+0000","last_peered":"2024-03-07T07:31:15.324386+0000","last_clean":"2024-03-07T07:31:15.324386+0000","last_became_active":"2024-03-07T07:31:13.005927+0000","last_became_peered":"2024-03-07T07:31:13.005927+0000","last_unstale":"2024-03-07T07:31:15.324386+0000","last_undegraded":"2024-03-07T07:31:15.324386+0000","last_fullsized":"2024-03-07T07:31:15.324386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506797+0000","last_change":"2024-03-07T07:31:13.003135+0000","last_active":"2024-03-07T07:31:15.506797+0000","last_peered":"2024-03-07T07:31:15.506797+0000","last_clean":"2024-03-07T07:31:15.506797+0000","last_became_active":"2024-03-07T07:31:13.002843+0000","last_became_peered":"2024-03-07T07:31:13.002843+0000","last_unstale":"2024-03-07T07:31:15.506797+0000","last_undegraded":"2024-03-07T07:31:15.506797+0000","last_fullsized":"2024-03-07T07:31:15.506797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:45.950345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507401+0000","last_change":"2024-03-07T07:31:14.031819+0000","last_active":"2024-03-07T07:31:15.507401+0000","last_peered":"2024-03-07T07:31:15.507401+0000","last_clean":"2024-03-07T07:31:15.507401+0000","last_became_active":"2024-03-07T07:31:14.031513+0000","last_became_peered":"2024-03-07T07:31:14.031513+0000","last_unstale":"2024-03-07T07:31:15.507401+0000","last_undegraded":"2024-03-07T07:31:15.507401+0000","last_fullsized":"2024-03-07T07:31:15.507401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:19.620264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324216+0000","last_change":"2024-03-07T07:31:13.006518+0000","last_active":"2024-03-07T07:31:15.324216+0000","last_peered":"2024-03-07T07:31:15.324216+0000","last_clean":"2024-03-07T07:31:15.324216+0000","last_became_active":"2024-03-07T07:31:13.005662+0000","last_became_peered":"2024-03-07T07:31:13.005662+0000","last_unstale":"2024-03-07T07:31:15.324216+0000","last_undegraded":"2024-03-07T07:31:15.324216+0000","last_fullsized":"2024-03-07T07:31:15.324216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004066+0000","last_change":"2024-03-07T07:31:14.006625+0000","last_active":"2024-03-07T07:31:15.004066+0000","last_peered":"2024-03-07T07:31:15.004066+0000","last_clean":"2024-03-07T07:31:15.004066+0000","last_became_active":"2024-03-07T07:31:14.006314+0000","last_became_peered":"2024-03-07T07:31:14.006314+0000","last_unstale":"2024-03-07T07:31:15.004066+0000","last_undegraded":"2024-03-07T07:31:15.004066+0000","last_fullsized":"2024-03-07T07:31:15.004066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:16:31.787880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005853+0000","last_change":"2024-03-07T07:31:13.014357+0000","last_active":"2024-03-07T07:31:15.005853+0000","last_peered":"2024-03-07T07:31:15.005853+0000","last_clean":"2024-03-07T07:31:15.005853+0000","last_became_active":"2024-03-07T07:31:13.014065+0000","last_became_peered":"2024-03-07T07:31:13.014065+0000","last_unstale":"2024-03-07T07:31:15.005853+0000","last_undegraded":"2024-03-07T07:31:15.005853+0000","last_fullsized":"2024-03-07T07:31:15.005853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004535+0000","last_change":"2024-03-07T07:31:14.016928+0000","last_active":"2024-03-07T07:31:15.004535+0000","last_peered":"2024-03-07T07:31:15.004535+0000","last_clean":"2024-03-07T07:31:15.004535+0000","last_became_active":"2024-03-07T07:31:14.016029+0000","last_became_peered":"2024-03-07T07:31:14.016029+0000","last_unstale":"2024-03-07T07:31:15.004535+0000","last_undegraded":"2024-03-07T07:31:15.004535+0000","last_fullsized":"2024-03-07T07:31:15.004535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:33:57.397623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507244+0000","last_change":"2024-03-07T07:31:13.017045+0000","last_active":"2024-03-07T07:31:15.507244+0000","last_peered":"2024-03-07T07:31:15.507244+0000","last_clean":"2024-03-07T07:31:15.507244+0000","last_became_active":"2024-03-07T07:31:13.016712+0000","last_became_peered":"2024-03-07T07:31:13.016712+0000","last_unstale":"2024-03-07T07:31:15.507244+0000","last_undegraded":"2024-03-07T07:31:15.507244+0000","last_fullsized":"2024-03-07T07:31:15.507244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:20:55.422782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507993+0000","last_change":"2024-03-07T07:31:14.011291+0000","last_active":"2024-03-07T07:31:15.507993+0000","last_peered":"2024-03-07T07:31:15.507993+0000","last_clean":"2024-03-07T07:31:15.507993+0000","last_became_active":"2024-03-07T07:31:14.010987+0000","last_became_peered":"2024-03-07T07:31:14.010987+0000","last_unstale":"2024-03-07T07:31:15.507993+0000","last_undegraded":"2024-03-07T07:31:15.507993+0000","last_fullsized":"2024-03-07T07:31:15.507993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:56:52.711355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507937+0000","last_change":"2024-03-07T07:31:13.004264+0000","last_active":"2024-03-07T07:31:15.507937+0000","last_peered":"2024-03-07T07:31:15.507937+0000","last_clean":"2024-03-07T07:31:15.507937+0000","last_became_active":"2024-03-07T07:31:13.003883+0000","last_became_peered":"2024-03-07T07:31:13.003883+0000","last_unstale":"2024-03-07T07:31:15.507937+0000","last_undegraded":"2024-03-07T07:31:15.507937+0000","last_fullsized":"2024-03-07T07:31:15.507937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:18:45.919382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324252+0000","last_change":"2024-03-07T07:31:14.007051+0000","last_active":"2024-03-07T07:31:15.324252+0000","last_peered":"2024-03-07T07:31:15.324252+0000","last_clean":"2024-03-07T07:31:15.324252+0000","last_became_active":"2024-03-07T07:31:14.005904+0000","last_became_peered":"2024-03-07T07:31:14.005904+0000","last_unstale":"2024-03-07T07:31:15.324252+0000","last_undegraded":"2024-03-07T07:31:15.324252+0000","last_fullsized":"2024-03-07T07:31:15.324252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:57:16.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004295+0000","last_change":"2024-03-07T07:31:12.997602+0000","last_active":"2024-03-07T07:31:15.004295+0000","last_peered":"2024-03-07T07:31:15.004295+0000","last_clean":"2024-03-07T07:31:15.004295+0000","last_became_active":"2024-03-07T07:31:12.997204+0000","last_became_peered":"2024-03-07T07:31:12.997204+0000","last_unstale":"2024-03-07T07:31:15.004295+0000","last_undegraded":"2024-03-07T07:31:15.004295+0000","last_fullsized":"2024-03-07T07:31:15.004295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:37:18.274151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507181+0000","last_change":"2024-03-07T07:31:14.028791+0000","last_active":"2024-03-07T07:31:15.507181+0000","last_peered":"2024-03-07T07:31:15.507181+0000","last_clean":"2024-03-07T07:31:15.507181+0000","last_became_active":"2024-03-07T07:31:14.028591+0000","last_became_peered":"2024-03-07T07:31:14.028591+0000","last_unstale":"2024-03-07T07:31:15.507181+0000","last_undegraded":"2024-03-07T07:31:15.507181+0000","last_fullsized":"2024-03-07T07:31:15.507181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:56:52.711355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506774+0000","last_change":"2024-03-07T07:31:13.011937+0000","last_active":"2024-03-07T07:31:15.506774+0000","last_peered":"2024-03-07T07:31:15.506774+0000","last_clean":"2024-03-07T07:31:15.506774+0000","last_became_active":"2024-03-07T07:31:13.011577+0000","last_became_peered":"2024-03-07T07:31:13.011577+0000","last_unstale":"2024-03-07T07:31:15.506774+0000","last_undegraded":"2024-03-07T07:31:15.506774+0000","last_fullsized":"2024-03-07T07:31:15.506774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:44.580387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506742+0000","last_change":"2024-03-07T07:31:14.028636+0000","last_active":"2024-03-07T07:31:15.506742+0000","last_peered":"2024-03-07T07:31:15.506742+0000","last_clean":"2024-03-07T07:31:15.506742+0000","last_became_active":"2024-03-07T07:31:14.024496+0000","last_became_peered":"2024-03-07T07:31:14.024496+0000","last_unstale":"2024-03-07T07:31:15.506742+0000","last_undegraded":"2024-03-07T07:31:15.506742+0000","last_fullsized":"2024-03-07T07:31:15.506742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:10:02.515660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324494+0000","last_change":"2024-03-07T07:31:13.000961+0000","last_active":"2024-03-07T07:31:15.324494+0000","last_peered":"2024-03-07T07:31:15.324494+0000","last_clean":"2024-03-07T07:31:15.324494+0000","last_became_active":"2024-03-07T07:31:13.000129+0000","last_became_peered":"2024-03-07T07:31:13.000129+0000","last_unstale":"2024-03-07T07:31:15.324494+0000","last_undegraded":"2024-03-07T07:31:15.324494+0000","last_fullsized":"2024-03-07T07:31:15.324494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:58.045352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324283+0000","last_change":"2024-03-07T07:31:14.022537+0000","last_active":"2024-03-07T07:31:15.324283+0000","last_peered":"2024-03-07T07:31:15.324283+0000","last_clean":"2024-03-07T07:31:15.324283+0000","last_became_active":"2024-03-07T07:31:14.022221+0000","last_became_peered":"2024-03-07T07:31:14.022221+0000","last_unstale":"2024-03-07T07:31:15.324283+0000","last_undegraded":"2024-03-07T07:31:15.324283+0000","last_fullsized":"2024-03-07T07:31:15.324283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:34:42.196434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506798+0000","last_change":"2024-03-07T07:31:13.009533+0000","last_active":"2024-03-07T07:31:15.506798+0000","last_peered":"2024-03-07T07:31:15.506798+0000","last_clean":"2024-03-07T07:31:15.506798+0000","last_became_active":"2024-03-07T07:31:13.009224+0000","last_became_peered":"2024-03-07T07:31:13.009224+0000","last_unstale":"2024-03-07T07:31:15.506798+0000","last_undegraded":"2024-03-07T07:31:15.506798+0000","last_fullsized":"2024-03-07T07:31:15.506798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:27:40.675440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005317+0000","last_change":"2024-03-07T07:31:14.015133+0000","last_active":"2024-03-07T07:31:15.005317+0000","last_peered":"2024-03-07T07:31:15.005317+0000","last_clean":"2024-03-07T07:31:15.005317+0000","last_became_active":"2024-03-07T07:31:14.014859+0000","last_became_peered":"2024-03-07T07:31:14.014859+0000","last_unstale":"2024-03-07T07:31:15.005317+0000","last_undegraded":"2024-03-07T07:31:15.005317+0000","last_fullsized":"2024-03-07T07:31:15.005317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:26.665366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.003867+0000","last_change":"2024-03-07T07:31:13.000976+0000","last_active":"2024-03-07T07:31:15.003867+0000","last_peered":"2024-03-07T07:31:15.003867+0000","last_clean":"2024-03-07T07:31:15.003867+0000","last_became_active":"2024-03-07T07:31:13.000624+0000","last_became_peered":"2024-03-07T07:31:13.000624+0000","last_unstale":"2024-03-07T07:31:15.003867+0000","last_undegraded":"2024-03-07T07:31:15.003867+0000","last_fullsized":"2024-03-07T07:31:15.003867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:34.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324076+0000","last_change":"2024-03-07T07:31:14.008321+0000","last_active":"2024-03-07T07:31:15.324076+0000","last_peered":"2024-03-07T07:31:15.324076+0000","last_clean":"2024-03-07T07:31:15.324076+0000","last_became_active":"2024-03-07T07:31:14.008039+0000","last_became_peered":"2024-03-07T07:31:14.008039+0000","last_unstale":"2024-03-07T07:31:15.324076+0000","last_undegraded":"2024-03-07T07:31:15.324076+0000","last_fullsized":"2024-03-07T07:31:15.324076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:54:30.956919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507471+0000","last_change":"2024-03-07T07:31:13.008580+0000","last_active":"2024-03-07T07:31:15.507471+0000","last_peered":"2024-03-07T07:31:15.507471+0000","last_clean":"2024-03-07T07:31:15.507471+0000","last_became_active":"2024-03-07T07:31:13.008276+0000","last_became_peered":"2024-03-07T07:31:13.008276+0000","last_unstale":"2024-03-07T07:31:15.507471+0000","last_undegraded":"2024-03-07T07:31:15.507471+0000","last_fullsized":"2024-03-07T07:31:15.507471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004627+0000","last_change":"2024-03-07T07:31:14.003764+0000","last_active":"2024-03-07T07:31:15.004627+0000","last_peered":"2024-03-07T07:31:15.004627+0000","last_clean":"2024-03-07T07:31:15.004627+0000","last_became_active":"2024-03-07T07:31:14.002976+0000","last_became_peered":"2024-03-07T07:31:14.002976+0000","last_unstale":"2024-03-07T07:31:15.004627+0000","last_undegraded":"2024-03-07T07:31:15.004627+0000","last_fullsized":"2024-03-07T07:31:15.004627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:31.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004481+0000","last_change":"2024-03-07T07:31:13.010016+0000","last_active":"2024-03-07T07:31:15.004481+0000","last_peered":"2024-03-07T07:31:15.004481+0000","last_clean":"2024-03-07T07:31:15.004481+0000","last_became_active":"2024-03-07T07:31:13.009751+0000","last_became_peered":"2024-03-07T07:31:13.009751+0000","last_unstale":"2024-03-07T07:31:15.004481+0000","last_undegraded":"2024-03-07T07:31:15.004481+0000","last_fullsized":"2024-03-07T07:31:15.004481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:48:10.630881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507467+0000","last_change":"2024-03-07T07:31:14.013078+0000","last_active":"2024-03-07T07:31:15.507467+0000","last_peered":"2024-03-07T07:31:15.507467+0000","last_clean":"2024-03-07T07:31:15.507467+0000","last_became_active":"2024-03-07T07:31:14.012816+0000","last_became_peered":"2024-03-07T07:31:14.012816+0000","last_unstale":"2024-03-07T07:31:15.507467+0000","last_undegraded":"2024-03-07T07:31:15.507467+0000","last_fullsized":"2024-03-07T07:31:15.507467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:01.505914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507560+0000","last_change":"2024-03-07T07:31:13.016042+0000","last_active":"2024-03-07T07:31:15.507560+0000","last_peered":"2024-03-07T07:31:15.507560+0000","last_clean":"2024-03-07T07:31:15.507560+0000","last_became_active":"2024-03-07T07:31:13.015749+0000","last_became_peered":"2024-03-07T07:31:13.015749+0000","last_unstale":"2024-03-07T07:31:15.507560+0000","last_undegraded":"2024-03-07T07:31:15.507560+0000","last_fullsized":"2024-03-07T07:31:15.507560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:37:21.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507367+0000","last_change":"2024-03-07T07:31:14.015090+0000","last_active":"2024-03-07T07:31:15.507367+0000","last_peered":"2024-03-07T07:31:15.507367+0000","last_clean":"2024-03-07T07:31:15.507367+0000","last_became_active":"2024-03-07T07:31:14.014806+0000","last_became_peered":"2024-03-07T07:31:14.014806+0000","last_unstale":"2024-03-07T07:31:15.507367+0000","last_undegraded":"2024-03-07T07:31:15.507367+0000","last_fullsized":"2024-03-07T07:31:15.507367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:54:43.856401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507597+0000","last_change":"2024-03-07T07:31:13.002882+0000","last_active":"2024-03-07T07:31:15.507597+0000","last_peered":"2024-03-07T07:31:15.507597+0000","last_clean":"2024-03-07T07:31:15.507597+0000","last_became_active":"2024-03-07T07:31:13.002570+0000","last_became_peered":"2024-03-07T07:31:13.002570+0000","last_unstale":"2024-03-07T07:31:15.507597+0000","last_undegraded":"2024-03-07T07:31:15.507597+0000","last_fullsized":"2024-03-07T07:31:15.507597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:45:09.754760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324540+0000","last_change":"2024-03-07T07:31:14.008276+0000","last_active":"2024-03-07T07:31:15.324540+0000","last_peered":"2024-03-07T07:31:15.324540+0000","last_clean":"2024-03-07T07:31:15.324540+0000","last_became_active":"2024-03-07T07:31:14.007776+0000","last_became_peered":"2024-03-07T07:31:14.007776+0000","last_unstale":"2024-03-07T07:31:15.324540+0000","last_undegraded":"2024-03-07T07:31:15.324540+0000","last_fullsized":"2024-03-07T07:31:15.324540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:31:10.904651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005322+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:31:15.005322+0000","last_peered":"2024-03-07T07:31:15.005322+0000","last_clean":"2024-03-07T07:31:15.005322+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:31:15.005322+0000","last_undegraded":"2024-03-07T07:31:15.005322+0000","last_fullsized":"2024-03-07T07:31:15.005322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324287+0000","last_change":"2024-03-07T07:31:13.008377+0000","last_active":"2024-03-07T07:31:15.324287+0000","last_peered":"2024-03-07T07:31:15.324287+0000","last_clean":"2024-03-07T07:31:15.324287+0000","last_became_active":"2024-03-07T07:31:13.007831+0000","last_became_peered":"2024-03-07T07:31:13.007831+0000","last_unstale":"2024-03-07T07:31:15.324287+0000","last_undegraded":"2024-03-07T07:31:15.324287+0000","last_fullsized":"2024-03-07T07:31:15.324287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:44:04.756437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004221+0000","last_change":"2024-03-07T07:31:14.011057+0000","last_active":"2024-03-07T07:31:15.004221+0000","last_peered":"2024-03-07T07:31:15.004221+0000","last_clean":"2024-03-07T07:31:15.004221+0000","last_became_active":"2024-03-07T07:31:14.008674+0000","last_became_peered":"2024-03-07T07:31:14.008674+0000","last_unstale":"2024-03-07T07:31:15.004221+0000","last_undegraded":"2024-03-07T07:31:15.004221+0000","last_fullsized":"2024-03-07T07:31:15.004221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:13:13.737562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324150+0000","last_change":"2024-03-07T07:31:13.008418+0000","last_active":"2024-03-07T07:31:15.324150+0000","last_peered":"2024-03-07T07:31:15.324150+0000","last_clean":"2024-03-07T07:31:15.324150+0000","last_became_active":"2024-03-07T07:31:13.008022+0000","last_became_peered":"2024-03-07T07:31:13.008022+0000","last_unstale":"2024-03-07T07:31:15.324150+0000","last_undegraded":"2024-03-07T07:31:15.324150+0000","last_fullsized":"2024-03-07T07:31:15.324150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506707+0000","last_change":"2024-03-07T07:31:14.021608+0000","last_active":"2024-03-07T07:31:15.506707+0000","last_peered":"2024-03-07T07:31:15.506707+0000","last_clean":"2024-03-07T07:31:15.506707+0000","last_became_active":"2024-03-07T07:31:14.021264+0000","last_became_peered":"2024-03-07T07:31:14.021264+0000","last_unstale":"2024-03-07T07:31:15.506707+0000","last_undegraded":"2024-03-07T07:31:15.506707+0000","last_fullsized":"2024-03-07T07:31:15.506707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:09.493361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506600+0000","last_change":"2024-03-07T07:31:13.012807+0000","last_active":"2024-03-07T07:31:15.506600+0000","last_peered":"2024-03-07T07:31:15.506600+0000","last_clean":"2024-03-07T07:31:15.506600+0000","last_became_active":"2024-03-07T07:31:13.011968+0000","last_became_peered":"2024-03-07T07:31:13.011968+0000","last_unstale":"2024-03-07T07:31:15.506600+0000","last_undegraded":"2024-03-07T07:31:15.506600+0000","last_fullsized":"2024-03-07T07:31:15.506600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:23.206739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507191+0000","last_change":"2024-03-07T07:31:14.013203+0000","last_active":"2024-03-07T07:31:15.507191+0000","last_peered":"2024-03-07T07:31:15.507191+0000","last_clean":"2024-03-07T07:31:15.507191+0000","last_became_active":"2024-03-07T07:31:14.012147+0000","last_became_peered":"2024-03-07T07:31:14.012147+0000","last_unstale":"2024-03-07T07:31:15.507191+0000","last_undegraded":"2024-03-07T07:31:15.507191+0000","last_fullsized":"2024-03-07T07:31:15.507191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:15:43.131978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324586+0000","last_change":"2024-03-07T07:31:13.004811+0000","last_active":"2024-03-07T07:31:15.324586+0000","last_peered":"2024-03-07T07:31:15.324586+0000","last_clean":"2024-03-07T07:31:15.324586+0000","last_became_active":"2024-03-07T07:31:13.001378+0000","last_became_peered":"2024-03-07T07:31:13.001378+0000","last_unstale":"2024-03-07T07:31:15.324586+0000","last_undegraded":"2024-03-07T07:31:15.324586+0000","last_fullsized":"2024-03-07T07:31:15.324586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:30:30.900538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507068+0000","last_change":"2024-03-07T07:31:14.001567+0000","last_active":"2024-03-07T07:31:15.507068+0000","last_peered":"2024-03-07T07:31:15.507068+0000","last_clean":"2024-03-07T07:31:15.507068+0000","last_became_active":"2024-03-07T07:31:14.001209+0000","last_became_peered":"2024-03-07T07:31:14.001209+0000","last_unstale":"2024-03-07T07:31:15.507068+0000","last_undegraded":"2024-03-07T07:31:15.507068+0000","last_fullsized":"2024-03-07T07:31:15.507068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:26.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507268+0000","last_change":"2024-03-07T07:31:13.009741+0000","last_active":"2024-03-07T07:31:15.507268+0000","last_peered":"2024-03-07T07:31:15.507268+0000","last_clean":"2024-03-07T07:31:15.507268+0000","last_became_active":"2024-03-07T07:31:13.009377+0000","last_became_peered":"2024-03-07T07:31:13.009377+0000","last_unstale":"2024-03-07T07:31:15.507268+0000","last_undegraded":"2024-03-07T07:31:15.507268+0000","last_fullsized":"2024-03-07T07:31:15.507268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:11:23.206739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004256+0000","last_change":"2024-03-07T07:31:14.029593+0000","last_active":"2024-03-07T07:31:15.004256+0000","last_peered":"2024-03-07T07:31:15.004256+0000","last_clean":"2024-03-07T07:31:15.004256+0000","last_became_active":"2024-03-07T07:31:14.029271+0000","last_became_peered":"2024-03-07T07:31:14.029271+0000","last_unstale":"2024-03-07T07:31:15.004256+0000","last_undegraded":"2024-03-07T07:31:15.004256+0000","last_fullsized":"2024-03-07T07:31:15.004256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324639+0000","last_change":"2024-03-07T07:31:12.999335+0000","last_active":"2024-03-07T07:31:15.324639+0000","last_peered":"2024-03-07T07:31:15.324639+0000","last_clean":"2024-03-07T07:31:15.324639+0000","last_became_active":"2024-03-07T07:31:12.998960+0000","last_became_peered":"2024-03-07T07:31:12.998960+0000","last_unstale":"2024-03-07T07:31:15.324639+0000","last_undegraded":"2024-03-07T07:31:15.324639+0000","last_fullsized":"2024-03-07T07:31:15.324639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:36.670727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507521+0000","last_change":"2024-03-07T07:31:14.023039+0000","last_active":"2024-03-07T07:31:15.507521+0000","last_peered":"2024-03-07T07:31:15.507521+0000","last_clean":"2024-03-07T07:31:15.507521+0000","last_became_active":"2024-03-07T07:31:14.022753+0000","last_became_peered":"2024-03-07T07:31:14.022753+0000","last_unstale":"2024-03-07T07:31:15.507521+0000","last_undegraded":"2024-03-07T07:31:15.507521+0000","last_fullsized":"2024-03-07T07:31:15.507521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:49:34.177805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004648+0000","last_change":"2024-03-07T07:31:13.004776+0000","last_active":"2024-03-07T07:31:15.004648+0000","last_peered":"2024-03-07T07:31:15.004648+0000","last_clean":"2024-03-07T07:31:15.004648+0000","last_became_active":"2024-03-07T07:31:13.004179+0000","last_became_peered":"2024-03-07T07:31:13.004179+0000","last_unstale":"2024-03-07T07:31:15.004648+0000","last_undegraded":"2024-03-07T07:31:15.004648+0000","last_fullsized":"2024-03-07T07:31:15.004648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:20:31.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004577+0000","last_change":"2024-03-07T07:31:14.018269+0000","last_active":"2024-03-07T07:31:15.004577+0000","last_peered":"2024-03-07T07:31:15.004577+0000","last_clean":"2024-03-07T07:31:15.004577+0000","last_became_active":"2024-03-07T07:31:14.017951+0000","last_became_peered":"2024-03-07T07:31:14.017951+0000","last_unstale":"2024-03-07T07:31:15.004577+0000","last_undegraded":"2024-03-07T07:31:15.004577+0000","last_fullsized":"2024-03-07T07:31:15.004577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:47.090004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324673+0000","last_change":"2024-03-07T07:31:13.014574+0000","last_active":"2024-03-07T07:31:15.324673+0000","last_peered":"2024-03-07T07:31:15.324673+0000","last_clean":"2024-03-07T07:31:15.324673+0000","last_became_active":"2024-03-07T07:31:13.014264+0000","last_became_peered":"2024-03-07T07:31:13.014264+0000","last_unstale":"2024-03-07T07:31:15.324673+0000","last_undegraded":"2024-03-07T07:31:15.324673+0000","last_fullsized":"2024-03-07T07:31:15.324673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:17:41.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004522+0000","last_change":"2024-03-07T07:31:14.013847+0000","last_active":"2024-03-07T07:31:15.004522+0000","last_peered":"2024-03-07T07:31:15.004522+0000","last_clean":"2024-03-07T07:31:15.004522+0000","last_became_active":"2024-03-07T07:31:14.013485+0000","last_became_peered":"2024-03-07T07:31:14.013485+0000","last_unstale":"2024-03-07T07:31:15.004522+0000","last_undegraded":"2024-03-07T07:31:15.004522+0000","last_fullsized":"2024-03-07T07:31:15.004522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:20:38.979357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506657+0000","last_change":"2024-03-07T07:31:13.010611+0000","last_active":"2024-03-07T07:31:15.506657+0000","last_peered":"2024-03-07T07:31:15.506657+0000","last_clean":"2024-03-07T07:31:15.506657+0000","last_became_active":"2024-03-07T07:31:13.005305+0000","last_became_peered":"2024-03-07T07:31:13.005305+0000","last_unstale":"2024-03-07T07:31:15.506657+0000","last_undegraded":"2024-03-07T07:31:15.506657+0000","last_fullsized":"2024-03-07T07:31:15.506657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:27:10.661050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324091+0000","last_change":"2024-03-07T07:31:14.021524+0000","last_active":"2024-03-07T07:31:15.324091+0000","last_peered":"2024-03-07T07:31:15.324091+0000","last_clean":"2024-03-07T07:31:15.324091+0000","last_became_active":"2024-03-07T07:31:14.021248+0000","last_became_peered":"2024-03-07T07:31:14.021248+0000","last_unstale":"2024-03-07T07:31:15.324091+0000","last_undegraded":"2024-03-07T07:31:15.324091+0000","last_fullsized":"2024-03-07T07:31:15.324091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:10:35.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004002+0000","last_change":"2024-03-07T07:31:13.002330+0000","last_active":"2024-03-07T07:31:15.004002+0000","last_peered":"2024-03-07T07:31:15.004002+0000","last_clean":"2024-03-07T07:31:15.004002+0000","last_became_active":"2024-03-07T07:31:13.002030+0000","last_became_peered":"2024-03-07T07:31:13.002030+0000","last_unstale":"2024-03-07T07:31:15.004002+0000","last_undegraded":"2024-03-07T07:31:15.004002+0000","last_fullsized":"2024-03-07T07:31:15.004002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:16:54.530906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.003974+0000","last_change":"2024-03-07T07:31:14.012840+0000","last_active":"2024-03-07T07:31:15.003974+0000","last_peered":"2024-03-07T07:31:15.003974+0000","last_clean":"2024-03-07T07:31:15.003974+0000","last_became_active":"2024-03-07T07:31:14.009043+0000","last_became_peered":"2024-03-07T07:31:14.009043+0000","last_unstale":"2024-03-07T07:31:15.003974+0000","last_undegraded":"2024-03-07T07:31:15.003974+0000","last_fullsized":"2024-03-07T07:31:15.003974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:17:16.143558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506843+0000","last_change":"2024-03-07T07:31:13.008737+0000","last_active":"2024-03-07T07:31:15.506843+0000","last_peered":"2024-03-07T07:31:15.506843+0000","last_clean":"2024-03-07T07:31:15.506843+0000","last_became_active":"2024-03-07T07:31:13.008485+0000","last_became_peered":"2024-03-07T07:31:13.008485+0000","last_unstale":"2024-03-07T07:31:15.506843+0000","last_undegraded":"2024-03-07T07:31:15.506843+0000","last_fullsized":"2024-03-07T07:31:15.506843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:33:34.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.506665+0000","last_change":"2024-03-07T07:31:14.012842+0000","last_active":"2024-03-07T07:31:15.506665+0000","last_peered":"2024-03-07T07:31:15.506665+0000","last_clean":"2024-03-07T07:31:15.506665+0000","last_became_active":"2024-03-07T07:31:14.012549+0000","last_became_peered":"2024-03-07T07:31:14.012549+0000","last_unstale":"2024-03-07T07:31:15.506665+0000","last_undegraded":"2024-03-07T07:31:15.506665+0000","last_fullsized":"2024-03-07T07:31:15.506665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:16.564825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324173+0000","last_change":"2024-03-07T07:31:13.008117+0000","last_active":"2024-03-07T07:31:15.324173+0000","last_peered":"2024-03-07T07:31:15.324173+0000","last_clean":"2024-03-07T07:31:15.324173+0000","last_became_active":"2024-03-07T07:31:13.006517+0000","last_became_peered":"2024-03-07T07:31:13.006517+0000","last_unstale":"2024-03-07T07:31:15.324173+0000","last_undegraded":"2024-03-07T07:31:15.324173+0000","last_fullsized":"2024-03-07T07:31:15.324173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:18:17.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324678+0000","last_change":"2024-03-07T07:31:14.011780+0000","last_active":"2024-03-07T07:31:15.324678+0000","last_peered":"2024-03-07T07:31:15.324678+0000","last_clean":"2024-03-07T07:31:15.324678+0000","last_became_active":"2024-03-07T07:31:14.011509+0000","last_became_peered":"2024-03-07T07:31:14.011509+0000","last_unstale":"2024-03-07T07:31:15.324678+0000","last_undegraded":"2024-03-07T07:31:15.324678+0000","last_fullsized":"2024-03-07T07:31:15.324678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:20:14.495243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.324463+0000","last_change":"2024-03-07T07:31:14.024307+0000","last_active":"2024-03-07T07:31:15.324463+0000","last_peered":"2024-03-07T07:31:15.324463+0000","last_clean":"2024-03-07T07:31:15.324463+0000","last_became_active":"2024-03-07T07:31:14.024003+0000","last_became_peered":"2024-03-07T07:31:14.024003+0000","last_unstale":"2024-03-07T07:31:15.324463+0000","last_undegraded":"2024-03-07T07:31:15.324463+0000","last_fullsized":"2024-03-07T07:31:15.324463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:15.163371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507245+0000","last_change":"2024-03-07T07:31:13.017220+0000","last_active":"2024-03-07T07:31:15.507245+0000","last_peered":"2024-03-07T07:31:15.507245+0000","last_clean":"2024-03-07T07:31:15.507245+0000","last_became_active":"2024-03-07T07:31:13.016766+0000","last_became_peered":"2024-03-07T07:31:13.016766+0000","last_unstale":"2024-03-07T07:31:15.507245+0000","last_undegraded":"2024-03-07T07:31:15.507245+0000","last_fullsized":"2024-03-07T07:31:15.507245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:15.557835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.005588+0000","last_change":"2024-03-07T07:31:14.008305+0000","last_active":"2024-03-07T07:31:15.005588+0000","last_peered":"2024-03-07T07:31:15.005588+0000","last_clean":"2024-03-07T07:31:15.005588+0000","last_became_active":"2024-03-07T07:31:14.006803+0000","last_became_peered":"2024-03-07T07:31:14.006803+0000","last_unstale":"2024-03-07T07:31:15.005588+0000","last_undegraded":"2024-03-07T07:31:15.005588+0000","last_fullsized":"2024-03-07T07:31:15.005588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:03:59.052342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507223+0000","last_change":"2024-03-07T07:31:13.016945+0000","last_active":"2024-03-07T07:31:15.507223+0000","last_peered":"2024-03-07T07:31:15.507223+0000","last_clean":"2024-03-07T07:31:15.507223+0000","last_became_active":"2024-03-07T07:31:13.016362+0000","last_became_peered":"2024-03-07T07:31:13.016362+0000","last_unstale":"2024-03-07T07:31:15.507223+0000","last_undegraded":"2024-03-07T07:31:15.507223+0000","last_fullsized":"2024-03-07T07:31:15.507223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:51:25.658376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507857+0000","last_change":"2024-03-07T07:31:14.015081+0000","last_active":"2024-03-07T07:31:15.507857+0000","last_peered":"2024-03-07T07:31:15.507857+0000","last_clean":"2024-03-07T07:31:15.507857+0000","last_became_active":"2024-03-07T07:31:14.014734+0000","last_became_peered":"2024-03-07T07:31:14.014734+0000","last_unstale":"2024-03-07T07:31:15.507857+0000","last_undegraded":"2024-03-07T07:31:15.507857+0000","last_fullsized":"2024-03-07T07:31:15.507857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:48:37.549473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507737+0000","last_change":"2024-03-07T07:31:13.011989+0000","last_active":"2024-03-07T07:31:15.507737+0000","last_peered":"2024-03-07T07:31:15.507737+0000","last_clean":"2024-03-07T07:31:15.507737+0000","last_became_active":"2024-03-07T07:31:13.011663+0000","last_became_peered":"2024-03-07T07:31:13.011663+0000","last_unstale":"2024-03-07T07:31:15.507737+0000","last_undegraded":"2024-03-07T07:31:15.507737+0000","last_fullsized":"2024-03-07T07:31:15.507737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:28:50.212787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.507644+0000","last_change":"2024-03-07T07:31:14.019436+0000","last_active":"2024-03-07T07:31:15.507644+0000","last_peered":"2024-03-07T07:31:15.507644+0000","last_clean":"2024-03-07T07:31:15.507644+0000","last_became_active":"2024-03-07T07:31:14.019144+0000","last_became_peered":"2024-03-07T07:31:14.019144+0000","last_unstale":"2024-03-07T07:31:15.507644+0000","last_undegraded":"2024-03-07T07:31:15.507644+0000","last_fullsized":"2024-03-07T07:31:15.507644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:12.974214+0000","last_clean_scrub_stamp":"2024-03-07T07:31:12.974214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:39:40.166016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-07T07:31:15.004520+0000","last_change":"2024-03-07T07:31:12.997330+0000","last_active":"2024-03-07T07:31:15.004520+0000","last_peered":"2024-03-07T07:31:15.004520+0000","last_clean":"2024-03-07T07:31:15.004520+0000","last_became_active":"2024-03-07T07:31:12.997026+0000","last_became_peered":"2024-03-07T07:31:12.997026+0000","last_unstale":"2024-03-07T07:31:15.004520+0000","last_undegraded":"2024-03-07T07:31:15.004520+0000","last_fullsized":"2024-03-07T07:31:15.004520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:31:11.967223+0000","last_clean_scrub_stamp":"2024-03-07T07:31:11.967223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:04:34.643046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":73109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":662965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":662987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:31:27.259 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-07T07:31:27.260 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-07T07:31:27.260 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-07T07:31:27.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-07T07:31:27.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b58200640 1 Processor -- start 2024-03-07T07:31:27.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b58200640 1 -- start start 2024-03-07T07:31:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b58200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b50147d10 0x7f9b500b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b58200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b50071600 0x7f9b500b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b58200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b500724f0 con 0x7f9b500b3a00 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b58200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b501480f0 con 0x7f9b50147d10 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b58200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b500b0f80 con 0x7f9b50071600 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b55800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b50147d10 0x7f9b500b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b55800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b50147d10 0x7f9b500b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50182/0 (socket says 172.21.15.84:50182) 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b54e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b50071600 0x7f9b500b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b55800640 1 -- 172.21.15.84:0/474704182 learned_addr learned my addr 172.21.15.84:0/474704182 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b56200640 1 --1- 172.21.15.84:0/474704182 >> v1:172.21.15.161:6789/0 conn(0x7f9b500b3a00 0x7f9b500aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41470/0 (socket says 172.21.15.84:41470) 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b4fe00640 1 -- 172.21.15.84:0/474704182 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445732529 0 0) 0x7f9b480014a0 con 0x7f9b500b3a00 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b55800640 1 -- 172.21.15.84:0/474704182 >> v2:172.21.15.161:3300/0 conn(0x7f9b50071600 msgr2=0x7f9b500b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b55800640 1 --2- 172.21.15.84:0/474704182 >> v2:172.21.15.161:3300/0 conn(0x7f9b50071600 0x7f9b500b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b55800640 1 -- 172.21.15.84:0/474704182 >> v1:172.21.15.161:6789/0 conn(0x7f9b500b3a00 legacy=0x7f9b500aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b55800640 1 -- 172.21.15.84:0/474704182 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b500732f0 con 0x7f9b50147d10 2024-03-07T07:31:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.426+0000 7f9b54e00640 1 --2- 172.21.15.84:0/474704182 >> v2:172.21.15.161:3300/0 conn(0x7f9b50071600 0x7f9b500b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:27.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b55800640 1 --2- 172.21.15.84:0/474704182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b50147d10 0x7f9b500b01c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9b500a02f0 tx=0x7f9b4401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b47d088227a8bc8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b4fe00640 1 -- 172.21.15.84:0/474704182 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b440b5070 con 0x7f9b50147d10 2024-03-07T07:31:27.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b4fe00640 1 -- 172.21.15.84:0/474704182 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b440a8a10 con 0x7f9b50147d10 2024-03-07T07:31:27.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b4fe00640 1 -- 172.21.15.84:0/474704182 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b440a8de0 con 0x7f9b50147d10 2024-03-07T07:31:27.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 -- 172.21.15.84:0/474704182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b50147d10 msgr2=0x7f9b500b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 --2- 172.21.15.84:0/474704182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b50147d10 0x7f9b500b01c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9b500a02f0 tx=0x7f9b4401ed10 comp rx=0 tx=0).stop 2024-03-07T07:31:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 -- 172.21.15.84:0/474704182 shutdown_connections 2024-03-07T07:31:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 --2- 172.21.15.84:0/474704182 >> v2:172.21.15.161:3300/0 conn(0x7f9b50071600 0x7f9b500b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 --2- 172.21.15.84:0/474704182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b50147d10 0x7f9b500b01c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 -- 172.21.15.84:0/474704182 >> 172.21.15.84:0/474704182 conn(0x7f9b500b1ed0 msgr2=0x7f9b500b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 -- 172.21.15.84:0/474704182 shutdown_connections 2024-03-07T07:31:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 -- 172.21.15.84:0/474704182 wait complete. 2024-03-07T07:31:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.430+0000 7f9b58200640 1 Processor -- start 2024-03-07T07:31:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 -- start start 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b50071600 0x7f9b5015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b500b3a00 0x7f9b50153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b50147d10 0x7f9b501541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b50072d30 con 0x7f9b500b3a00 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b50072a50 con 0x7f9b50147d10 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b50073010 con 0x7f9b50071600 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b500b3a00 0x7f9b50153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b56200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b50147d10 0x7f9b501541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b500b3a00 0x7f9b50153ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50196/0 (socket says 172.21.15.84:50196) 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 -- 172.21.15.84:0/3456188278 learned_addr learned my addr 172.21.15.84:0/3456188278 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b55800640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b50071600 0x7f9b5015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 -- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b50071600 msgr2=0x7f9b5015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b50071600 0x7f9b5015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 -- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b50147d10 msgr2=0x7f9b501541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b50147d10 0x7f9b501541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 -- 172.21.15.84:0/3456188278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50154ad0 con 0x7f9b500b3a00 2024-03-07T07:31:27.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b55800640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b50071600 0x7f9b5015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:27.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b56200640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b50147d10 0x7f9b501541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:27.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b54e00640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b500b3a00 0x7f9b50153ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00ebe0 tx=0x7f9b3c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b4d600640 1 -- 172.21.15.84:0/3456188278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c017070 con 0x7f9b500b3a00 2024-03-07T07:31:27.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b4d600640 1 -- 172.21.15.84:0/3456188278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c00cc30 con 0x7f9b500b3a00 2024-03-07T07:31:27.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b501527f0 con 0x7f9b500b3a00 2024-03-07T07:31:27.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b4d600640 1 -- 172.21.15.84:0/3456188278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c013470 con 0x7f9b500b3a00 2024-03-07T07:31:27.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b50153090 con 0x7f9b500b3a00 2024-03-07T07:31:27.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.434+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b50062d40 con 0x7f9b500b3a00 2024-03-07T07:31:27.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.438+0000 7f9b4d600640 1 -- 172.21.15.84:0/3456188278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f9b3c01a070 con 0x7f9b500b3a00 2024-03-07T07:31:27.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.438+0000 7f9b4d600640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9b30066f60 0x7f9b30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.438+0000 7f9b4d600640 1 -- 172.21.15.84:0/3456188278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b3c084fb0 con 0x7f9b500b3a00 2024-03-07T07:31:27.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.438+0000 7f9b55800640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9b30066f60 0x7f9b30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.438+0000 7f9b55800640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9b30066f60 0x7f9b30069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b440b2000 tx=0x7f9b44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.442+0000 7f9b4d600640 1 -- 172.21.15.84:0/3456188278 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f9b50154ad0 con 0x7f9b500b3a00 2024-03-07T07:31:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9b500d1b20 con 0x7f9b500b3a00 2024-03-07T07:31:27.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b4d600640 1 -- 172.21.15.84:0/3456188278 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9b3c0558d0 con 0x7f9b500b3a00 2024-03-07T07:31:27.633 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:27.633 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-07T07:31:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9b30066f60 msgr2=0x7f9b30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9b30066f60 0x7f9b30069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b440b2000 tx=0x7f9b44009040 comp rx=0 tx=0).stop 2024-03-07T07:31:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b500b3a00 msgr2=0x7f9b50153ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b500b3a00 0x7f9b50153ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00ebe0 tx=0x7f9b3c00c520 comp rx=0 tx=0).stop 2024-03-07T07:31:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 shutdown_connections 2024-03-07T07:31:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9b30066f60 0x7f9b30069420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b50147d10 0x7f9b501541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b500b3a00 0x7f9b50153ca0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 --2- 172.21.15.84:0/3456188278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b50071600 0x7f9b5015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 >> 172.21.15.84:0/3456188278 conn(0x7f9b500b1ed0 msgr2=0x7f9b500cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 shutdown_connections 2024-03-07T07:31:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.630+0000 7f9b58200640 1 -- 172.21.15.84:0/3456188278 wait complete. 2024-03-07T07:31:27.654 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-07T07:31:27.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:27.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140f800640 1 Processor -- start 2024-03-07T07:31:27.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140f800640 1 -- start start 2024-03-07T07:31:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140f800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f14080b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140f800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14080b0290 con 0x7f14080b3a00 2024-03-07T07:31:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140f800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14080b0570 con 0x7f14080cf100 2024-03-07T07:31:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140f800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080b1d40 con 0x7f140815c1f0 2024-03-07T07:31:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140ce00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f14080b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f1407e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f14080cf100 0x7f14080d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41482/0 (socket says 172.21.15.84:41482) 2024-03-07T07:31:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f1407e00640 1 -- 172.21.15.84:0/3361089406 learned_addr learned my addr 172.21.15.84:0/3361089406 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140d800640 1 --1- 172.21.15.84:0/3361089406 >> v1:172.21.15.84:6789/0 conn(0x7f14080b3a00 0x7f14080aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33744/0 (socket says 172.21.15.84:33744) 2024-03-07T07:31:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140ce00640 1 -- 172.21.15.84:0/3361089406 >> v1:172.21.15.161:6789/0 conn(0x7f14080cf100 legacy=0x7f14080d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140ce00640 1 -- 172.21.15.84:0/3361089406 >> v1:172.21.15.84:6789/0 conn(0x7f14080b3a00 legacy=0x7f14080aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f1407400640 1 -- 172.21.15.84:0/3361089406 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306848265 0 0) 0x7f14080b0570 con 0x7f14080cf100 2024-03-07T07:31:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.786+0000 7f140ce00640 1 -- 172.21.15.84:0/3361089406 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080b0850 con 0x7f140815c1f0 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f140ce00640 1 --2- 172.21.15.84:0/3361089406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f14080b1330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13f80097f0 tx=0x7f13f801c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba517a510d279ab8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f1407400640 1 -- 172.21.15.84:0/3361089406 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80b0070 con 0x7f140815c1f0 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f1407400640 1 -- 172.21.15.84:0/3361089406 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f80ab600 con 0x7f140815c1f0 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f1407400640 1 -- 172.21.15.84:0/3361089406 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80ab9d0 con 0x7f140815c1f0 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f140f800640 1 -- 172.21.15.84:0/3361089406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 msgr2=0x7f14080b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f140f800640 1 --2- 172.21.15.84:0/3361089406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f14080b1330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13f80097f0 tx=0x7f13f801c2e0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f140f800640 1 -- 172.21.15.84:0/3361089406 shutdown_connections 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f140f800640 1 --2- 172.21.15.84:0/3361089406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f14080b1330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f140f800640 1 -- 172.21.15.84:0/3361089406 >> 172.21.15.84:0/3361089406 conn(0x7f14080b1ed0 msgr2=0x7f14080b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f140f800640 1 -- 172.21.15.84:0/3361089406 shutdown_connections 2024-03-07T07:31:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.790+0000 7f140f800640 1 -- 172.21.15.84:0/3361089406 wait complete. 2024-03-07T07:31:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 Processor -- start 2024-03-07T07:31:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 -- start start 2024-03-07T07:31:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14080b3a00 0x7f140814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14080cf100 0x7f140814e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f140814c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080d1d70 con 0x7f14080cf100 2024-03-07T07:31:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080d1bf0 con 0x7f14080b3a00 2024-03-07T07:31:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080d1ef0 con 0x7f140815c1f0 2024-03-07T07:31:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14080cf100 0x7f140814e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14080cf100 0x7f140814e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50200/0 (socket says 172.21.15.84:50200) 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 -- 172.21.15.84:0/2395593846 learned_addr learned my addr 172.21.15.84:0/2395593846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140ce00640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14080b3a00 0x7f140814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140d800640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f140814c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 -- 172.21.15.84:0/2395593846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 msgr2=0x7f140814c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f140814c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 -- 172.21.15.84:0/2395593846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14080b3a00 msgr2=0x7f140814f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14080b3a00 0x7f140814f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 -- 172.21.15.84:0/2395593846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080cba30 con 0x7f14080cf100 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1407e00640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14080cf100 0x7f140814e670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13f000c4a0 tx=0x7f13f000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1404c00640 1 -- 172.21.15.84:0/2395593846 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f0018070 con 0x7f14080cf100 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1404c00640 1 -- 172.21.15.84:0/2395593846 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f00074e0 con 0x7f14080cf100 2024-03-07T07:31:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f1404c00640 1 -- 172.21.15.84:0/2395593846 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f0004a30 con 0x7f14080cf100 2024-03-07T07:31:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14080cbd10 con 0x7f14080cf100 2024-03-07T07:31:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14080cc2d0 con 0x7f14080cf100 2024-03-07T07:31:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.794+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408062d40 con 0x7f14080cf100 2024-03-07T07:31:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.798+0000 7f1404c00640 1 -- 172.21.15.84:0/2395593846 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f13f0004bd0 con 0x7f14080cf100 2024-03-07T07:31:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.798+0000 7f1404c00640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f13e4066f60 0x7f13e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.798+0000 7f1404c00640 1 -- 172.21.15.84:0/2395593846 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13f0084300 con 0x7f14080cf100 2024-03-07T07:31:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.798+0000 7f140ce00640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f13e4066f60 0x7f13e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.798+0000 7f140ce00640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f13e4066f60 0x7f13e4069420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f13f80ad000 tx=0x7f13f80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:27.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.802+0000 7f1404c00640 1 -- 172.21.15.84:0/2395593846 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f13f0054cb0 con 0x7f14080cf100 2024-03-07T07:31:27.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.958+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14080cfe50 con 0x7f14080cf100 2024-03-07T07:31:27.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.958+0000 7f1404c00640 1 -- 172.21.15.84:0/2395593846 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f13f0058d50 con 0x7f14080cf100 2024-03-07T07:31:27.963 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:27.964 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f13e4066f60 msgr2=0x7f13e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f13e4066f60 0x7f13e4069420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f13f80ad000 tx=0x7f13f80a6000 comp rx=0 tx=0).stop 2024-03-07T07:31:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14080cf100 msgr2=0x7f140814e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14080cf100 0x7f140814e670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13f000c4a0 tx=0x7f13f000c960 comp rx=0 tx=0).stop 2024-03-07T07:31:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 shutdown_connections 2024-03-07T07:31:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f13e4066f60 0x7f13e4069420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f140815c1f0 0x7f140814c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14080cf100 0x7f140814e670 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 --2- 172.21.15.84:0/2395593846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14080b3a00 0x7f140814f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 >> 172.21.15.84:0/2395593846 conn(0x7f14080b1ed0 msgr2=0x7f14080b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 shutdown_connections 2024-03-07T07:31:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:27.962+0000 7f140f800640 1 -- 172.21.15.84:0/2395593846 wait complete. 2024-03-07T07:31:27.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:27.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:28.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6b200640 1 Processor -- start 2024-03-07T07:31:28.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6b200640 1 -- start start 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c147780 0x7f3f6c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6b200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3f6c0b53a0 0x7f3f6c167c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6b200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c0d21a0 con 0x7f3f6c0d1970 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6b200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c0d2480 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0d2760 con 0x7f3f6c147780 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6a800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3f6c0b53a0 0x7f3f6c167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f69e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c147780 0x7f3f6c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6a800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3f6c0b53a0 0x7f3f6c167c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50202/0 (socket says 172.21.15.84:50202) 2024-03-07T07:31:28.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.118+0000 7f3f6a800640 1 -- 172.21.15.84:0/295174682 learned_addr learned my addr 172.21.15.84:0/295174682 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:28.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6a800640 1 -- 172.21.15.84:0/295174682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c147780 msgr2=0x7f3f6c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:28.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6a800640 1 --2- 172.21.15.84:0/295174682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c147780 0x7f3f6c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6a800640 1 -- 172.21.15.84:0/295174682 >> v1:172.21.15.161:6789/0 conn(0x7f3f6c0d1970 legacy=0x7f3f6c0b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6a800640 1 -- 172.21.15.84:0/295174682 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c0d2a40 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f68a00640 1 -- 172.21.15.84:0/295174682 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043883592 0 0) 0x7f3f6c0d21a0 con 0x7f3f6c0d1970 2024-03-07T07:31:28.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6a800640 1 --2- 172.21.15.84:0/295174682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c167c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009e50 tx=0x7f3f6401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f6825331f5e510 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f68a00640 1 -- 172.21.15.84:0/295174682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f640a5920 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f68a00640 1 -- 172.21.15.84:0/295174682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f640a5ac0 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f68a00640 1 -- 172.21.15.84:0/295174682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f640ad3f0 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6b200640 1 -- 172.21.15.84:0/295174682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 msgr2=0x7f3f6c167c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6b200640 1 --2- 172.21.15.84:0/295174682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c167c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009e50 tx=0x7f3f6401ca30 comp rx=0 tx=0).stop 2024-03-07T07:31:28.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6b200640 1 -- 172.21.15.84:0/295174682 shutdown_connections 2024-03-07T07:31:28.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6b200640 1 --2- 172.21.15.84:0/295174682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c167c60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6b200640 1 --2- 172.21.15.84:0/295174682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c147780 0x7f3f6c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6b200640 1 -- 172.21.15.84:0/295174682 >> 172.21.15.84:0/295174682 conn(0x7f3f6c070460 msgr2=0x7f3f6c070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6b200640 1 -- 172.21.15.84:0/295174682 shutdown_connections 2024-03-07T07:31:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.122+0000 7f3f6b200640 1 -- 172.21.15.84:0/295174682 wait complete. 2024-03-07T07:31:28.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 Processor -- start 2024-03-07T07:31:28.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 -- start start 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c1399e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c0d1970 0x7f3f6c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f6c147780 0x7f3f6c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c16ad50 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c16abd0 con 0x7f3f6c147780 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c16aed0 con 0x7f3f6c0d1970 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c1399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c1399e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50210/0 (socket says 172.21.15.84:50210) 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 -- 172.21.15.84:0/4119732339 learned_addr learned my addr 172.21.15.84:0/4119732339 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69400640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c0d1970 0x7f3f6c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6a800640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f6c147780 0x7f3f6c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 -- 172.21.15.84:0/4119732339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c0d1970 msgr2=0x7f3f6c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c0d1970 0x7f3f6c15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 -- 172.21.15.84:0/4119732339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f6c147780 msgr2=0x7f3f6c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f6c147780 0x7f3f6c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 -- 172.21.15.84:0/4119732339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c15cb00 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f69e00640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c1399e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00e870 tx=0x7f3f5c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f62000640 1 -- 172.21.15.84:0/4119732339 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c017070 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f62000640 1 -- 172.21.15.84:0/4119732339 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c00c940 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f62000640 1 -- 172.21.15.84:0/4119732339 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00ccf0 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c15cde0 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.126+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6c140ee0 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.130+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6c067b20 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.130+0000 7f3f62000640 1 -- 172.21.15.84:0/4119732339 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f3f5c01a070 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.130+0000 7f3f62000640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f4c066f60 0x7f3f4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.130+0000 7f3f62000640 1 -- 172.21.15.84:0/4119732339 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f5c085220 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.130+0000 7f3f69400640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f4c066f60 0x7f3f4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.130+0000 7f3f69400640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f4c066f60 0x7f3f4c069420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c144270 tx=0x7f3f58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.134+0000 7f3f62000640 1 -- 172.21.15.84:0/4119732339 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f3f5c055bd0 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.286+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f6c15be90 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f62000640 1 -- 172.21.15.84:0/4119732339 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f5c059c70 con 0x7f3f6c0b53a0 2024-03-07T07:31:28.293 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f4c066f60 msgr2=0x7f3f4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f4c066f60 0x7f3f4c069420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c144270 tx=0x7f3f58009040 comp rx=0 tx=0).stop 2024-03-07T07:31:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 msgr2=0x7f3f6c1399e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c1399e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00e870 tx=0x7f3f5c00ec70 comp rx=0 tx=0).stop 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 shutdown_connections 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f4c066f60 0x7f3f4c069420 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f6c147780 0x7f3f6c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f6c0d1970 0x7f3f6c15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 --2- 172.21.15.84:0/4119732339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f6c0b53a0 0x7f3f6c1399e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 >> 172.21.15.84:0/4119732339 conn(0x7f3f6c070460 msgr2=0x7f3f6c1469c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 shutdown_connections 2024-03-07T07:31:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.290+0000 7f3f6b200640 1 -- 172.21.15.84:0/4119732339 wait complete. 2024-03-07T07:31:28.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:28.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb510800640 1 Processor -- start 2024-03-07T07:31:28.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb510800640 1 -- start start 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb510800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb50815c3d0 0x7fb5080cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb510800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5080cd950 0x7fb5080724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb510800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5080b4a60 con 0x7fb508145090 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb510800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5080cddc0 con 0x7fb50815c3d0 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb510800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080b4d40 con 0x7fb5080cd950 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb50d400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb50815c3d0 0x7fb5080cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb50d400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb50815c3d0 0x7fb5080cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50222/0 (socket says 172.21.15.84:50222) 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb50d400640 1 -- 172.21.15.84:0/2834905821 learned_addr learned my addr 172.21.15.84:0/2834905821 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb50e800640 1 --2- 172.21.15.84:0/2834905821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5080cd950 0x7fb5080724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb50d400640 1 -- 172.21.15.84:0/2834905821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5080cd950 msgr2=0x7fb5080724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:28.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb50d400640 1 --2- 172.21.15.84:0/2834905821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5080cd950 0x7fb5080724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb50d400640 1 -- 172.21.15.84:0/2834905821 >> v1:172.21.15.161:6789/0 conn(0x7fb508145090 legacy=0x7fb5080cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.446+0000 7fb50d400640 1 -- 172.21.15.84:0/2834905821 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080719c0 con 0x7fb50815c3d0 2024-03-07T07:31:28.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb50d400640 1 --2- 172.21.15.84:0/2834905821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb50815c3d0 0x7fb5080cd410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009870 tx=0x7fb4f801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd5c7963af12804 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb50ca00640 1 -- 172.21.15.84:0/2834905821 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80a95f0 con 0x7fb50815c3d0 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb50ca00640 1 -- 172.21.15.84:0/2834905821 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80a9790 con 0x7fb50815c3d0 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb50ca00640 1 -- 172.21.15.84:0/2834905821 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80a9b60 con 0x7fb50815c3d0 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb510800640 1 -- 172.21.15.84:0/2834905821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb50815c3d0 msgr2=0x7fb5080cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb510800640 1 --2- 172.21.15.84:0/2834905821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb50815c3d0 0x7fb5080cd410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009870 tx=0x7fb4f801c530 comp rx=0 tx=0).stop 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb510800640 1 -- 172.21.15.84:0/2834905821 shutdown_connections 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb510800640 1 --2- 172.21.15.84:0/2834905821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5080cd950 0x7fb5080724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb510800640 1 --2- 172.21.15.84:0/2834905821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb50815c3d0 0x7fb5080cd410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb510800640 1 -- 172.21.15.84:0/2834905821 >> 172.21.15.84:0/2834905821 conn(0x7fb5080b1c50 msgr2=0x7fb5080b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb510800640 1 -- 172.21.15.84:0/2834905821 shutdown_connections 2024-03-07T07:31:28.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.450+0000 7fb510800640 1 -- 172.21.15.84:0/2834905821 wait complete. 2024-03-07T07:31:28.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 Processor -- start 2024-03-07T07:31:28.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 -- start start 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5080cd950 0x7fb50813c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb508145090 0x7fb508157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb50815c3d0 0x7fb508139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508145830 con 0x7fb508145090 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080b4710 con 0x7fb5080cd950 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081459b0 con 0x7fb50815c3d0 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb508145090 0x7fb508157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb508145090 0x7fb508157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50230/0 (socket says 172.21.15.84:50230) 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 -- 172.21.15.84:0/3727276267 learned_addr learned my addr 172.21.15.84:0/3727276267 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:28.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50e800640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb50815c3d0 0x7fb508139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50de00640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5080cd950 0x7fb50813c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 -- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb50815c3d0 msgr2=0x7fb508139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb50815c3d0 0x7fb508139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 -- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5080cd950 msgr2=0x7fb50813c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5080cd950 0x7fb50813c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 -- 172.21.15.84:0/3727276267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508158390 con 0x7fb508145090 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50de00640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5080cd950 0x7fb50813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb50d400640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb508145090 0x7fb508157cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4f801abe0 tx=0x7fb4f80192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb502000640 1 -- 172.21.15.84:0/3727276267 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80bf070 con 0x7fb508145090 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb502000640 1 -- 172.21.15.84:0/3727276267 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80ba410 con 0x7fb508145090 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb502000640 1 -- 172.21.15.84:0/3727276267 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80ba7e0 con 0x7fb508145090 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb508158670 con 0x7fb508145090 2024-03-07T07:31:28.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.454+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb508158c30 con 0x7fb508145090 2024-03-07T07:31:28.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.458+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb508062d40 con 0x7fb508145090 2024-03-07T07:31:28.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.458+0000 7fb502000640 1 -- 172.21.15.84:0/3727276267 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb4f80b13f0 con 0x7fb508145090 2024-03-07T07:31:28.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.458+0000 7fb502000640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb4ec066f60 0x7fb4ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.458+0000 7fb502000640 1 -- 172.21.15.84:0/3727276267 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4f811f0f0 con 0x7fb508145090 2024-03-07T07:31:28.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.458+0000 7fb50de00640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb4ec066f60 0x7fb4ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.458+0000 7fb50de00640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb4ec066f60 0x7fb4ec069420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc000f70 tx=0x7fb4fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.462+0000 7fb502000640 1 -- 172.21.15.84:0/3727276267 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb4f80ad020 con 0x7fb508145090 2024-03-07T07:31:28.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.614+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb508138e50 con 0x7fb508145090 2024-03-07T07:31:28.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb502000640 1 -- 172.21.15.84:0/3727276267 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4f8016150 con 0x7fb508145090 2024-03-07T07:31:28.621 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:28.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb4ec066f60 msgr2=0x7fb4ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb4ec066f60 0x7fb4ec069420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc000f70 tx=0x7fb4fc009040 comp rx=0 tx=0).stop 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb508145090 msgr2=0x7fb508157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb508145090 0x7fb508157cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4f801abe0 tx=0x7fb4f80192d0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 shutdown_connections 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb4ec066f60 0x7fb4ec069420 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb50815c3d0 0x7fb508139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb508145090 0x7fb508157cc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 --2- 172.21.15.84:0/3727276267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5080cd950 0x7fb50813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 >> 172.21.15.84:0/3727276267 conn(0x7fb5080b1c50 msgr2=0x7fb508142690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 shutdown_connections 2024-03-07T07:31:28.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.618+0000 7fb510800640 1 -- 172.21.15.84:0/3727276267 wait complete. 2024-03-07T07:31:28.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.774+0000 7f1f0e400640 1 Processor -- start 2024-03-07T07:31:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.774+0000 7f1f0e400640 1 -- start start 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f0e400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f0815df00 0x7f1f0806f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f0e400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f080b3df0 0x7f1f08070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f0e400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f080704b0 con 0x7f1f0815e2e0 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f0e400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080b45b0 con 0x7f1f080b3df0 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f0e400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080b4800 con 0x7f1f0815df00 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f080b3df0 0x7f1f08070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f080b3df0 0x7f1f08070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50238/0 (socket says 172.21.15.84:50238) 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07e00640 1 -- 172.21.15.84:0/4021640914 learned_addr learned my addr 172.21.15.84:0/4021640914 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07400640 1 --2- 172.21.15.84:0/4021640914 >> v2:172.21.15.161:3300/0 conn(0x7f1f0815df00 0x7f1f0806f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07e00640 1 -- 172.21.15.84:0/4021640914 >> v2:172.21.15.161:3300/0 conn(0x7f1f0815df00 msgr2=0x7f1f0806f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07e00640 1 --2- 172.21.15.84:0/4021640914 >> v2:172.21.15.161:3300/0 conn(0x7f1f0815df00 0x7f1f0806f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07e00640 1 -- 172.21.15.84:0/4021640914 >> v1:172.21.15.161:6789/0 conn(0x7f1f0815e2e0 legacy=0x7f1f080b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07e00640 1 -- 172.21.15.84:0/4021640914 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080b4ae0 con 0x7f1f080b3df0 2024-03-07T07:31:28.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f07e00640 1 --2- 172.21.15.84:0/4021640914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f080b3df0 0x7f1f08070990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f080ce290 tx=0x7f1f0001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbaa08e841ec691 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f06a00640 1 -- 172.21.15.84:0/4021640914 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f000a57a0 con 0x7f1f080b3df0 2024-03-07T07:31:28.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f06a00640 1 -- 172.21.15.84:0/4021640914 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f000a5940 con 0x7f1f080b3df0 2024-03-07T07:31:28.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.778+0000 7f1f06a00640 1 -- 172.21.15.84:0/4021640914 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f000a5d10 con 0x7f1f080b3df0 2024-03-07T07:31:28.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- 172.21.15.84:0/4021640914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f080b3df0 msgr2=0x7f1f08070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 --2- 172.21.15.84:0/4021640914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f080b3df0 0x7f1f08070990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f080ce290 tx=0x7f1f0001c9f0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- 172.21.15.84:0/4021640914 shutdown_connections 2024-03-07T07:31:28.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 --2- 172.21.15.84:0/4021640914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f080b3df0 0x7f1f08070990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 --2- 172.21.15.84:0/4021640914 >> v2:172.21.15.161:3300/0 conn(0x7f1f0815df00 0x7f1f0806f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- 172.21.15.84:0/4021640914 >> 172.21.15.84:0/4021640914 conn(0x7f1f080cd530 msgr2=0x7f1f080cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:28.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- 172.21.15.84:0/4021640914 shutdown_connections 2024-03-07T07:31:28.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- 172.21.15.84:0/4021640914 wait complete. 2024-03-07T07:31:28.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 Processor -- start 2024-03-07T07:31:28.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- start start 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f080b3df0 0x7f1f08157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f0815df00 0x7f1f08154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f0815e2e0 0x7f1f08155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08071a70 con 0x7f1f0815e2e0 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080718f0 con 0x7f1f0815df00 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f0e400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08071bf0 con 0x7f1f080b3df0 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f0815e2e0 0x7f1f08155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1effe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f0815df00 0x7f1f08154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f0815e2e0 0x7f1f08155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50250/0 (socket says 172.21.15.84:50250) 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07e00640 1 -- 172.21.15.84:0/2810802588 learned_addr learned my addr 172.21.15.84:0/2810802588 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f080b3df0 0x7f1f08157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07e00640 1 -- 172.21.15.84:0/2810802588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f080b3df0 msgr2=0x7f1f08157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07e00640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f080b3df0 0x7f1f08157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07e00640 1 -- 172.21.15.84:0/2810802588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f0815df00 msgr2=0x7f1f08154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07e00640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f0815df00 0x7f1f08154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.782+0000 7f1f07e00640 1 -- 172.21.15.84:0/2810802588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f081578d0 con 0x7f1f0815e2e0 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1f07e00640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f0815e2e0 0x7f1f08155470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1f000af040 tx=0x7f1f00019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1eff400640 1 -- 172.21.15.84:0/2810802588 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f000b8670 con 0x7f1f0815e2e0 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1eff400640 1 -- 172.21.15.84:0/2810802588 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f000be070 con 0x7f1f0815e2e0 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1eff400640 1 -- 172.21.15.84:0/2810802588 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f000b8a70 con 0x7f1f0815e2e0 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f08160860 con 0x7f1f0815e2e0 2024-03-07T07:31:28.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f08160e20 con 0x7f1f0815e2e0 2024-03-07T07:31:28.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f08062d40 con 0x7f1f0815e2e0 2024-03-07T07:31:28.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1eff400640 1 -- 172.21.15.84:0/2810802588 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f1f000b8c10 con 0x7f1f0815e2e0 2024-03-07T07:31:28.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1eff400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ee4066f60 0x7f1ee4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:28.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1eff400640 1 -- 172.21.15.84:0/2810802588 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f00120090 con 0x7f1f0815e2e0 2024-03-07T07:31:28.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1f07400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ee4066f60 0x7f1ee4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:28.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.786+0000 7f1f07400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ee4066f60 0x7f1ee4069420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009b60 tx=0x7f1ef8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:28.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.790+0000 7f1eff400640 1 -- 172.21.15.84:0/2810802588 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f1f000165e0 con 0x7f1f0815e2e0 2024-03-07T07:31:28.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f0815fab0 con 0x7f1f0815e2e0 2024-03-07T07:31:28.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1eff400640 1 -- 172.21.15.84:0/2810802588 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f000a5910 con 0x7f1f0815e2e0 2024-03-07T07:31:28.953 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:28.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ee4066f60 msgr2=0x7f1ee4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ee4066f60 0x7f1ee4069420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009b60 tx=0x7f1ef8009190 comp rx=0 tx=0).stop 2024-03-07T07:31:28.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f0815e2e0 msgr2=0x7f1f08155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:28.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f0815e2e0 0x7f1f08155470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1f000af040 tx=0x7f1f00019790 comp rx=0 tx=0).stop 2024-03-07T07:31:28.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 shutdown_connections 2024-03-07T07:31:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ee4066f60 0x7f1ee4069420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f0815e2e0 0x7f1f08155470 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f0815df00 0x7f1f08154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 --2- 172.21.15.84:0/2810802588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f080b3df0 0x7f1f08157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 >> 172.21.15.84:0/2810802588 conn(0x7f1f080cd530 msgr2=0x7f1f0815be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 shutdown_connections 2024-03-07T07:31:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:28.950+0000 7f1f0e400640 1 -- 172.21.15.84:0/2810802588 wait complete. 2024-03-07T07:31:28.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:29.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.106+0000 7f0c1a600640 1 Processor -- start 2024-03-07T07:31:29.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.106+0000 7f0c1a600640 1 -- start start 2024-03-07T07:31:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.106+0000 7f0c1a600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c14144360 0x7f0c140cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.106+0000 7f0c1a600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c140cc880 con 0x7f0c140730e0 2024-03-07T07:31:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.106+0000 7f0c1a600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c140ccb60 con 0x7f0c14143dd0 2024-03-07T07:31:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.106+0000 7f0c1a600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c141441b0 con 0x7f0c14144360 2024-03-07T07:31:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c13e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c14144360 0x7f0c140cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c13400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0c14143dd0 0x7f0c140729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41508/0 (socket says 172.21.15.84:41508) 2024-03-07T07:31:29.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c13400640 1 -- 172.21.15.84:0/1762070471 learned_addr learned my addr 172.21.15.84:0/1762070471 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:29.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c12a00640 1 -- 172.21.15.84:0/1762070471 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897036583 0 0) 0x7f0c140ccb60 con 0x7f0c14143dd0 2024-03-07T07:31:29.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c12a00640 1 -- 172.21.15.84:0/1762070471 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf8005740 con 0x7f0c14143dd0 2024-03-07T07:31:29.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c12a00640 1 -- 172.21.15.84:0/1762070471 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255736610 0 0) 0x7f0c140cc880 con 0x7f0c140730e0 2024-03-07T07:31:29.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c13e00640 1 -- 172.21.15.84:0/1762070471 >> v1:172.21.15.161:6789/0 conn(0x7f0c14143dd0 legacy=0x7f0c140729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c13e00640 1 -- 172.21.15.84:0/1762070471 >> v1:172.21.15.84:6789/0 conn(0x7f0c140730e0 legacy=0x7f0c1415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c13e00640 1 -- 172.21.15.84:0/1762070471 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c140cce40 con 0x7f0c14144360 2024-03-07T07:31:29.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c13e00640 1 --2- 172.21.15.84:0/1762070471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c140cdc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009d90 tx=0x7f0c0c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83deeea732ce00e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c12a00640 1 -- 172.21.15.84:0/1762070471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0b2070 con 0x7f0c14144360 2024-03-07T07:31:29.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c12a00640 1 -- 172.21.15.84:0/1762070471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c0a5950 con 0x7f0c14144360 2024-03-07T07:31:29.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.110+0000 7f0c12a00640 1 -- 172.21.15.84:0/1762070471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0a5d20 con 0x7f0c14144360 2024-03-07T07:31:29.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- 172.21.15.84:0/1762070471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 msgr2=0x7f0c140cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 --2- 172.21.15.84:0/1762070471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c140cdc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009d90 tx=0x7f0c0c01c970 comp rx=0 tx=0).stop 2024-03-07T07:31:29.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- 172.21.15.84:0/1762070471 shutdown_connections 2024-03-07T07:31:29.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 --2- 172.21.15.84:0/1762070471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c140cdc00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- 172.21.15.84:0/1762070471 >> 172.21.15.84:0/1762070471 conn(0x7f0c140704b0 msgr2=0x7f0c140708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:29.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- 172.21.15.84:0/1762070471 shutdown_connections 2024-03-07T07:31:29.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- 172.21.15.84:0/1762070471 wait complete. 2024-03-07T07:31:29.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 Processor -- start 2024-03-07T07:31:29.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- start start 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c140730e0 0x7f0c141f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c14143dd0 0x7f0c1415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c14141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1415bf30 con 0x7f0c14144360 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140cf050 con 0x7f0c140730e0 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c1a600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1415c0b0 con 0x7f0c14143dd0 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c14141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c14141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50274/0 (socket says 172.21.15.84:50274) 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13e00640 1 -- 172.21.15.84:0/3133389759 learned_addr learned my addr 172.21.15.84:0/3133389759 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13400640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c140730e0 0x7f0c141f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c0aa00640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c14143dd0 0x7f0c1415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13e00640 1 -- 172.21.15.84:0/3133389759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c14143dd0 msgr2=0x7f0c1415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13e00640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c14143dd0 0x7f0c1415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13e00640 1 -- 172.21.15.84:0/3133389759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c140730e0 msgr2=0x7f0c141f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13e00640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c140730e0 0x7f0c141f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.114+0000 7f0c13e00640 1 -- 172.21.15.84:0/3133389759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1415a6c0 con 0x7f0c14144360 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c13e00640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c14141230 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009d90 tx=0x7f0c0c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c0be00640 1 -- 172.21.15.84:0/3133389759 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0b2050 con 0x7f0c14144360 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c0be00640 1 -- 172.21.15.84:0/3133389759 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c0b3040 con 0x7f0c14144360 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c14159120 con 0x7f0c14144360 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c0be00640 1 -- 172.21.15.84:0/3133389759 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c003da0 con 0x7f0c14144360 2024-03-07T07:31:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c14136430 con 0x7f0c14144360 2024-03-07T07:31:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c14062d40 con 0x7f0c14144360 2024-03-07T07:31:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c0be00640 1 -- 172.21.15.84:0/3133389759 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f0c0c0a5810 con 0x7f0c14144360 2024-03-07T07:31:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c0be00640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bf0066f60 0x7f0bf0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c0be00640 1 -- 172.21.15.84:0/3133389759 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c0c11f9f0 con 0x7f0c14144360 2024-03-07T07:31:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c13400640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bf0066f60 0x7f0bf0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.118+0000 7f0c13400640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bf0066f60 0x7f0bf0069420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c04007fd0 tx=0x7f0c04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.122+0000 7f0c0be00640 1 -- 172.21.15.84:0/3133389759 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f0c0c016560 con 0x7f0c14144360 2024-03-07T07:31:29.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.310+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c14071280 con 0x7f0c14144360 2024-03-07T07:31:29.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.310+0000 7f0c0be00640 1 -- 172.21.15.84:0/3133389759 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4974 (secure 0 0 0) 0x7f0c0c0f04c0 con 0x7f0c14144360 2024-03-07T07:31:29.316 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:29.316 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:31:13.375093+0000","modified":"2024-03-07T07:31:16.379882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4315,"qdb_cluster":[4315]},"id":1}]} 2024-03-07T07:31:29.316 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-03-07T07:31:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bf0066f60 msgr2=0x7f0bf0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bf0066f60 0x7f0bf0069420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c04007fd0 tx=0x7f0c04009040 comp rx=0 tx=0).stop 2024-03-07T07:31:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 msgr2=0x7f0c14141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c14141230 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009d90 tx=0x7f0c0c019710 comp rx=0 tx=0).stop 2024-03-07T07:31:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 shutdown_connections 2024-03-07T07:31:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bf0066f60 0x7f0bf0069420 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c14144360 0x7f0c14141230 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c14143dd0 0x7f0c1415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 --2- 172.21.15.84:0/3133389759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c140730e0 0x7f0c141f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 >> 172.21.15.84:0/3133389759 conn(0x7f0c140704b0 msgr2=0x7f0c141428c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:29.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 shutdown_connections 2024-03-07T07:31:29.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.314+0000 7f0c1a600640 1 -- 172.21.15.84:0/3133389759 wait complete. 2024-03-07T07:31:29.336 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.466+0000 7f35eb000640 1 Processor -- start 2024-03-07T07:31:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.466+0000 7f35eb000640 1 -- start start 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35eb000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f35e4143dd0 0x7f35e40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35eb000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e40729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35eb000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e40cc880 con 0x7f35e41448b0 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35eb000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e41441b0 con 0x7f35e4143dd0 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35eb000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40cf050 con 0x7f35e4144360 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35e9000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f35e41448b0 0x7f35e415b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33776/0 (socket says 172.21.15.84:33776) 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35e9000640 1 -- 172.21.15.84:0/3773614404 learned_addr learned my addr 172.21.15.84:0/3773614404 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35e3e00640 1 --2- 172.21.15.84:0/3773614404 >> v2:172.21.15.161:3300/0 conn(0x7f35e4143dd0 0x7f35e40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35db400640 1 --2- 172.21.15.84:0/3773614404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e40729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35e3e00640 1 -- 172.21.15.84:0/3773614404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 msgr2=0x7f35e40729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35e3e00640 1 --2- 172.21.15.84:0/3773614404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e40729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35e3e00640 1 -- 172.21.15.84:0/3773614404 >> v1:172.21.15.84:6789/0 conn(0x7f35e41448b0 legacy=0x7f35e415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35e3e00640 1 -- 172.21.15.84:0/3773614404 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40ccb60 con 0x7f35e4143dd0 2024-03-07T07:31:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.470+0000 7f35e3400640 1 -- 172.21.15.84:0/3773614404 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500540757 0 0) 0x7f35e40cc880 con 0x7f35e41448b0 2024-03-07T07:31:29.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35e3e00640 1 --2- 172.21.15.84:0/3773614404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e4143dd0 0x7f35e40cdc00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35d40097f0 tx=0x7f35d401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72ed96fccd431f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35e3400640 1 -- 172.21.15.84:0/3773614404 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d40aa5f0 con 0x7f35e4143dd0 2024-03-07T07:31:29.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35e3400640 1 -- 172.21.15.84:0/3773614404 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d40af070 con 0x7f35e4143dd0 2024-03-07T07:31:29.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35e3400640 1 -- 172.21.15.84:0/3773614404 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d40aa9b0 con 0x7f35e4143dd0 2024-03-07T07:31:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 -- 172.21.15.84:0/3773614404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e4143dd0 msgr2=0x7f35e40cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 --2- 172.21.15.84:0/3773614404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e4143dd0 0x7f35e40cdc00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35d40097f0 tx=0x7f35d401c470 comp rx=0 tx=0).stop 2024-03-07T07:31:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 -- 172.21.15.84:0/3773614404 shutdown_connections 2024-03-07T07:31:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 --2- 172.21.15.84:0/3773614404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e40729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 --2- 172.21.15.84:0/3773614404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e4143dd0 0x7f35e40cdc00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 -- 172.21.15.84:0/3773614404 >> 172.21.15.84:0/3773614404 conn(0x7f35e40704b0 msgr2=0x7f35e40708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 -- 172.21.15.84:0/3773614404 shutdown_connections 2024-03-07T07:31:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 -- 172.21.15.84:0/3773614404 wait complete. 2024-03-07T07:31:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 Processor -- start 2024-03-07T07:31:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.474+0000 7f35eb000640 1 -- start start 2024-03-07T07:31:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35e4143dd0 0x7f35e4156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e4134400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e41448b0 0x7f35e40ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40cd6e0 con 0x7f35e4143dd0 2024-03-07T07:31:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e4073320 con 0x7f35e41448b0 2024-03-07T07:31:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e415bf30 con 0x7f35e4144360 2024-03-07T07:31:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35e4143dd0 0x7f35e4156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35e4143dd0 0x7f35e4156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50280/0 (socket says 172.21.15.84:50280) 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 -- 172.21.15.84:0/515736359 learned_addr learned my addr 172.21.15.84:0/515736359 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35db400640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e4134400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e9000640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e41448b0 0x7f35e40ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 -- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 msgr2=0x7f35e4134400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e4134400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 -- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e41448b0 msgr2=0x7f35e40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e41448b0 0x7f35e40ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 -- 172.21.15.84:0/515736359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4134940 con 0x7f35e4143dd0 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35db400640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e4134400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e3e00640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35e4143dd0 0x7f35e4156010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f35d40ac040 tx=0x7f35d401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e0c00640 1 -- 172.21.15.84:0/515736359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4006e20 con 0x7f35e4143dd0 2024-03-07T07:31:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e0c00640 1 -- 172.21.15.84:0/515736359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4004030 con 0x7f35e4143dd0 2024-03-07T07:31:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e0c00640 1 -- 172.21.15.84:0/515736359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d40043e0 con 0x7f35e4143dd0 2024-03-07T07:31:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e4138290 con 0x7f35e4143dd0 2024-03-07T07:31:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e413ae60 con 0x7f35e4143dd0 2024-03-07T07:31:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e4062d40 con 0x7f35e4143dd0 2024-03-07T07:31:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.478+0000 7f35e0c00640 1 -- 172.21.15.84:0/515736359 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f35d4003620 con 0x7f35e4143dd0 2024-03-07T07:31:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.482+0000 7f35e0c00640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35c0066f60 0x7f35c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.482+0000 7f35e0c00640 1 -- 172.21.15.84:0/515736359 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35d411f570 con 0x7f35e4143dd0 2024-03-07T07:31:29.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.482+0000 7f35db400640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35c0066f60 0x7f35c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.482+0000 7f35db400640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35c0066f60 0x7f35c0069420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35e413ac60 tx=0x7f35cc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.486+0000 7f35e0c00640 1 -- 172.21.15.84:0/515736359 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f35d4016090 con 0x7f35e4143dd0 2024-03-07T07:31:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.638+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35e415b1f0 con 0x7f35e4143dd0 2024-03-07T07:31:29.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35e0c00640 1 -- 172.21.15.84:0/515736359 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f35d40f00e0 con 0x7f35e4143dd0 2024-03-07T07:31:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:29.646 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35c0066f60 msgr2=0x7f35c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35c0066f60 0x7f35c0069420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35e413ac60 tx=0x7f35cc009190 comp rx=0 tx=0).stop 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35e4143dd0 msgr2=0x7f35e4156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35e4143dd0 0x7f35e4156010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f35d40ac040 tx=0x7f35d401acb0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 shutdown_connections 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35c0066f60 0x7f35c0069420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35e41448b0 0x7f35e40ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35e4144360 0x7f35e4134400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 --2- 172.21.15.84:0/515736359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35e4143dd0 0x7f35e4156010 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 >> 172.21.15.84:0/515736359 conn(0x7f35e40704b0 msgr2=0x7f35e40b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 shutdown_connections 2024-03-07T07:31:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.642+0000 7f35eb000640 1 -- 172.21.15.84:0/515736359 wait complete. 2024-03-07T07:31:29.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:29.666 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.798+0000 7f4ede400640 1 Processor -- start 2024-03-07T07:31:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.798+0000 7f4ede400640 1 -- start start 2024-03-07T07:31:29.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ede400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4ed80d0cf0 0x7f4ed806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ede400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed815c420 con 0x7f4ed806bb00 2024-03-07T07:31:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ede400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed80d1180 con 0x7f4ed81456c0 2024-03-07T07:31:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ede400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806bf30 con 0x7f4ed80d0cf0 2024-03-07T07:31:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ed7e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4ed80d0cf0 0x7f4ed806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4edda00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4ed806bb00 0x7f4ed80b5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33780/0 (socket says 172.21.15.84:33780) 2024-03-07T07:31:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4edda00640 1 -- 172.21.15.84:0/2427339006 learned_addr learned my addr 172.21.15.84:0/2427339006 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ed7e00640 1 -- 172.21.15.84:0/2427339006 >> v1:172.21.15.161:6789/0 conn(0x7f4ed81456c0 legacy=0x7f4ed80d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ed7e00640 1 -- 172.21.15.84:0/2427339006 >> v1:172.21.15.84:6789/0 conn(0x7f4ed806bb00 legacy=0x7f4ed80b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ed7e00640 1 -- 172.21.15.84:0/2427339006 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80d1460 con 0x7f4ed80d0cf0 2024-03-07T07:31:29.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.802+0000 7f4ed7e00640 1 --2- 172.21.15.84:0/2427339006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed80d0cf0 0x7f4ed806b5c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40097c0 tx=0x7f4ec401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10646c122089daf server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ed7400640 1 -- 172.21.15.84:0/2427339006 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40a7070 con 0x7f4ed80d0cf0 2024-03-07T07:31:29.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ed7400640 1 -- 172.21.15.84:0/2427339006 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40b0070 con 0x7f4ed80d0cf0 2024-03-07T07:31:29.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ed7400640 1 -- 172.21.15.84:0/2427339006 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40ab890 con 0x7f4ed80d0cf0 2024-03-07T07:31:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- 172.21.15.84:0/2427339006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed80d0cf0 msgr2=0x7f4ed806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 --2- 172.21.15.84:0/2427339006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed80d0cf0 0x7f4ed806b5c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40097c0 tx=0x7f4ec401c470 comp rx=0 tx=0).stop 2024-03-07T07:31:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- 172.21.15.84:0/2427339006 shutdown_connections 2024-03-07T07:31:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 --2- 172.21.15.84:0/2427339006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed80d0cf0 0x7f4ed806b5c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- 172.21.15.84:0/2427339006 >> 172.21.15.84:0/2427339006 conn(0x7f4ed80b3840 msgr2=0x7f4ed80b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- 172.21.15.84:0/2427339006 shutdown_connections 2024-03-07T07:31:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- 172.21.15.84:0/2427339006 wait complete. 2024-03-07T07:31:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 Processor -- start 2024-03-07T07:31:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- start start 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed806bb00 0x7f4ed80a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ed81456c0 0x7f4ed80aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed813ea50 0x7f4ed81fe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8145aa0 con 0x7f4ed806bb00 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806cbd0 con 0x7f4ed813ea50 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ede400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8145c20 con 0x7f4ed81456c0 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4edd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed806bb00 0x7f4ed80a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4edd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed806bb00 0x7f4ed80a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50300/0 (socket says 172.21.15.84:50300) 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4edd000640 1 -- 172.21.15.84:0/2564076252 learned_addr learned my addr 172.21.15.84:0/2564076252 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4edda00640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed813ea50 0x7f4ed81fe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.806+0000 7f4ed7e00640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ed81456c0 0x7f4ed80aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4edd000640 1 -- 172.21.15.84:0/2564076252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ed81456c0 msgr2=0x7f4ed80aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4edd000640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ed81456c0 0x7f4ed80aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4edd000640 1 -- 172.21.15.84:0/2564076252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed813ea50 msgr2=0x7f4ed81fe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4edd000640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed813ea50 0x7f4ed81fe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4edd000640 1 -- 172.21.15.84:0/2564076252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8164ee0 con 0x7f4ed806bb00 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4edd000640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed806bb00 0x7f4ed80a9e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c370 tx=0x7f4ecc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ed4c00640 1 -- 172.21.15.84:0/2564076252 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0052d0 con 0x7f4ed806bb00 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ed4c00640 1 -- 172.21.15.84:0/2564076252 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc005470 con 0x7f4ed806bb00 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed8165150 con 0x7f4ed806bb00 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ed4c00640 1 -- 172.21.15.84:0/2564076252 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc007260 con 0x7f4ed806bb00 2024-03-07T07:31:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed8165710 con 0x7f4ed806bb00 2024-03-07T07:31:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed8165b50 con 0x7f4ed806bb00 2024-03-07T07:31:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ed4c00640 1 -- 172.21.15.84:0/2564076252 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f4ecc007400 con 0x7f4ed806bb00 2024-03-07T07:31:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ed4c00640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4eb8066f60 0x7f4eb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ed4c00640 1 -- 172.21.15.84:0/2564076252 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ecc0844b0 con 0x7f4ed806bb00 2024-03-07T07:31:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.810+0000 7f4ed7e00640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4eb8066f60 0x7f4eb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.814+0000 7f4ed7e00640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4eb8066f60 0x7f4eb8069420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40af000 tx=0x7f4ec40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:29.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.814+0000 7f4ed4c00640 1 -- 172.21.15.84:0/2564076252 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f4ecc054dd0 con 0x7f4ed806bb00 2024-03-07T07:31:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.970+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ed8062d40 con 0x7f4ed806bb00 2024-03-07T07:31:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.970+0000 7f4ed4c00640 1 -- 172.21.15.84:0/2564076252 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ecc058e70 con 0x7f4ed806bb00 2024-03-07T07:31:29.975 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4eb8066f60 msgr2=0x7f4eb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4eb8066f60 0x7f4eb8069420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40af000 tx=0x7f4ec40a7000 comp rx=0 tx=0).stop 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed806bb00 msgr2=0x7f4ed80a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed806bb00 0x7f4ed80a9e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c370 tx=0x7f4ecc00c830 comp rx=0 tx=0).stop 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 shutdown_connections 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4eb8066f60 0x7f4eb8069420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed813ea50 0x7f4ed81fe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ed81456c0 0x7f4ed80aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 --2- 172.21.15.84:0/2564076252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ed806bb00 0x7f4ed80a9e00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 >> 172.21.15.84:0/2564076252 conn(0x7f4ed80b3840 msgr2=0x7f4ed80729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 shutdown_connections 2024-03-07T07:31:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:29.974+0000 7f4ede400640 1 -- 172.21.15.84:0/2564076252 wait complete. 2024-03-07T07:31:29.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:30.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.134+0000 7f9e43e00640 1 Processor -- start 2024-03-07T07:31:30.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.134+0000 7f9e43e00640 1 -- start start 2024-03-07T07:31:30.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.134+0000 7f9e43e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e440af9e0 0x7f9e440aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.134+0000 7f9e43e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9e440b2f80 0x7f9e44070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.134+0000 7f9e43e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e441627c0 con 0x7f9e4415de30 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.134+0000 7f9e43e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4415e730 con 0x7f9e440af9e0 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.134+0000 7f9e43e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4415ea10 con 0x7f9e440b2f80 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e42000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e440af9e0 0x7f9e440aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e42a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9e4415de30 0x7f9e440af2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41518/0 (socket says 172.21.15.84:41518) 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e42a00640 1 -- 172.21.15.84:0/149779884 learned_addr learned my addr 172.21.15.84:0/149779884 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e43400640 1 --2- 172.21.15.84:0/149779884 >> v2:172.21.15.161:3300/0 conn(0x7f9e440b2f80 0x7f9e44070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e42000640 1 -- 172.21.15.84:0/149779884 >> v2:172.21.15.161:3300/0 conn(0x7f9e440b2f80 msgr2=0x7f9e44070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e42000640 1 --2- 172.21.15.84:0/149779884 >> v2:172.21.15.161:3300/0 conn(0x7f9e440b2f80 0x7f9e44070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e41600640 1 -- 172.21.15.84:0/149779884 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581343694 0 0) 0x7f9e441627c0 con 0x7f9e4415de30 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e42000640 1 -- 172.21.15.84:0/149779884 >> v1:172.21.15.161:6789/0 conn(0x7f9e4415de30 legacy=0x7f9e440af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e42000640 1 -- 172.21.15.84:0/149779884 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4415ecf0 con 0x7f9e440af9e0 2024-03-07T07:31:30.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e42000640 1 --2- 172.21.15.84:0/149779884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e440af9e0 0x7f9e440aed00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9e440b3ed0 tx=0x7f9e3001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8451f872328f5f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e41600640 1 -- 172.21.15.84:0/149779884 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300b0070 con 0x7f9e440af9e0 2024-03-07T07:31:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e41600640 1 -- 172.21.15.84:0/149779884 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e300ab600 con 0x7f9e440af9e0 2024-03-07T07:31:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e41600640 1 -- 172.21.15.84:0/149779884 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300ab9d0 con 0x7f9e440af9e0 2024-03-07T07:31:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.138+0000 7f9e43e00640 1 -- 172.21.15.84:0/149779884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e440af9e0 msgr2=0x7f9e440aed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 --2- 172.21.15.84:0/149779884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e440af9e0 0x7f9e440aed00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9e440b3ed0 tx=0x7f9e3001c3f0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- 172.21.15.84:0/149779884 shutdown_connections 2024-03-07T07:31:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 --2- 172.21.15.84:0/149779884 >> v2:172.21.15.161:3300/0 conn(0x7f9e440b2f80 0x7f9e44070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 --2- 172.21.15.84:0/149779884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e440af9e0 0x7f9e440aed00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- 172.21.15.84:0/149779884 >> 172.21.15.84:0/149779884 conn(0x7f9e44073070 msgr2=0x7f9e440b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- 172.21.15.84:0/149779884 shutdown_connections 2024-03-07T07:31:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- 172.21.15.84:0/149779884 wait complete. 2024-03-07T07:31:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 Processor -- start 2024-03-07T07:31:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- start start 2024-03-07T07:31:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e440af9e0 0x7f9e4414c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e440b2f80 0x7f9e4415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e4415de30 0x7f9e44153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4416ad70 con 0x7f9e4415de30 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440713c0 con 0x7f9e440b2f80 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4416aef0 con 0x7f9e440af9e0 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e4415de30 0x7f9e44153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e4415de30 0x7f9e44153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50324/0 (socket says 172.21.15.84:50324) 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 -- 172.21.15.84:0/2346385904 learned_addr learned my addr 172.21.15.84:0/2346385904 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e42000640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e440b2f80 0x7f9e4415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e42a00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e440af9e0 0x7f9e4414c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 -- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e440af9e0 msgr2=0x7f9e4414c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e440af9e0 0x7f9e4414c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 -- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e440b2f80 msgr2=0x7f9e4415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e440b2f80 0x7f9e4415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 -- 172.21.15.84:0/2346385904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4415d200 con 0x7f9e4415de30 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e42000640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e440b2f80 0x7f9e4415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43400640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e4415de30 0x7f9e44153020 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00ef90 tx=0x7f9e3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e3aa00640 1 -- 172.21.15.84:0/2346385904 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c018020 con 0x7f9e4415de30 2024-03-07T07:31:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e3aa00640 1 -- 172.21.15.84:0/2346385904 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c014480 con 0x7f9e4415de30 2024-03-07T07:31:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4415d4e0 con 0x7f9e4415de30 2024-03-07T07:31:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.142+0000 7f9e3aa00640 1 -- 172.21.15.84:0/2346385904 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c014870 con 0x7f9e4415de30 2024-03-07T07:31:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.146+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4414dc90 con 0x7f9e4415de30 2024-03-07T07:31:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.146+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e44062d40 con 0x7f9e4415de30 2024-03-07T07:31:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.146+0000 7f9e3aa00640 1 -- 172.21.15.84:0/2346385904 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f9e3c01b020 con 0x7f9e4415de30 2024-03-07T07:31:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.146+0000 7f9e3aa00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9e24066f60 0x7f9e24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.146+0000 7f9e3aa00640 1 -- 172.21.15.84:0/2346385904 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e3c085eb0 con 0x7f9e4415de30 2024-03-07T07:31:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.146+0000 7f9e42a00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9e24066f60 0x7f9e24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.146+0000 7f9e42a00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9e24066f60 0x7f9e24069420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000f70 tx=0x7f9e34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.150+0000 7f9e3aa00640 1 -- 172.21.15.84:0/2346385904 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f9e3c022030 con 0x7f9e4415de30 2024-03-07T07:31:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e4406f060 con 0x7f9e4415de30 2024-03-07T07:31:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e3aa00640 1 -- 172.21.15.84:0/2346385904 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e3c010040 con 0x7f9e4415de30 2024-03-07T07:31:30.310 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:30.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9e24066f60 msgr2=0x7f9e24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9e24066f60 0x7f9e24069420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000f70 tx=0x7f9e34009040 comp rx=0 tx=0).stop 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e4415de30 msgr2=0x7f9e44153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e4415de30 0x7f9e44153020 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00ef90 tx=0x7f9e3c00c490 comp rx=0 tx=0).stop 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 shutdown_connections 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9e24066f60 0x7f9e24069420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e4415de30 0x7f9e44153020 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e440b2f80 0x7f9e4415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 --2- 172.21.15.84:0/2346385904 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e440af9e0 0x7f9e4414c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.306+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 >> 172.21.15.84:0/2346385904 conn(0x7f9e44073070 msgr2=0x7f9e4415f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.310+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 shutdown_connections 2024-03-07T07:31:30.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.310+0000 7f9e43e00640 1 -- 172.21.15.84:0/2346385904 wait complete. 2024-03-07T07:31:30.330 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.462+0000 7f86d9a00640 1 Processor -- start 2024-03-07T07:31:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.462+0000 7f86d9a00640 1 -- start start 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d9a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f86d4145760 0x7f86d4160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d9a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86d406b5c0 0x7f86d406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d9a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d4160960 con 0x7f86d406caf0 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d9a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d4145b40 con 0x7f86d406b5c0 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d9a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d40b6170 con 0x7f86d4145760 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86cb400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86d406b5c0 0x7f86d406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d9000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86d406caf0 0x7f86d406cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33786/0 (socket says 172.21.15.84:33786) 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d9000640 1 -- 172.21.15.84:0/1222378313 learned_addr learned my addr 172.21.15.84:0/1222378313 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:30.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d3e00640 1 --2- 172.21.15.84:0/1222378313 >> v2:172.21.15.161:3300/0 conn(0x7f86d4145760 0x7f86d4160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86cb400640 1 -- 172.21.15.84:0/1222378313 >> v2:172.21.15.161:3300/0 conn(0x7f86d4145760 msgr2=0x7f86d4160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:30.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86cb400640 1 --2- 172.21.15.84:0/1222378313 >> v2:172.21.15.161:3300/0 conn(0x7f86d4145760 0x7f86d4160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86cb400640 1 -- 172.21.15.84:0/1222378313 >> v1:172.21.15.84:6789/0 conn(0x7f86d406caf0 legacy=0x7f86d406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86cb400640 1 -- 172.21.15.84:0/1222378313 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40b5560 con 0x7f86d406b5c0 2024-03-07T07:31:30.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d3400640 1 -- 172.21.15.84:0/1222378313 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715706350 0 0) 0x7f86d4160960 con 0x7f86d406caf0 2024-03-07T07:31:30.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86cb400640 1 --2- 172.21.15.84:0/1222378313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406b5c0 0x7f86d406ba50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86d406c1c0 tx=0x7f86bc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a786a54855ad48 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.466+0000 7f86d3400640 1 -- 172.21.15.84:0/1222378313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b0070 con 0x7f86d406b5c0 2024-03-07T07:31:30.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d3400640 1 -- 172.21.15.84:0/1222378313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0ab600 con 0x7f86d406b5c0 2024-03-07T07:31:30.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d3400640 1 -- 172.21.15.84:0/1222378313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0ab9d0 con 0x7f86d406b5c0 2024-03-07T07:31:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- 172.21.15.84:0/1222378313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406b5c0 msgr2=0x7f86d406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 --2- 172.21.15.84:0/1222378313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406b5c0 0x7f86d406ba50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86d406c1c0 tx=0x7f86bc01c3f0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- 172.21.15.84:0/1222378313 shutdown_connections 2024-03-07T07:31:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 --2- 172.21.15.84:0/1222378313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406b5c0 0x7f86d406ba50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 --2- 172.21.15.84:0/1222378313 >> v2:172.21.15.161:3300/0 conn(0x7f86d4145760 0x7f86d4160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- 172.21.15.84:0/1222378313 >> 172.21.15.84:0/1222378313 conn(0x7f86d40b3920 msgr2=0x7f86d40b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- 172.21.15.84:0/1222378313 shutdown_connections 2024-03-07T07:31:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- 172.21.15.84:0/1222378313 wait complete. 2024-03-07T07:31:30.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 Processor -- start 2024-03-07T07:31:30.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- start start 2024-03-07T07:31:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d406b5c0 0x7f86d415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406caf0 0x7f86d40728b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86d4145760 0x7f86d4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40b4e10 con 0x7f86d406caf0 2024-03-07T07:31:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40b51f0 con 0x7f86d4145760 2024-03-07T07:31:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40b4f90 con 0x7f86d406b5c0 2024-03-07T07:31:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86cb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406caf0 0x7f86d40728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86cb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406caf0 0x7f86d40728b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50350/0 (socket says 172.21.15.84:50350) 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86cb400640 1 -- 172.21.15.84:0/988082282 learned_addr learned my addr 172.21.15.84:0/988082282 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d3e00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d406b5c0 0x7f86d415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.470+0000 7f86d9000640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86d4145760 0x7f86d4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86cb400640 1 -- 172.21.15.84:0/988082282 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d406b5c0 msgr2=0x7f86d415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86cb400640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d406b5c0 0x7f86d415aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86cb400640 1 -- 172.21.15.84:0/988082282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86d4145760 msgr2=0x7f86d4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86cb400640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86d4145760 0x7f86d4071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86cb400640 1 -- 172.21.15.84:0/988082282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4144080 con 0x7f86d406caf0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86cb400640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406caf0 0x7f86d40728b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ae040 tx=0x7f86bc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d0c00640 1 -- 172.21.15.84:0/988082282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b0050 con 0x7f86d406caf0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d0c00640 1 -- 172.21.15.84:0/988082282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0bc070 con 0x7f86d406caf0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d4072fb0 con 0x7f86d406caf0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d0c00640 1 -- 172.21.15.84:0/988082282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc006e20 con 0x7f86d406caf0 2024-03-07T07:31:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d40716a0 con 0x7f86d406caf0 2024-03-07T07:31:30.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d4062d40 con 0x7f86d406caf0 2024-03-07T07:31:30.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d0c00640 1 -- 172.21.15.84:0/988082282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f86bc0b5850 con 0x7f86d406caf0 2024-03-07T07:31:30.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d0c00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f86b0066f60 0x7f86b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d0c00640 1 -- 172.21.15.84:0/988082282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86bc11f5b0 con 0x7f86d406caf0 2024-03-07T07:31:30.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.474+0000 7f86d3e00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f86b0066f60 0x7f86b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.478+0000 7f86d3e00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f86b0066f60 0x7f86b0069420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86c40113e0 tx=0x7f86c400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.478+0000 7f86d0c00640 1 -- 172.21.15.84:0/988082282 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f86bc016070 con 0x7f86d406caf0 2024-03-07T07:31:30.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.630+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86d406c230 con 0x7f86d406caf0 2024-03-07T07:31:30.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d0c00640 1 -- 172.21.15.84:0/988082282 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86bc0eff70 con 0x7f86d406caf0 2024-03-07T07:31:30.637 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:30.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f86b0066f60 msgr2=0x7f86b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f86b0066f60 0x7f86b0069420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86c40113e0 tx=0x7f86c400b040 comp rx=0 tx=0).stop 2024-03-07T07:31:30.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406caf0 msgr2=0x7f86d40728b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406caf0 0x7f86d40728b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ae040 tx=0x7f86bc01ac30 comp rx=0 tx=0).stop 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 shutdown_connections 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f86b0066f60 0x7f86b0069420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86d4145760 0x7f86d4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d406caf0 0x7f86d40728b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 --2- 172.21.15.84:0/988082282 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d406b5c0 0x7f86d415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 >> 172.21.15.84:0/988082282 conn(0x7f86d40b3920 msgr2=0x7f86d413b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 shutdown_connections 2024-03-07T07:31:30.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.634+0000 7f86d9a00640 1 -- 172.21.15.84:0/988082282 wait complete. 2024-03-07T07:31:30.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.786+0000 7f1f37e00640 1 Processor -- start 2024-03-07T07:31:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f37e00640 1 -- start start 2024-03-07T07:31:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f37e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f37e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f380d19e0 0x7f1f3806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f37e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3815e630 con 0x7f1f3806ba40 2024-03-07T07:31:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f37e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3815e3f0 con 0x7f1f380d19e0 2024-03-07T07:31:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f37e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3815f240 con 0x7f1f38140e30 2024-03-07T07:31:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f36a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f37400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f380d19e0 0x7f1f3806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f36a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38072f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:46456/0 (socket says 172.21.15.84:46456) 2024-03-07T07:31:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f36a00640 1 -- 172.21.15.84:0/3815885615 learned_addr learned my addr 172.21.15.84:0/3815885615 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f36000640 1 --1- 172.21.15.84:0/3815885615 >> v1:172.21.15.161:6789/0 conn(0x7f1f3806ba40 0x7f1f38071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41532/0 (socket says 172.21.15.84:41532) 2024-03-07T07:31:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f36a00640 1 -- 172.21.15.84:0/3815885615 >> v2:172.21.15.161:3300/0 conn(0x7f1f380d19e0 msgr2=0x7f1f3806bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f36a00640 1 --2- 172.21.15.84:0/3815885615 >> v2:172.21.15.161:3300/0 conn(0x7f1f380d19e0 0x7f1f3806bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f36a00640 1 -- 172.21.15.84:0/3815885615 >> v1:172.21.15.161:6789/0 conn(0x7f1f3806ba40 legacy=0x7f1f38071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.790+0000 7f1f36a00640 1 -- 172.21.15.84:0/3815885615 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3815e910 con 0x7f1f38140e30 2024-03-07T07:31:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f36a00640 1 --2- 172.21.15.84:0/3815885615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38072f00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009e50 tx=0x7f1f2801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23e400958c3553d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f35600640 1 -- 172.21.15.84:0/3815885615 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f280a5610 con 0x7f1f38140e30 2024-03-07T07:31:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f35600640 1 -- 172.21.15.84:0/3815885615 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f280a57b0 con 0x7f1f38140e30 2024-03-07T07:31:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f35600640 1 -- 172.21.15.84:0/3815885615 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f280a5b80 con 0x7f1f38140e30 2024-03-07T07:31:30.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 -- 172.21.15.84:0/3815885615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 msgr2=0x7f1f38072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3815885615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38072f00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009e50 tx=0x7f1f2801ca30 comp rx=0 tx=0).stop 2024-03-07T07:31:30.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 -- 172.21.15.84:0/3815885615 shutdown_connections 2024-03-07T07:31:30.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3815885615 >> v2:172.21.15.161:3300/0 conn(0x7f1f380d19e0 0x7f1f3806bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3815885615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38072f00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 -- 172.21.15.84:0/3815885615 >> 172.21.15.84:0/3815885615 conn(0x7f1f3806f2b0 msgr2=0x7f1f3806f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 -- 172.21.15.84:0/3815885615 shutdown_connections 2024-03-07T07:31:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 -- 172.21.15.84:0/3815885615 wait complete. 2024-03-07T07:31:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 Processor -- start 2024-03-07T07:31:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.794+0000 7f1f37e00640 1 -- start start 2024-03-07T07:31:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f3806ba40 0x7f1f380b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f380d19e0 0x7f1f38139d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380b16c0 con 0x7f1f380d19e0 2024-03-07T07:31:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380b1540 con 0x7f1f3806ba40 2024-03-07T07:31:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3816aa80 con 0x7f1f38140e30 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f380d19e0 0x7f1f38139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f380d19e0 0x7f1f38139d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50360/0 (socket says 172.21.15.84:50360) 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 -- 172.21.15.84:0/3203578236 learned_addr learned my addr 172.21.15.84:0/3203578236 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37400640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36a00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f3806ba40 0x7f1f380b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 -- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 msgr2=0x7f1f38137820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38137820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 -- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f3806ba40 msgr2=0x7f1f380b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f3806ba40 0x7f1f380b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 -- 172.21.15.84:0/3203578236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f381577b0 con 0x7f1f380d19e0 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37400640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38137820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f36000640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f380d19e0 0x7f1f38139d60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c370 tx=0x7f1f2400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f2ea00640 1 -- 172.21.15.84:0/3203578236 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f240074e0 con 0x7f1f380d19e0 2024-03-07T07:31:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f2ea00640 1 -- 172.21.15.84:0/3203578236 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f24007680 con 0x7f1f380d19e0 2024-03-07T07:31:30.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f38157a90 con 0x7f1f380d19e0 2024-03-07T07:31:30.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f2ea00640 1 -- 172.21.15.84:0/3203578236 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24004a30 con 0x7f1f380d19e0 2024-03-07T07:31:30.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f38158050 con 0x7f1f380d19e0 2024-03-07T07:31:30.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f38062d40 con 0x7f1f380d19e0 2024-03-07T07:31:30.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.798+0000 7f1f2ea00640 1 -- 172.21.15.84:0/3203578236 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f1f2401a020 con 0x7f1f380d19e0 2024-03-07T07:31:30.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.802+0000 7f1f2ea00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1f18066f90 0x7f1f18069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:30.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.802+0000 7f1f2ea00640 1 -- 172.21.15.84:0/3203578236 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f24084690 con 0x7f1f380d19e0 2024-03-07T07:31:30.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.802+0000 7f1f36a00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1f18066f90 0x7f1f18069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:30.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.802+0000 7f1f36a00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1f18066f90 0x7f1f18069450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f280ae000 tx=0x7f1f280a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:30.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.806+0000 7f1f2ea00640 1 -- 172.21.15.84:0/3203578236 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f1f24055030 con 0x7f1f380d19e0 2024-03-07T07:31:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.994+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f38138610 con 0x7f1f380d19e0 2024-03-07T07:31:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.994+0000 7f1f2ea00640 1 -- 172.21.15.84:0/3203578236 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4974 (secure 0 0 0) 0x7f1f240590d0 con 0x7f1f380d19e0 2024-03-07T07:31:31.000 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:31.001 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:31:13.375093+0000","modified":"2024-03-07T07:31:16.379882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4315,"qdb_cluster":[4315]},"id":1}]} 2024-03-07T07:31:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-03-07T07:31:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1f18066f90 msgr2=0x7f1f18069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1f18066f90 0x7f1f18069450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f280ae000 tx=0x7f1f280a7070 comp rx=0 tx=0).stop 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f380d19e0 msgr2=0x7f1f38139d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f380d19e0 0x7f1f38139d60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c370 tx=0x7f1f2400c830 comp rx=0 tx=0).stop 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 shutdown_connections 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1f18066f90 0x7f1f18069450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1f38140e30 0x7f1f38137820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f380d19e0 0x7f1f38139d60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 --2- 172.21.15.84:0/3203578236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f3806ba40 0x7f1f380b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 >> 172.21.15.84:0/3203578236 conn(0x7f1f3806f2b0 msgr2=0x7f1f3813a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 shutdown_connections 2024-03-07T07:31:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:30.998+0000 7f1f37e00640 1 -- 172.21.15.84:0/3203578236 wait complete. 2024-03-07T07:31:31.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:31.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.150+0000 7f5b21a00640 1 Processor -- start 2024-03-07T07:31:31.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21a00640 1 -- start start 2024-03-07T07:31:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b1c06c180 0x7f5b1c0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15cf10 0x7f5b1c0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c15c1a0 con 0x7f5b1c15bdc0 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c15ca80 con 0x7f5b1c06c180 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0ab240 con 0x7f5b1c15cf10 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b1be00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5b1c15bdc0 0x7f5b1c06ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33788/0 (socket says 172.21.15.84:33788) 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b1be00640 1 -- 172.21.15.84:0/4078776407 learned_addr learned my addr 172.21.15.84:0/4078776407 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21000640 1 --2- 172.21.15.84:0/4078776407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15cf10 0x7f5b1c0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b1b400640 1 --2- 172.21.15.84:0/4078776407 >> v2:172.21.15.161:3300/0 conn(0x7f5b1c06c180 0x7f5b1c0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b1aa00640 1 -- 172.21.15.84:0/4078776407 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59223764 0 0) 0x7f5b1c15c1a0 con 0x7f5b1c15bdc0 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b1aa00640 1 -- 172.21.15.84:0/4078776407 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b00003530 con 0x7f5b1c15bdc0 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21000640 1 -- 172.21.15.84:0/4078776407 >> v2:172.21.15.161:3300/0 conn(0x7f5b1c06c180 msgr2=0x7f5b1c0aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21000640 1 --2- 172.21.15.84:0/4078776407 >> v2:172.21.15.161:3300/0 conn(0x7f5b1c06c180 0x7f5b1c0aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21000640 1 -- 172.21.15.84:0/4078776407 >> v1:172.21.15.84:6789/0 conn(0x7f5b1c15bdc0 legacy=0x7f5b1c06ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.154+0000 7f5b21000640 1 -- 172.21.15.84:0/4078776407 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c15c430 con 0x7f5b1c15cf10 2024-03-07T07:31:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21000640 1 --2- 172.21.15.84:0/4078776407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15cf10 0x7f5b1c0aaba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009d90 tx=0x7f5b1401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4a7e68e03ab343 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b1aa00640 1 -- 172.21.15.84:0/4078776407 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140b2070 con 0x7f5b1c15cf10 2024-03-07T07:31:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b1aa00640 1 -- 172.21.15.84:0/4078776407 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b140a5940 con 0x7f5b1c15cf10 2024-03-07T07:31:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b1aa00640 1 -- 172.21.15.84:0/4078776407 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140a5d10 con 0x7f5b1c15cf10 2024-03-07T07:31:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 -- 172.21.15.84:0/4078776407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15cf10 msgr2=0x7f5b1c0aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4078776407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15cf10 0x7f5b1c0aaba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009d90 tx=0x7f5b1401c970 comp rx=0 tx=0).stop 2024-03-07T07:31:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 -- 172.21.15.84:0/4078776407 shutdown_connections 2024-03-07T07:31:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4078776407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15cf10 0x7f5b1c0aaba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4078776407 >> v2:172.21.15.161:3300/0 conn(0x7f5b1c06c180 0x7f5b1c0aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 -- 172.21.15.84:0/4078776407 >> 172.21.15.84:0/4078776407 conn(0x7f5b1c06f2b0 msgr2=0x7f5b1c06f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 -- 172.21.15.84:0/4078776407 shutdown_connections 2024-03-07T07:31:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 -- 172.21.15.84:0/4078776407 wait complete. 2024-03-07T07:31:31.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 Processor -- start 2024-03-07T07:31:31.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.158+0000 7f5b21a00640 1 -- start start 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c06c180 0x7f5b1c1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15bdc0 0x7f5b1c1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c15cf10 0x7f5b1c14f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c15dfb0 con 0x7f5b1c15cf10 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c15de30 con 0x7f5b1c06c180 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c15e130 con 0x7f5b1c15bdc0 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c15cf10 0x7f5b1c14f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c15cf10 0x7f5b1c14f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50370/0 (socket says 172.21.15.84:50370) 2024-03-07T07:31:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 -- 172.21.15.84:0/4265153156 learned_addr learned my addr 172.21.15.84:0/4265153156 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b1b400640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15bdc0 0x7f5b1c1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b1be00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c06c180 0x7f5b1c1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 -- 172.21.15.84:0/4265153156 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15bdc0 msgr2=0x7f5b1c1502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15bdc0 0x7f5b1c1502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 -- 172.21.15.84:0/4265153156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c06c180 msgr2=0x7f5b1c1544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c06c180 0x7f5b1c1544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 -- 172.21.15.84:0/4265153156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c151660 con 0x7f5b1c15cf10 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21000640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c15cf10 0x7f5b1c14f6a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5b140b0040 tx=0x7f5b14019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b13e00640 1 -- 172.21.15.84:0/4265153156 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140b2050 con 0x7f5b1c15cf10 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b13e00640 1 -- 172.21.15.84:0/4265153156 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b140be070 con 0x7f5b1c15cf10 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b13e00640 1 -- 172.21.15.84:0/4265153156 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140ada70 con 0x7f5b1c15cf10 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c150dc0 con 0x7f5b1c15cf10 2024-03-07T07:31:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c151380 con 0x7f5b1c15cf10 2024-03-07T07:31:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c062d40 con 0x7f5b1c15cf10 2024-03-07T07:31:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.162+0000 7f5b13e00640 1 -- 172.21.15.84:0/4265153156 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f5b140a57c0 con 0x7f5b1c15cf10 2024-03-07T07:31:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.166+0000 7f5b13e00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5afc066f60 0x7f5afc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.166+0000 7f5b13e00640 1 -- 172.21.15.84:0/4265153156 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b14120040 con 0x7f5b1c15cf10 2024-03-07T07:31:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.166+0000 7f5b1be00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5afc066f60 0x7f5afc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.166+0000 7f5b1be00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5afc066f60 0x7f5afc069420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c005890 tx=0x7f5b0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.170+0000 7f5b13e00640 1 -- 172.21.15.84:0/4265153156 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f5b1c151660 con 0x7f5b1c15cf10 2024-03-07T07:31:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.322+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b1c06bd20 con 0x7f5b1c15cf10 2024-03-07T07:31:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b13e00640 1 -- 172.21.15.84:0/4265153156 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f5b14016560 con 0x7f5b1c15cf10 2024-03-07T07:31:31.329 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:31.329 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5afc066f60 msgr2=0x7f5afc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5afc066f60 0x7f5afc069420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c005890 tx=0x7f5b0c009040 comp rx=0 tx=0).stop 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c15cf10 msgr2=0x7f5b1c14f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c15cf10 0x7f5b1c14f6a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5b140b0040 tx=0x7f5b14019710 comp rx=0 tx=0).stop 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 shutdown_connections 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5afc066f60 0x7f5afc069420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b1c15cf10 0x7f5b1c14f6a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b1c15bdc0 0x7f5b1c1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 --2- 172.21.15.84:0/4265153156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b1c06c180 0x7f5b1c1544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 >> 172.21.15.84:0/4265153156 conn(0x7f5b1c06f2b0 msgr2=0x7f5b1c15a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 shutdown_connections 2024-03-07T07:31:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.326+0000 7f5b21a00640 1 -- 172.21.15.84:0/4265153156 wait complete. 2024-03-07T07:31:31.351 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:31.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2acd000640 1 Processor -- start 2024-03-07T07:31:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2acd000640 1 -- start start 2024-03-07T07:31:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2acd000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ac80ad850 0x7f2ac80adce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2acd000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac8070f00 0x7f2ac8071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2acd000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac815ef30 con 0x7f2ac8154e10 2024-03-07T07:31:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2acd000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac80704b0 con 0x7f2ac80ad850 2024-03-07T07:31:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2acd000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8070a70 con 0x7f2ac8070f00 2024-03-07T07:31:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2ac6a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ac80ad850 0x7f2ac80adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2ac7400640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2ac8154e10 0x7f2ac815e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:41536/0 (socket says 172.21.15.84:41536) 2024-03-07T07:31:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2ac7400640 1 -- 172.21.15.84:0/1771090423 learned_addr learned my addr 172.21.15.84:0/1771090423 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2ac7e00640 1 --2- 172.21.15.84:0/1771090423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac8070f00 0x7f2ac8071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2ac6a00640 1 -- 172.21.15.84:0/1771090423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac8070f00 msgr2=0x7f2ac8071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2ac6a00640 1 --2- 172.21.15.84:0/1771090423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac8070f00 0x7f2ac8071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2ac6a00640 1 -- 172.21.15.84:0/1771090423 >> v1:172.21.15.161:6789/0 conn(0x7f2ac8154e10 legacy=0x7f2ac815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.482+0000 7f2ac6a00640 1 -- 172.21.15.84:0/1771090423 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac815f210 con 0x7f2ac80ad850 2024-03-07T07:31:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2ac6a00640 1 --2- 172.21.15.84:0/1771090423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac80ad850 0x7f2ac80adce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40097c0 tx=0x7f2ab401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed739f8ece17dda server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:31.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2ac6000640 1 -- 172.21.15.84:0/1771090423 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab40b0070 con 0x7f2ac80ad850 2024-03-07T07:31:31.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2ac6000640 1 -- 172.21.15.84:0/1771090423 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab40ab600 con 0x7f2ac80ad850 2024-03-07T07:31:31.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2ac6000640 1 -- 172.21.15.84:0/1771090423 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab40ab9d0 con 0x7f2ac80ad850 2024-03-07T07:31:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 -- 172.21.15.84:0/1771090423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac80ad850 msgr2=0x7f2ac80adce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 --2- 172.21.15.84:0/1771090423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac80ad850 0x7f2ac80adce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40097c0 tx=0x7f2ab401c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 -- 172.21.15.84:0/1771090423 shutdown_connections 2024-03-07T07:31:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 --2- 172.21.15.84:0/1771090423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac8070f00 0x7f2ac8071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 --2- 172.21.15.84:0/1771090423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac80ad850 0x7f2ac80adce0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 -- 172.21.15.84:0/1771090423 >> 172.21.15.84:0/1771090423 conn(0x7f2ac806b7c0 msgr2=0x7f2ac806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 -- 172.21.15.84:0/1771090423 shutdown_connections 2024-03-07T07:31:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 -- 172.21.15.84:0/1771090423 wait complete. 2024-03-07T07:31:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 Processor -- start 2024-03-07T07:31:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.486+0000 7f2acd000640 1 -- start start 2024-03-07T07:31:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac8070f00 0x7f2ac814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac80ad850 0x7f2ac80b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ac8154e10 0x7f2ac8161c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8071e40 con 0x7f2ac8070f00 2024-03-07T07:31:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8071cc0 con 0x7f2ac8154e10 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81551f0 con 0x7f2ac80ad850 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac8070f00 0x7f2ac814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac8070f00 0x7f2ac814fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50396/0 (socket says 172.21.15.84:50396) 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 -- 172.21.15.84:0/2755832836 learned_addr learned my addr 172.21.15.84:0/2755832836 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac6a00640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac80ad850 0x7f2ac80b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7e00640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ac8154e10 0x7f2ac8161c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 -- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac80ad850 msgr2=0x7f2ac80b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac80ad850 0x7f2ac80b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 -- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ac8154e10 msgr2=0x7f2ac8161c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ac8154e10 0x7f2ac8161c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 -- 172.21.15.84:0/2755832836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac815c9c0 con 0x7f2ac8070f00 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7e00640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ac8154e10 0x7f2ac8161c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2ac7400640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac8070f00 0x7f2ac814fec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800c370 tx=0x7f2ab800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2abf400640 1 -- 172.21.15.84:0/2755832836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8017070 con 0x7f2ac8070f00 2024-03-07T07:31:31.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2abf400640 1 -- 172.21.15.84:0/2755832836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8005cf0 con 0x7f2ac8070f00 2024-03-07T07:31:31.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2abf400640 1 -- 172.21.15.84:0/2755832836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80072f0 con 0x7f2ac8070f00 2024-03-07T07:31:31.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac80b1f00 con 0x7f2ac8070f00 2024-03-07T07:31:31.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac8151cf0 con 0x7f2ac8070f00 2024-03-07T07:31:31.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.490+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac8062d40 con 0x7f2ac8070f00 2024-03-07T07:31:31.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.494+0000 7f2abf400640 1 -- 172.21.15.84:0/2755832836 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f2ab801a070 con 0x7f2ac8070f00 2024-03-07T07:31:31.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.494+0000 7f2abf400640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2aa8066f60 0x7f2aa8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:31.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.494+0000 7f2abf400640 1 -- 172.21.15.84:0/2755832836 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ab8084320 con 0x7f2ac8070f00 2024-03-07T07:31:31.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.494+0000 7f2ac6a00640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2aa8066f60 0x7f2aa8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:31.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.494+0000 7f2ac6a00640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2aa8066f60 0x7f2aa8069420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40ad000 tx=0x7f2ab4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:31.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.498+0000 7f2abf400640 1 -- 172.21.15.84:0/2755832836 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f2ab8054ce0 con 0x7f2ac8070f00 2024-03-07T07:31:31.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.682+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ac8068860 con 0x7f2ac8070f00 2024-03-07T07:31:31.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.682+0000 7f2abf400640 1 -- 172.21.15.84:0/2755832836 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4974 (secure 0 0 0) 0x7f2ab8058d80 con 0x7f2ac8070f00 2024-03-07T07:31:31.687 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:31.687 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:31:13.375093+0000","modified":"2024-03-07T07:31:16.379882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4315,"qdb_cluster":[4315]},"id":1}]} 2024-03-07T07:31:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-03-07T07:31:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2aa8066f60 msgr2=0x7f2aa8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2aa8066f60 0x7f2aa8069420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40ad000 tx=0x7f2ab4008040 comp rx=0 tx=0).stop 2024-03-07T07:31:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac8070f00 msgr2=0x7f2ac814fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac8070f00 0x7f2ac814fec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800c370 tx=0x7f2ab800c830 comp rx=0 tx=0).stop 2024-03-07T07:31:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 shutdown_connections 2024-03-07T07:31:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2aa8066f60 0x7f2aa8069420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ac8154e10 0x7f2ac8161c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2ac80ad850 0x7f2ac80b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 --2- 172.21.15.84:0/2755832836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac8070f00 0x7f2ac814fec0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 >> 172.21.15.84:0/2755832836 conn(0x7f2ac806b7c0 msgr2=0x7f2ac806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 shutdown_connections 2024-03-07T07:31:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:31.686+0000 7f2acd000640 1 -- 172.21.15.84:0/2755832836 wait complete. 2024-03-07T07:31:32.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-07T07:31:13.375093+0000', 'modified': '2024-03-07T07:31:16.379882+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4315}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4315': {'gid': 4315, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6834/347324593', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6832', 'nonce': 347324593}, {'type': 'v1', 'addr': '172.21.15.161:6834', 'nonce': 347324593}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4315, 'qdb_cluster': [4315]} 2024-03-07T07:31:32.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-07T07:31:32.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-07T07:31:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf14400640 1 Processor -- start 2024-03-07T07:31:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf14400640 1 -- start start 2024-03-07T07:31:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf14400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf0c145a30 0x7fbf0c0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf14400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c0cf9a0 con 0x7fbf0c06d230 2024-03-07T07:31:32.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf14400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c06d780 con 0x7fbf0c0a9540 2024-03-07T07:31:32.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf14400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c06da60 con 0x7fbf0c145a30 2024-03-07T07:31:32.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf12400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbf0c06d230 0x7fbf0c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44384/0 (socket says 172.21.15.84:44384) 2024-03-07T07:31:32.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf12400640 1 -- 172.21.15.84:0/1452801113 learned_addr learned my addr 172.21.15.84:0/1452801113 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:32.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.242+0000 7fbf11a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf0c145a30 0x7fbf0c0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf11a00640 1 -- 172.21.15.84:0/1452801113 >> v1:172.21.15.161:6789/0 conn(0x7fbf0c0a9540 legacy=0x7fbf0c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf11a00640 1 -- 172.21.15.84:0/1452801113 >> v1:172.21.15.84:6789/0 conn(0x7fbf0c06d230 legacy=0x7fbf0c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf0be00640 1 -- 172.21.15.84:0/1452801113 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160548490 0 0) 0x7fbf0c06d780 con 0x7fbf0c0a9540 2024-03-07T07:31:32.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf11a00640 1 -- 172.21.15.84:0/1452801113 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c06dd40 con 0x7fbf0c145a30 2024-03-07T07:31:32.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf11a00640 1 --2- 172.21.15.84:0/1452801113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c145a30 0x7fbf0c0729d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009d90 tx=0x7fbf0001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f777b8d7cc4ea65 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf0be00640 1 -- 172.21.15.84:0/1452801113 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000b1070 con 0x7fbf0c145a30 2024-03-07T07:31:32.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf0be00640 1 -- 172.21.15.84:0/1452801113 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf000a49f0 con 0x7fbf0c145a30 2024-03-07T07:31:32.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf0be00640 1 -- 172.21.15.84:0/1452801113 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000a4dc0 con 0x7fbf0c145a30 2024-03-07T07:31:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf14400640 1 -- 172.21.15.84:0/1452801113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c145a30 msgr2=0x7fbf0c0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.246+0000 7fbf14400640 1 --2- 172.21.15.84:0/1452801113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c145a30 0x7fbf0c0729d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009d90 tx=0x7fbf0001c450 comp rx=0 tx=0).stop 2024-03-07T07:31:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- 172.21.15.84:0/1452801113 shutdown_connections 2024-03-07T07:31:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 --2- 172.21.15.84:0/1452801113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c145a30 0x7fbf0c0729d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- 172.21.15.84:0/1452801113 >> 172.21.15.84:0/1452801113 conn(0x7fbf0c0704b0 msgr2=0x7fbf0c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- 172.21.15.84:0/1452801113 shutdown_connections 2024-03-07T07:31:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- 172.21.15.84:0/1452801113 wait complete. 2024-03-07T07:31:32.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 Processor -- start 2024-03-07T07:31:32.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- start start 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf0c06d230 0x7fbf0c0ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf0c145a30 0x7fbf0c0abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c15e130 0x7fbf0c15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c16acb0 con 0x7fbf0c15e130 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c16ab30 con 0x7fbf0c06d230 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c16ae30 con 0x7fbf0c145a30 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c15e130 0x7fbf0c15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c15e130 0x7fbf0c15e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41246/0 (socket says 172.21.15.84:41246) 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf11a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf0c06d230 0x7fbf0c0ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 -- 172.21.15.84:0/1159718362 learned_addr learned my addr 172.21.15.84:0/1159718362 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf11000640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf0c145a30 0x7fbf0c0abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 -- 172.21.15.84:0/1159718362 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf0c145a30 msgr2=0x7fbf0c0abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf0c145a30 0x7fbf0c0abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 -- 172.21.15.84:0/1159718362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf0c06d230 msgr2=0x7fbf0c0ab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf0c06d230 0x7fbf0c0ab690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 -- 172.21.15.84:0/1159718362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c0ac1c0 con 0x7fbf0c15e130 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf12400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c15e130 0x7fbf0c15e5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c780 tx=0x7fbf0400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf09600640 1 -- 172.21.15.84:0/1159718362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04018070 con 0x7fbf0c15e130 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf09600640 1 -- 172.21.15.84:0/1159718362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf040072d0 con 0x7fbf0c15e130 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- 172.21.15.84:0/1159718362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c0ac4a0 con 0x7fbf0c15e130 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf09600640 1 -- 172.21.15.84:0/1159718362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf040047f0 con 0x7fbf0c15e130 2024-03-07T07:31:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.250+0000 7fbf14400640 1 -- 172.21.15.84:0/1159718362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c0ad6f0 con 0x7fbf0c15e130 2024-03-07T07:31:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.254+0000 7fbf09600640 1 -- 172.21.15.84:0/1159718362 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fbf0401b070 con 0x7fbf0c15e130 2024-03-07T07:31:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.254+0000 7fbf09600640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbeec066f60 0x7fbeec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.254+0000 7fbf09600640 1 -- 172.21.15.84:0/1159718362 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf04084400 con 0x7fbf0c15e130 2024-03-07T07:31:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.254+0000 7fbf11a00640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbeec066f60 0x7fbeec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.254+0000 7fbf177c8000 1 Processor -- start 2024-03-07T07:31:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.254+0000 7fbf177c8000 1 -- start start 2024-03-07T07:31:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.254+0000 7fbf11a00640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbeec066f60 0x7fbeec069420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf000ae000 tx=0x7fbf000a6070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 0x55d838281140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838281680 0x55d838236a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838236f90 0x55d838237370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83811e420 con 0x55d838281680 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d838085fa0 con 0x55d838236f90 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d83800de00 con 0x55d838280d60 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838281680 0x55d838236a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838281680 0x55d838236a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41262/0 (socket says 172.21.15.84:41262) 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 -- 172.21.15.84:0/1608484847 learned_addr learned my addr 172.21.15.84:0/1608484847 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11a00640 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 0x55d838281140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf12400640 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838236f90 0x55d838237370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 -- 172.21.15.84:0/1608484847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 msgr2=0x55d838281140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 0x55d838281140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 -- 172.21.15.84:0/1608484847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838236f90 msgr2=0x55d838237370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838236f90 0x55d838237370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 -- 172.21.15.84:0/1608484847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d838011cc0 con 0x55d838281680 2024-03-07T07:31:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf11000640 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838281680 0x55d838236a50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbef80018d0 tx=0x7fbef8007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fff469f410a900 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbefe000640 1 -- 172.21.15.84:0/1608484847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80052e0 con 0x55d838281680 2024-03-07T07:31:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbefe000640 1 -- 172.21.15.84:0/1608484847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8018070 con 0x55d838281680 2024-03-07T07:31:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbefe000640 1 -- 172.21.15.84:0/1608484847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8005480 con 0x55d838281680 2024-03-07T07:31:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- 172.21.15.84:0/1608484847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838281680 msgr2=0x55d838236a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838281680 0x55d838236a50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbef80018d0 tx=0x7fbef8007d40 comp rx=0 tx=0).stop 2024-03-07T07:31:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- 172.21.15.84:0/1608484847 shutdown_connections 2024-03-07T07:31:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838236f90 0x55d838237370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838281680 0x55d838236a50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1608484847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 0x55d838281140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- 172.21.15.84:0/1608484847 >> 172.21.15.84:0/1608484847 conn(0x55d83822e310 msgr2=0x55d838235330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- 172.21.15.84:0/1608484847 shutdown_connections 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- 172.21.15.84:0/1608484847 wait complete. 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- start start 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 Processor -- start 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d838242110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 0x55d838242650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d838242b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d838040b00 con 0x55d838236f90 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d838082040 con 0x55d838281680 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.258+0000 7fbf177c8000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d83808a5d0 con 0x55d838280d60 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 10 client.0 _ll_register_callbacks cb 0x55d838027ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d838242110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d838242110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41276/0 (socket says 172.21.15.84:41276) 2024-03-07T07:31:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 -- 172.21.15.84:0/341282960 learned_addr learned my addr 172.21.15.84:0/341282960 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11000640 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 0x55d838242650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf12400640 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d838242b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 -- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 msgr2=0x55d838242650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 0x55d838242650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 -- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 msgr2=0x55d838242b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d838242b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 -- 172.21.15.84:0/341282960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d83804a380 con 0x55d838236f90 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11a00640 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d838242110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009d90 tx=0x7fbf0001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235768c371e0b8ea server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 1 -- 172.21.15.84:0/341282960 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000cb020 con 0x55d838236f90 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 1 -- 172.21.15.84:0/341282960 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf000b8b30 con 0x55d838236f90 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 1 -- 172.21.15.84:0/341282960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbef8018070 con 0x55d838236f90 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 1 -- 172.21.15.84:0/341282960 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf000d5050 con 0x55d838236f90 2024-03-07T07:31:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 10 client.4575 fetch_fsmap learned FSMap version 8 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 1 -- 172.21.15.84:0/341282960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d838059830 con 0x55d838236f90 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 1 -- 172.21.15.84:0/341282960 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8018070 con 0x55d838236f90 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 1 -- 172.21.15.84:0/341282960 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 8) v1 ==== 3314+0+0 (secure 0 0 0) 0x7fbf000d8020 con 0x55d838236f90 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 10 client.4575 fetch_fsmap finished waiting for FSMap version 8 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 10 client.4575 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 20 client.4575 populate_metadata read hostname 'smithi084' 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] conn(0x55d838243430 0x55d8382924e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 4 client.4575 mds_command: new command op to 4315 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 1 -- 172.21.15.84:0/341282960 --> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d838021b60 con 0x55d838243430 2024-03-07T07:31:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11000640 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] conn(0x55d838243430 0x55d8382924e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 10 client.4575 ms_handle_connect on v2:172.21.15.161:6832/347324593 2024-03-07T07:31:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf11000640 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] conn(0x55d838243430 0x55d8382924e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3124d20b0c210de3 server_cookie=96408a8af58f92d8 in_seq=0 out_seq=0 2024-03-07T07:31:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 1 -- 172.21.15.84:0/341282960 <== mds.0 v2:172.21.15.161:6832/347324593 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d838021b60 con 0x55d838243430 2024-03-07T07:31:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbef2a00640 10 client.4575 handle_command_reply: tid=0 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 1 client.4575 shutdown 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 1 -- 172.21.15.84:0/341282960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 msgr2=0x55d838242110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.262+0000 7fbf177c8000 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d838242110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009d90 tx=0x7fbf0001ac90 comp rx=0 tx=0).stop 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 1 -- 172.21.15.84:0/341282960 shutdown_connections 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d838242b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838280d60 0x55d838242650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] conn(0x55d838243430 0x55d8382924e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 1 --2- 172.21.15.84:0/341282960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d838242110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbef2a00640 0 client.4575 ms_handle_reset on v2:172.21.15.161:6832/347324593 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 1 -- 172.21.15.84:0/341282960 >> 172.21.15.84:0/341282960 conn(0x55d83822e310 msgr2=0x55d838235a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 1 -- 172.21.15.84:0/341282960 shutdown_connections 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 1 -- 172.21.15.84:0/341282960 wait complete. 2024-03-07T07:31:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.266+0000 7fbf177c8000 20 client.4575 trim_cache size 0 max 16384 2024-03-07T07:31:32.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 Processor -- start 2024-03-07T07:31:32.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- start start 2024-03-07T07:31:32.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d8382e6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838280d60 0x55d8382e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838281680 0x55d8382e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c202080 con 0x55d838236f90 2024-03-07T07:31:32.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c201200 con 0x55d838280d60 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c200700 con 0x55d838281680 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d8382e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d8382e6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41282/0 (socket says 172.21.15.84:41282) 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 -- 172.21.15.84:0/238825233 learned_addr learned my addr 172.21.15.84:0/238825233 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf12400640 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838281680 0x55d8382e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11000640 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838280d60 0x55d8382e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 -- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838281680 msgr2=0x55d8382e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838281680 0x55d8382e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 -- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838280d60 msgr2=0x55d8382e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838280d60 0x55d8382e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 -- 172.21.15.84:0/238825233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d838053fb0 con 0x55d838236f90 2024-03-07T07:31:32.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf12400640 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838281680 0x55d8382e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:32.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11000640 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838280d60 0x55d8382e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:32.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf11a00640 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d8382e6210 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf0001c490 tx=0x7fbf000c4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d5c486875e6c23 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbefd600640 1 -- 172.21.15.84:0/238825233 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000de070 con 0x55d838236f90 2024-03-07T07:31:32.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbefd600640 1 -- 172.21.15.84:0/238825233 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf000b8830 con 0x55d838236f90 2024-03-07T07:31:32.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbefd600640 1 -- 172.21.15.84:0/238825233 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000bc030 con 0x55d838236f90 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- 172.21.15.84:0/238825233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 msgr2=0x55d8382e6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d8382e6210 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf0001c490 tx=0x7fbf000c4000 comp rx=0 tx=0).stop 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- 172.21.15.84:0/238825233 shutdown_connections 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838281680 0x55d8382e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838280d60 0x55d8382e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 --2- 172.21.15.84:0/238825233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838236f90 0x55d8382e6210 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- 172.21.15.84:0/238825233 >> 172.21.15.84:0/238825233 conn(0x55d83822e310 msgr2=0x55d83823c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- 172.21.15.84:0/238825233 shutdown_connections 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- 172.21.15.84:0/238825233 wait complete. 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 -- start start 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.282+0000 7fbf177c8000 1 Processor -- start 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838236f90 0x55d8382ea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838280d60 0x55d8382ea550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d8382a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8382404e0 con 0x55d838280d60 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c200c00 con 0x55d838281680 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d838141b80 con 0x55d838236f90 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 10 client.0 _ll_register_callbacks cb 0x7fbf000a4b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838280d60 0x55d8382ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838236f90 0x55d8382ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838280d60 0x55d8382ea550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41296/0 (socket says 172.21.15.84:41296) 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838236f90 0x55d8382ea010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:34126/0 (socket says 172.21.15.84:34126) 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 -- 172.21.15.84:0/1327269971 learned_addr learned my addr 172.21.15.84:0/1327269971 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf12400640 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d8382a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 -- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838236f90 msgr2=0x55d8382ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838236f90 0x55d8382ea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 -- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 msgr2=0x55d8382a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d8382a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 -- 172.21.15.84:0/1327269971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8381072e0 con 0x55d838280d60 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf12400640 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d8382a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11000640 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838280d60 0x55d8382ea550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbef80013a0 tx=0x7fbef8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0380bd63e48daa server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 1 -- 172.21.15.84:0/1327269971 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef800faf0 con 0x55d838280d60 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 1 -- 172.21.15.84:0/1327269971 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbef8029cc0 con 0x55d838280d60 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- 172.21.15.84:0/1327269971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf000b8830 con 0x55d838280d60 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 1 -- 172.21.15.84:0/1327269971 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbef800fc90 con 0x55d838280d60 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 10 client.4581 fetch_fsmap learned FSMap version 8 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- 172.21.15.84:0/1327269971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d83802d0a0 con 0x55d838280d60 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 1 -- 172.21.15.84:0/1327269971 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf000b8830 con 0x55d838280d60 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 1 -- 172.21.15.84:0/1327269971 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 8) v1 ==== 3314+0+0 (secure 0 0 0) 0x7fbef8033080 con 0x55d838280d60 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 10 client.4581 fetch_fsmap finished waiting for FSMap version 8 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 10 client.4581 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 20 client.4581 populate_metadata read hostname 'smithi084' 2024-03-07T07:31:32.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] conn(0x55d8382a55d0 0x55d8382a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 4 client.4581 mds_command: new command op to 4315 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- 172.21.15.84:0/1327269971 --> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8380934e0 con 0x55d8382a55d0 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11a00640 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] conn(0x55d8382a55d0 0x55d8382a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 10 client.4581 ms_handle_connect on v2:172.21.15.161:6832/347324593 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf11a00640 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] conn(0x55d8382a55d0 0x55d8382a59b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7db2f2c0e7f4b7f8 server_cookie=a732b3dcc6b48bee in_seq=0 out_seq=0 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 1 -- 172.21.15.84:0/1327269971 <== mds.0 v2:172.21.15.161:6832/347324593 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d8380934e0 con 0x55d8382a55d0 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 10 client.4581 handle_command_reply: tid=0 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 client.4581 shutdown 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- 172.21.15.84:0/1327269971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838280d60 msgr2=0x55d8382ea550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838280d60 0x55d8382ea550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbef80013a0 tx=0x7fbef8000ee0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- 172.21.15.84:0/1327269971 shutdown_connections 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d838281680 0x55d8382a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:6832/347324593,v1:172.21.15.161:6834/347324593] conn(0x55d8382a55d0 0x55d8382a59b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d838280d60 0x55d8382ea550 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 --2- 172.21.15.84:0/1327269971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55d838236f90 0x55d8382ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbef2a00640 0 client.4581 ms_handle_reset on v2:172.21.15.161:6832/347324593 2024-03-07T07:31:32.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- 172.21.15.84:0/1327269971 >> 172.21.15.84:0/1327269971 conn(0x55d83822e310 msgr2=0x55d8382924e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:32.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- 172.21.15.84:0/1327269971 shutdown_connections 2024-03-07T07:31:32.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.286+0000 7fbf177c8000 1 -- 172.21.15.84:0/1327269971 wait complete. 2024-03-07T07:31:32.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf177c8000 20 client.4581 trim_cache size 0 max 16384 2024-03-07T07:31:32.297 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "9dc7a008-fd12-4491-ba8d-83bae22f3106", 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4315, 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 18.309169107999999, 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 8, 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 21, 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 21, 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 25.903363528 2024-03-07T07:31:32.298 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:31:32.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 -- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbeec066f60 msgr2=0x7fbeec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbeec066f60 0x7fbeec069420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf000ae000 tx=0x7fbf000a6070 comp rx=0 tx=0).stop 2024-03-07T07:31:32.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 -- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c15e130 msgr2=0x7fbf0c15e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c15e130 0x7fbf0c15e5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c780 tx=0x7fbf0400cc40 comp rx=0 tx=0).stop 2024-03-07T07:31:32.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 -- 172.21.15.84:0/1159718362 shutdown_connections 2024-03-07T07:31:32.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbeec066f60 0x7fbeec069420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf0c15e130 0x7fbf0c15e5b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf0c145a30 0x7fbf0c0abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 --2- 172.21.15.84:0/1159718362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf0c06d230 0x7fbf0c0ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 -- 172.21.15.84:0/1159718362 >> 172.21.15.84:0/1159718362 conn(0x7fbf0c0704b0 msgr2=0x7fbf0c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:32.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 -- 172.21.15.84:0/1159718362 shutdown_connections 2024-03-07T07:31:32.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.290+0000 7fbf14400640 1 -- 172.21.15.84:0/1159718362 wait complete. 2024-03-07T07:31:32.312 INFO:teuthology.run_tasks:Running task kclient... 2024-03-07T07:31:32.336 INFO:tasks.kclient:Mounting kernel clients... 2024-03-07T07:31:32.336 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-07T07:31:32.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:32.336 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-03-07T07:31:32.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:32.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-03-07T07:31:32.409 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2024-03-07T07:31:32.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:31:32.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:32.412 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-03-07T07:31:32.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:32.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-03-07T07:31:32.525 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2024-03-07T07:31:32.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:31:32.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:32.528 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-03-07T07:31:32.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:32.537 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-03-07T07:31:32.599 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-03-07T07:31:32.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:31:32.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:32.601 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-03-07T07:31:32.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:32.650 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-03-07T07:31:32.715 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-03-07T07:31:32.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:31:32.717 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-03-07T07:31:32.717 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-07T07:31:32.717 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-07T07:31:32.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-07T07:31:32.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.846+0000 7fb831000640 1 Processor -- start 2024-03-07T07:31:32.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.846+0000 7fb831000640 1 -- start start 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb831000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb831000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb82c0730e0 0x7fb82c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb831000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c0cc880 con 0x7fb82c144360 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb831000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c1441b0 con 0x7fb82c0730e0 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb831000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0cf050 con 0x7fb82c143dd0 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb829e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb829e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:34140/0 (socket says 172.21.15.84:34140) 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb829e00640 1 -- 172.21.15.84:0/2983839518 learned_addr learned my addr 172.21.15.84:0/2983839518 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb82a800640 1 --2- 172.21.15.84:0/2983839518 >> v2:172.21.15.161:3300/0 conn(0x7fb82c0730e0 0x7fb82c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb829e00640 1 -- 172.21.15.84:0/2983839518 >> v2:172.21.15.161:3300/0 conn(0x7fb82c0730e0 msgr2=0x7fb82c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb829e00640 1 --2- 172.21.15.84:0/2983839518 >> v2:172.21.15.161:3300/0 conn(0x7fb82c0730e0 0x7fb82c15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb829e00640 1 -- 172.21.15.84:0/2983839518 >> v1:172.21.15.161:6789/0 conn(0x7fb82c144360 legacy=0x7fb82c0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb829e00640 1 -- 172.21.15.84:0/2983839518 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0ccb60 con 0x7fb82c143dd0 2024-03-07T07:31:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.850+0000 7fb82a800640 1 --2- 172.21.15.84:0/2983839518 >> v2:172.21.15.161:3300/0 conn(0x7fb82c0730e0 0x7fb82c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb829e00640 1 --2- 172.21.15.84:0/2983839518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c0cdc00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009e50 tx=0x7fb81c01ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=151208bbd1af119c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb828a00640 1 -- 172.21.15.84:0/2983839518 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0a58f0 con 0x7fb82c143dd0 2024-03-07T07:31:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb828a00640 1 -- 172.21.15.84:0/2983839518 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c0a5a90 con 0x7fb82c143dd0 2024-03-07T07:31:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb828a00640 1 -- 172.21.15.84:0/2983839518 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0a5e60 con 0x7fb82c143dd0 2024-03-07T07:31:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- 172.21.15.84:0/2983839518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 msgr2=0x7fb82c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 --2- 172.21.15.84:0/2983839518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c0cdc00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009e50 tx=0x7fb81c01ca00 comp rx=0 tx=0).stop 2024-03-07T07:31:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- 172.21.15.84:0/2983839518 shutdown_connections 2024-03-07T07:31:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 --2- 172.21.15.84:0/2983839518 >> v2:172.21.15.161:3300/0 conn(0x7fb82c0730e0 0x7fb82c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 --2- 172.21.15.84:0/2983839518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c0cdc00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- 172.21.15.84:0/2983839518 >> 172.21.15.84:0/2983839518 conn(0x7fb82c0704b0 msgr2=0x7fb82c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- 172.21.15.84:0/2983839518 shutdown_connections 2024-03-07T07:31:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- 172.21.15.84:0/2983839518 wait complete. 2024-03-07T07:31:32.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 Processor -- start 2024-03-07T07:31:32.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- start start 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb82c0730e0 0x7fb82c13d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb82c144360 0x7fb82c133920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c167960 con 0x7fb82c144360 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0cd6e0 con 0x7fb82c0730e0 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb831000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c167ae0 con 0x7fb82c143dd0 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb82a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb82c144360 0x7fb82c133920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb829e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb82c0730e0 0x7fb82c13d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb829400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb829e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb82c0730e0 0x7fb82c13d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39326/0 (socket says 172.21.15.84:39326) 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.854+0000 7fb829e00640 1 -- 172.21.15.84:0/2238929546 learned_addr learned my addr 172.21.15.84:0/2238929546 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb829400640 1 -- 172.21.15.84:0/2238929546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb82c0730e0 msgr2=0x7fb82c13d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb829400640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb82c0730e0 0x7fb82c13d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb829400640 1 -- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb82c144360 msgr2=0x7fb82c133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb829400640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb82c144360 0x7fb82c133920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb829400640 1 -- 172.21.15.84:0/2238929546 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c13ce40 con 0x7fb82c143dd0 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb829e00640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb82c0730e0 0x7fb82c13d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb829400640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c13d7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c3c0 tx=0x7fb81800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb822000640 1 -- 172.21.15.84:0/2238929546 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8180052d0 con 0x7fb82c143dd0 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb822000640 1 -- 172.21.15.84:0/2238929546 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb818005470 con 0x7fb82c143dd0 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c13f1b0 con 0x7fb82c143dd0 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb822000640 1 -- 172.21.15.84:0/2238929546 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818007260 con 0x7fb82c143dd0 2024-03-07T07:31:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c13f770 con 0x7fb82c143dd0 2024-03-07T07:31:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c062d40 con 0x7fb82c143dd0 2024-03-07T07:31:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb822000640 1 -- 172.21.15.84:0/2238929546 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb818007400 con 0x7fb82c143dd0 2024-03-07T07:31:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb822000640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb80c066f90 0x7fb80c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb822000640 1 -- 172.21.15.84:0/2238929546 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb818084360 con 0x7fb82c143dd0 2024-03-07T07:31:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.858+0000 7fb829e00640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb80c066f90 0x7fb80c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.862+0000 7fb829e00640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb80c066f90 0x7fb80c069450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb81c000f90 tx=0x7fb81c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:32.866+0000 7fb822000640 1 -- 172.21.15.84:0/2238929546 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb818054c80 con 0x7fb82c143dd0 2024-03-07T07:31:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.058+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb82c15ad90 con 0x7fb82c143dd0 2024-03-07T07:31:33.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.058+0000 7fb822000640 1 -- 172.21.15.84:0/2238929546 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb818058d20 con 0x7fb82c143dd0 2024-03-07T07:31:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-07T07:31:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb80c066f90 msgr2=0x7fb80c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb80c066f90 0x7fb80c069450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb81c000f90 tx=0x7fb81c0a7070 comp rx=0 tx=0).stop 2024-03-07T07:31:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 msgr2=0x7fb82c13d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c13d7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c3c0 tx=0x7fb81800c880 comp rx=0 tx=0).stop 2024-03-07T07:31:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 shutdown_connections 2024-03-07T07:31:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb80c066f90 0x7fb80c069450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb82c144360 0x7fb82c133920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb82c143dd0 0x7fb82c13d7a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 --2- 172.21.15.84:0/2238929546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb82c0730e0 0x7fb82c13d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 >> 172.21.15.84:0/2238929546 conn(0x7fb82c0704b0 msgr2=0x7fb82c0b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 shutdown_connections 2024-03-07T07:31:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:33.062+0000 7fb831000640 1 -- 172.21.15.84:0/2238929546 wait complete. 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-07T07:31:33.085 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-07T07:31:33.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.086 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-03-07T07:31:33.095 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:31:33.095 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:31:33.095 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:31:33.095 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:33.095 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-03-07T07:31:33.095 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:33.095 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:33.095 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-03-07T07:31:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:33.097 INFO:teuthology.orchestra.run.smithi084.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-07T07:31:33.097 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 02:42:51:43:ce:2d brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:33.097 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-07T07:31:33.097 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:33.097 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-07T07:31:33.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.097 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:33.097 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:33.097 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-03-07T07:31:33.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-03-07T07:31:33.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-03-07T07:31:33.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-07T07:31:33.098 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:33.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.202 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-07T07:31:33.220 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-03-07T07:31:33.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.223 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-03-07T07:31:33.295 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-03-07T07:31:33.295 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-07T07:31:33.296 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-07T07:31:33.296 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-07T07:31:33.296 INFO:teuthology.orchestra.run.smithi084.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-07T07:31:33.296 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-07T07:31:33.296 INFO:teuthology.orchestra.run.smithi084.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:33.296 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:33.296 INFO:teuthology.orchestra.run.smithi084.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:33.296 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-07T07:31:33.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.297 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:33.297 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:33.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-07T07:31:33.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-07T07:31:33.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-07T07:31:33.297 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:33.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.384 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-03-07T07:31:33.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.396 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-03-07T07:31:33.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.449 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:33.449 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:33.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-07T07:31:33.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-07T07:31:33.449 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:33.530 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-07T07:31:33.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.530 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:33.530 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:33.530 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-07T07:31:33.530 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-07T07:31:33.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-07T07:31:33.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-07T07:31:33.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-07T07:31:33.531 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:33.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.696 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:33.697 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:33.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-03-07T07:31:33.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-03-07T07:31:33.697 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:33.735 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:31:33.735 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-07T07:31:33.784 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-07T07:31:33.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:31:33.785 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-07T07:31:33.835 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-07T07:31:33.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:33.835 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:33.931 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:33.931 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:31:34.440 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:34.440 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:31:34.440 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-03-07T07:31:34.440 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@9dc7a008-fd12-4491-ba8d-83bae22f3106.cephfs=/ 2024-03-07T07:31:34.440 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-03-07T07:31:34.444 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-07T07:31:34.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:34.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-07T07:31:34.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:34.465 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:34.539 INFO:teuthology.orchestra.run.smithi084.stdout:client4541 2024-03-07T07:31:34.540 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:31:34.540 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:34.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:34.596 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:34.662 INFO:teuthology.orchestra.run.smithi084.stdout:client4541 2024-03-07T07:31:34.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:34.662 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:34.721 INFO:teuthology.orchestra.run.smithi084.stdout:client4541 2024-03-07T07:31:34.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:34.721 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9dc7a008-fd12-4491-ba8d-83bae22f3106.client4541/status') 2024-03-07T07:31:34.788 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.4541 (3)172.21.15.84:0/3538253072 2024-03-07T07:31:34.788 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2024-03-07T07:31:34.788 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2024-03-07T07:31:34.788 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2024-03-07T07:31:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:70 bytes copied, 6.6872e-05 s, 1.0 MB/s 2024-03-07T07:31:34.790 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-03-07T07:31:34.790 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-07T07:31:34.790 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-07T07:31:34.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-07T07:31:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2ac600640 1 Processor -- start 2024-03-07T07:31:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2ac600640 1 -- start start 2024-03-07T07:31:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2ac600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2a4143dd0 0x7fa2a40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2ac600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa2a4144360 0x7fa2a40729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2ac600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a40cc880 con 0x7fa2a41448b0 2024-03-07T07:31:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2ac600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a41441b0 con 0x7fa2a4143dd0 2024-03-07T07:31:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2ac600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a40cf050 con 0x7fa2a4144360 2024-03-07T07:31:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2a9c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2a4143dd0 0x7fa2a40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:34.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2a9c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2a4143dd0 0x7fa2a40cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41322/0 (socket says 172.21.15.84:41322) 2024-03-07T07:31:34.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2a9c00640 1 -- 172.21.15.84:0/4078776342 learned_addr learned my addr 172.21.15.84:0/4078776342 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:34.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2a9200640 1 --2- 172.21.15.84:0/4078776342 >> v2:172.21.15.161:3300/0 conn(0x7fa2a4144360 0x7fa2a40729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:34.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2a9c00640 1 -- 172.21.15.84:0/4078776342 >> v2:172.21.15.161:3300/0 conn(0x7fa2a4144360 msgr2=0x7fa2a40729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:34.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2a9c00640 1 --2- 172.21.15.84:0/4078776342 >> v2:172.21.15.161:3300/0 conn(0x7fa2a4144360 0x7fa2a40729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:34.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2a9c00640 1 -- 172.21.15.84:0/4078776342 >> v1:172.21.15.161:6789/0 conn(0x7fa2a41448b0 legacy=0x7fa2a415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:34.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.966+0000 7fa2a9c00640 1 -- 172.21.15.84:0/4078776342 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a40ccb60 con 0x7fa2a4143dd0 2024-03-07T07:31:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2a9c00640 1 --2- 172.21.15.84:0/4078776342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4143dd0 0x7fa2a40cdc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4073790 tx=0x7fa29801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31c6345ad03f717 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2a3e00640 1 -- 172.21.15.84:0/4078776342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980a9400 con 0x7fa2a4143dd0 2024-03-07T07:31:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2a3e00640 1 -- 172.21.15.84:0/4078776342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2980a95a0 con 0x7fa2a4143dd0 2024-03-07T07:31:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2a3e00640 1 -- 172.21.15.84:0/4078776342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980a9970 con 0x7fa2a4143dd0 2024-03-07T07:31:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 -- 172.21.15.84:0/4078776342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4143dd0 msgr2=0x7fa2a40cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 --2- 172.21.15.84:0/4078776342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4143dd0 0x7fa2a40cdc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4073790 tx=0x7fa29801c520 comp rx=0 tx=0).stop 2024-03-07T07:31:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 -- 172.21.15.84:0/4078776342 shutdown_connections 2024-03-07T07:31:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 --2- 172.21.15.84:0/4078776342 >> v2:172.21.15.161:3300/0 conn(0x7fa2a4144360 0x7fa2a40729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 --2- 172.21.15.84:0/4078776342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4143dd0 0x7fa2a40cdc00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 -- 172.21.15.84:0/4078776342 >> 172.21.15.84:0/4078776342 conn(0x7fa2a40704b0 msgr2=0x7fa2a40708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 -- 172.21.15.84:0/4078776342 shutdown_connections 2024-03-07T07:31:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 -- 172.21.15.84:0/4078776342 wait complete. 2024-03-07T07:31:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 Processor -- start 2024-03-07T07:31:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.970+0000 7fa2ac600640 1 -- start start 2024-03-07T07:31:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2a4143dd0 0x7fa2a4142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4144360 0x7fa2a413e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a41448b0 0x7fa2a413cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40cd6e0 con 0x7fa2a4144360 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a4073320 con 0x7fa2a41448b0 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a415bf30 con 0x7fa2a4143dd0 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4144360 0x7fa2a413e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4144360 0x7fa2a413e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41334/0 (socket says 172.21.15.84:41334) 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 -- 172.21.15.84:0/3799224527 learned_addr learned my addr 172.21.15.84:0/3799224527 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9c00640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2a4143dd0 0x7fa2a4142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2aa600640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a41448b0 0x7fa2a413cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 -- 172.21.15.84:0/3799224527 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2a4143dd0 msgr2=0x7fa2a4142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2a4143dd0 0x7fa2a4142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 -- 172.21.15.84:0/3799224527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a41448b0 msgr2=0x7fa2a413cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a41448b0 0x7fa2a413cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 -- 172.21.15.84:0/3799224527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a413e920 con 0x7fa2a4144360 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a9200640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4144360 0x7fa2a413e0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa29000d830 tx=0x7fa29000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:34.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a1600640 1 -- 172.21.15.84:0/3799224527 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000b660 con 0x7fa2a4144360 2024-03-07T07:31:34.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a1600640 1 -- 172.21.15.84:0/3799224527 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290019070 con 0x7fa2a4144360 2024-03-07T07:31:34.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a413ec00 con 0x7fa2a4144360 2024-03-07T07:31:34.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a1600640 1 -- 172.21.15.84:0/3799224527 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000ba00 con 0x7fa2a4144360 2024-03-07T07:31:34.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a413f1c0 con 0x7fa2a4144360 2024-03-07T07:31:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a413e670 con 0x7fa2a4144360 2024-03-07T07:31:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.974+0000 7fa2a1600640 1 -- 172.21.15.84:0/3799224527 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa29001e460 con 0x7fa2a4144360 2024-03-07T07:31:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.978+0000 7fa2a1600640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa284066f90 0x7fa284069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.978+0000 7fa2a1600640 1 -- 172.21.15.84:0/3799224527 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa290085550 con 0x7fa2a4144360 2024-03-07T07:31:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.978+0000 7fa2a9c00640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa284066f90 0x7fa284069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.978+0000 7fa2a9c00640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa284066f90 0x7fa284069450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa2980ae000 tx=0x7fa2980b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:34.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:34.982+0000 7fa2a1600640 1 -- 172.21.15.84:0/3799224527 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa290055ef0 con 0x7fa2a4144360 2024-03-07T07:31:35.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.170+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2a4062d40 con 0x7fa2a4144360 2024-03-07T07:31:35.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.170+0000 7fa2a1600640 1 -- 172.21.15.84:0/3799224527 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa290059f90 con 0x7fa2a4144360 2024-03-07T07:31:35.175 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-07T07:31:35.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa284066f90 msgr2=0x7fa284069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa284066f90 0x7fa284069450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa2980ae000 tx=0x7fa2980b3040 comp rx=0 tx=0).stop 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4144360 msgr2=0x7fa2a413e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4144360 0x7fa2a413e0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa29000d830 tx=0x7fa29000dcf0 comp rx=0 tx=0).stop 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 shutdown_connections 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa284066f90 0x7fa284069450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2a41448b0 0x7fa2a413cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a4144360 0x7fa2a413e0d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 --2- 172.21.15.84:0/3799224527 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2a4143dd0 0x7fa2a4142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 >> 172.21.15.84:0/3799224527 conn(0x7fa2a40704b0 msgr2=0x7fa2a406d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 shutdown_connections 2024-03-07T07:31:35.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:35.174+0000 7fa2ac600640 1 -- 172.21.15.84:0/3799224527 wait complete. 2024-03-07T07:31:35.197 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-07T07:31:35.197 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-07T07:31:35.197 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-03-07T07:31:35.198 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-07T07:31:35.198 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-07T07:31:35.198 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-07T07:31:35.198 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-07T07:31:35.198 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-07T07:31:35.198 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-07T07:31:35.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.198 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-03-07T07:31:35.207 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-03-07T07:31:35.208 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42452sec preferred_lft 42452sec 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 02:42:51:43:ce:2d brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:35.209 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-07T07:31:35.210 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.210 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-03-07T07:31:35.210 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.210 INFO:teuthology.orchestra.run.smithi084.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-07T07:31:35.210 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-07T07:31:35.210 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-07T07:31:35.210 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.210 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-07T07:31:35.265 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-03-07T07:31:35.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.267 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-03-07T07:31:35.318 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-03-07T07:31:35.318 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run.smithi084.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run.smithi084.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run.smithi084.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-07T07:31:35.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.319 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:35.320 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:35.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-07T07:31:35.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-07T07:31:35.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-07T07:31:35.320 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:35.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.407 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-03-07T07:31:35.416 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-07T07:31:35.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.417 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-03-07T07:31:35.468 INFO:teuthology.orchestra.run.smithi084.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-07T07:31:35.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.468 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:35.468 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:35.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-07T07:31:35.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-07T07:31:35.469 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:35.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-07T07:31:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:31:35.611 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:31:35.611 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:31:35.611 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.612 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-03-07T07:31:35.612 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-07T07:31:35.612 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 22:53:30:c5:8a:6f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-07T07:31:35.612 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-07T07:31:35.612 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.612 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2053:30ff:fec5:8a6f/64 scope link 2024-03-07T07:31:35.612 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-07T07:31:35.675 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:31:35.675 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:31:35.675 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:31:35.675 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.675 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-03-07T07:31:35.675 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.676 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-07T07:31:35.676 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 22:53:30:c5:8a:6f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-07T07:31:35.676 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-07T07:31:35.676 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.676 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2053:30ff:fec5:8a6f/64 scope link 2024-03-07T07:31:35.676 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:35.677 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-07T07:31:35.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.678 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:35.678 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:35.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-07T07:31:35.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-07T07:31:35.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-07T07:31:35.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-07T07:31:35.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-07T07:31:35.678 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:35.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.813 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:31:35.813 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:31:35.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.1 up 2024-03-07T07:31:35.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.1 master ceph-brx 2024-03-07T07:31:35.813 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:31:35.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:31:35.852 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-07T07:31:35.904 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-07T07:31:35.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:31:35.905 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-07T07:31:35.955 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-03-07T07:31:35.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:35.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:36.044 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:36.044 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:31:36.056 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:36.056 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:31:36.057 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-03-07T07:31:36.057 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 2@9dc7a008-fd12-4491-ba8d-83bae22f3106.cephfs=/ 2024-03-07T07:31:36.057 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.84:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-03-07T07:31:36.060 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-07T07:31:36.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-07T07:31:36.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.080 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:36.138 INFO:teuthology.orchestra.run.smithi084.stdout:client4747 2024-03-07T07:31:36.139 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:31:36.139 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:36.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.188 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:36.243 INFO:teuthology.orchestra.run.smithi084.stdout:client4747 2024-03-07T07:31:36.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.243 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:36.294 INFO:teuthology.orchestra.run.smithi084.stdout:client4747 2024-03-07T07:31:36.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.294 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9dc7a008-fd12-4491-ba8d-83bae22f3106.client4747/status') 2024-03-07T07:31:36.355 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.4747 (3)172.21.15.84:0/2141680180 2024-03-07T07:31:36.355 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2024-03-07T07:31:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2024-03-07T07:31:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2024-03-07T07:31:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:70 bytes copied, 4.8528e-05 s, 1.4 MB/s 2024-03-07T07:31:36.357 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-03-07T07:31:36.357 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-07T07:31:36.357 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-07T07:31:36.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-07T07:31:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353c400640 1 Processor -- start 2024-03-07T07:31:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353c400640 1 -- start start 2024-03-07T07:31:36.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353c400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f35340aef70 0x7f3534168810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:36.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353c400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340af440 con 0x7f35340cef50 2024-03-07T07:31:36.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353c400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340af720 con 0x7f35340729d0 2024-03-07T07:31:36.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353c400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353406d550 con 0x7f35340aef70 2024-03-07T07:31:36.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f3539000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f35340cef50 0x7f35340ad850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44390/0 (socket says 172.21.15.84:44390) 2024-03-07T07:31:36.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f3539000640 1 -- 172.21.15.84:0/1901625270 learned_addr learned my addr 172.21.15.84:0/1901625270 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:36.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353a400640 1 --2- 172.21.15.84:0/1901625270 >> v2:172.21.15.161:3300/0 conn(0x7f35340aef70 0x7f3534168810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:36.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f3533e00640 1 -- 172.21.15.84:0/1901625270 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526168459 0 0) 0x7f35340af440 con 0x7f35340cef50 2024-03-07T07:31:36.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f3533e00640 1 -- 172.21.15.84:0/1901625270 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f351c003530 con 0x7f35340cef50 2024-03-07T07:31:36.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353a400640 1 -- 172.21.15.84:0/1901625270 >> v1:172.21.15.161:6789/0 conn(0x7f35340729d0 legacy=0x7f3534072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:36.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f3533e00640 1 -- 172.21.15.84:0/1901625270 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039612319 0 0) 0x7f35340af720 con 0x7f35340729d0 2024-03-07T07:31:36.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353a400640 1 -- 172.21.15.84:0/1901625270 >> v1:172.21.15.84:6789/0 conn(0x7f35340cef50 legacy=0x7f35340ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:36.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.534+0000 7f353a400640 1 -- 172.21.15.84:0/1901625270 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340cd460 con 0x7f35340aef70 2024-03-07T07:31:36.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f353a400640 1 --2- 172.21.15.84:0/1901625270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 0x7f3534168810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f352c0097c0 tx=0x7f352c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734fcad2a9dc16df server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:36.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f3533e00640 1 -- 172.21.15.84:0/1901625270 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0b5070 con 0x7f35340aef70 2024-03-07T07:31:36.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f3533e00640 1 -- 172.21.15.84:0/1901625270 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c0a8990 con 0x7f35340aef70 2024-03-07T07:31:36.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f3533e00640 1 -- 172.21.15.84:0/1901625270 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0a8d60 con 0x7f35340aef70 2024-03-07T07:31:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f353c400640 1 -- 172.21.15.84:0/1901625270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 msgr2=0x7f3534168810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f353c400640 1 --2- 172.21.15.84:0/1901625270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 0x7f3534168810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f352c0097c0 tx=0x7f352c01ec90 comp rx=0 tx=0).stop 2024-03-07T07:31:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f353c400640 1 -- 172.21.15.84:0/1901625270 shutdown_connections 2024-03-07T07:31:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f353c400640 1 --2- 172.21.15.84:0/1901625270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 0x7f3534168810 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f353c400640 1 -- 172.21.15.84:0/1901625270 >> 172.21.15.84:0/1901625270 conn(0x7f35340704b0 msgr2=0x7f35340708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f353c400640 1 -- 172.21.15.84:0/1901625270 shutdown_connections 2024-03-07T07:31:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.538+0000 7f353c400640 1 -- 172.21.15.84:0/1901625270 wait complete. 2024-03-07T07:31:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 Processor -- start 2024-03-07T07:31:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 -- start start 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35340729d0 0x7f353413e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 0x7f35341403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35340cef50 0x7f353413bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534168d50 con 0x7f35340cef50 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35340cda20 con 0x7f35340aef70 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3534168ed0 con 0x7f35340729d0 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35340cef50 0x7f353413bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f3539000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 0x7f35341403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f3539a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35340729d0 0x7f353413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35340cef50 0x7f353413bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41340/0 (socket says 172.21.15.84:41340) 2024-03-07T07:31:36.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 -- 172.21.15.84:0/780391314 learned_addr learned my addr 172.21.15.84:0/780391314 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 -- 172.21.15.84:0/780391314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35340729d0 msgr2=0x7f353413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35340729d0 0x7f353413e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 -- 172.21.15.84:0/780391314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 msgr2=0x7f35341403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 0x7f35341403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 -- 172.21.15.84:0/780391314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340ae300 con 0x7f35340cef50 2024-03-07T07:31:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353a400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35340cef50 0x7f353413bdf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f352c0097c0 tx=0x7f352c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f3531600640 1 -- 172.21.15.84:0/780391314 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0b5040 con 0x7f35340cef50 2024-03-07T07:31:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f3531600640 1 -- 172.21.15.84:0/780391314 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c004220 con 0x7f35340cef50 2024-03-07T07:31:36.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f3531600640 1 -- 172.21.15.84:0/780391314 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c003620 con 0x7f35340cef50 2024-03-07T07:31:36.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353413f030 con 0x7f35340cef50 2024-03-07T07:31:36.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353413f630 con 0x7f35340cef50 2024-03-07T07:31:36.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.542+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3534062d40 con 0x7f35340cef50 2024-03-07T07:31:36.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.546+0000 7f3531600640 1 -- 172.21.15.84:0/780391314 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f352c0c2060 con 0x7f35340cef50 2024-03-07T07:31:36.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.546+0000 7f3531600640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3514066f60 0x7f3514069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:36.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.546+0000 7f3531600640 1 -- 172.21.15.84:0/780391314 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f352c121650 con 0x7f35340cef50 2024-03-07T07:31:36.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.546+0000 7f3539a00640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3514066f60 0x7f3514069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:36.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.546+0000 7f3539a00640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3514066f60 0x7f3514069420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35280012f0 tx=0x7f3528009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:36.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.550+0000 7f3531600640 1 -- 172.21.15.84:0/780391314 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f352c0187f0 con 0x7f35340cef50 2024-03-07T07:31:36.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.738+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3534140930 con 0x7f35340cef50 2024-03-07T07:31:36.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.738+0000 7f3531600640 1 -- 172.21.15.84:0/780391314 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f352c0f2000 con 0x7f35340cef50 2024-03-07T07:31:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-07T07:31:36.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3514066f60 msgr2=0x7f3514069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:36.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3514066f60 0x7f3514069420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35280012f0 tx=0x7f3528009040 comp rx=0 tx=0).stop 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35340cef50 msgr2=0x7f353413bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35340cef50 0x7f353413bdf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f352c0097c0 tx=0x7f352c01ba30 comp rx=0 tx=0).stop 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 shutdown_connections 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3514066f60 0x7f3514069420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35340cef50 0x7f353413bdf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35340aef70 0x7f35341403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 --2- 172.21.15.84:0/780391314 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35340729d0 0x7f353413e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 >> 172.21.15.84:0/780391314 conn(0x7f35340704b0 msgr2=0x7f35340ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 shutdown_connections 2024-03-07T07:31:36.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:36.742+0000 7f353c400640 1 -- 172.21.15.84:0/780391314 wait complete. 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-07T07:31:36.764 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-07T07:31:36.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.764 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-03-07T07:31:36.773 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:31:36.773 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:31:36.773 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:31:36.773 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:36.773 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-03-07T07:31:36.773 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:36.773 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-03-07T07:31:36.774 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:36.775 INFO:teuthology.orchestra.run.smithi161.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-07T07:31:36.775 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:42:a1:31:1c:4f brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:36.775 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-07T07:31:36.775 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:36.776 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-07T07:31:36.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.776 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:36.776 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:36.776 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2024-03-07T07:31:36.776 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2024-03-07T07:31:36.776 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2024-03-07T07:31:36.776 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-07T07:31:36.776 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:36.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.885 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-07T07:31:36.903 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-03-07T07:31:36.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.905 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-03-07T07:31:36.975 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-03-07T07:31:36.975 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-07T07:31:36.975 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-07T07:31:36.975 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-07T07:31:36.975 INFO:teuthology.orchestra.run.smithi161.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-07T07:31:36.975 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-07T07:31:36.976 INFO:teuthology.orchestra.run.smithi161.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:36.976 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:36.976 INFO:teuthology.orchestra.run.smithi161.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:36.976 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-07T07:31:36.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:36.976 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:36.976 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:36.977 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-07T07:31:36.977 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-07T07:31:36.977 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-07T07:31:36.977 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:37.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:37.067 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-03-07T07:31:37.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:37.076 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-03-07T07:31:37.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:37.126 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:37.126 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:37.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-07T07:31:37.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-07T07:31:37.126 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:37.207 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-07T07:31:37.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:37.207 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:37.208 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:37.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-07T07:31:37.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-07T07:31:37.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-07T07:31:37.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-07T07:31:37.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-07T07:31:37.208 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:37.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:37.368 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:37.368 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:37.368 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-03-07T07:31:37.368 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2024-03-07T07:31:37.368 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:37.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:31:37.408 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-07T07:31:37.457 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-07T07:31:37.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:31:37.458 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-07T07:31:37.509 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-07T07:31:37.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:37.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:37.605 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:37.605 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:31:38.185 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:38.185 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:31:38.185 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-03-07T07:31:38.186 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 1@9dc7a008-fd12-4491-ba8d-83bae22f3106.cephfs=/ 2024-03-07T07:31:38.186 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-03-07T07:31:38.189 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-07T07:31:38.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:38.189 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-07T07:31:38.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:38.209 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:38.278 INFO:teuthology.orchestra.run.smithi161.stdout:client4759 2024-03-07T07:31:38.279 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:31:38.279 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:38.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:38.330 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:38.384 INFO:teuthology.orchestra.run.smithi161.stdout:client4759 2024-03-07T07:31:38.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:38.384 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:38.436 INFO:teuthology.orchestra.run.smithi161.stdout:client4759 2024-03-07T07:31:38.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:38.496 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9dc7a008-fd12-4491-ba8d-83bae22f3106.client4759/status') 2024-03-07T07:31:38.515 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4759 (3)192.168.0.1:0/2557145391 2024-03-07T07:31:38.515 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2024-03-07T07:31:38.516 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2024-03-07T07:31:38.516 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2024-03-07T07:31:38.516 INFO:teuthology.orchestra.run.smithi161.stderr:69 bytes copied, 6.1478e-05 s, 1.1 MB/s 2024-03-07T07:31:38.521 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-03-07T07:31:38.521 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-07T07:31:38.521 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-07T07:31:38.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-07T07:31:38.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b83800640 1 Processor -- start 2024-03-07T07:31:38.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b83800640 1 -- start start 2024-03-07T07:31:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b83800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b7c0730e0 0x7f4b7c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b83800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0cc880 con 0x7f4b7c143dd0 2024-03-07T07:31:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b83800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0ccb60 con 0x7f4b7c144360 2024-03-07T07:31:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b83800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c1441b0 con 0x7f4b7c0730e0 2024-03-07T07:31:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b80e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4b7c143dd0 0x7f4b7c0729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44394/0 (socket says 172.21.15.84:44394) 2024-03-07T07:31:38.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b80e00640 1 -- 172.21.15.84:0/2280402208 learned_addr learned my addr 172.21.15.84:0/2280402208 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:38.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7be00640 1 --2- 172.21.15.84:0/2280402208 >> v2:172.21.15.161:3300/0 conn(0x7f4b7c0730e0 0x7f4b7c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:38.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905585365 0 0) 0x7f4b7c0cc880 con 0x7f4b7c143dd0 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b64005740 con 0x7f4b7c143dd0 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803177788 0 0) 0x7f4b7c0ccb60 con 0x7f4b7c144360 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b7c0cc880 con 0x7f4b7c144360 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3525469208 0 0) 0x7f4b64005740 con 0x7f4b7c143dd0 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 >> v2:172.21.15.161:3300/0 conn(0x7f4b7c0730e0 msgr2=0x7f4b7c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 --2- 172.21.15.84:0/2280402208 >> v2:172.21.15.161:3300/0 conn(0x7f4b7c0730e0 0x7f4b7c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 >> v1:172.21.15.161:6789/0 conn(0x7f4b7c144360 legacy=0x7f4b7c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0cce40 con 0x7f4b7c143dd0 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f4b700016a0 con 0x7f4b7c143dd0 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 >> v1:172.21.15.84:6789/0 conn(0x7f4b7c143dd0 legacy=0x7f4b7c0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b64005d60 0x7f4b64006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b64006a20 0x7f4b64006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b640073e0 0x7f4b6400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6400e230 con 0x7f4b640073e0 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6400e3e0 con 0x7f4b64005d60 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6400e5e0 con 0x7f4b64006a20 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b81800640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b640073e0 0x7f4b6400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b80e00640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b64005d60 0x7f4b64006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b7be00640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b64006a20 0x7f4b64006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b81800640 1 -- 172.21.15.84:0/2280402208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b64006a20 msgr2=0x7f4b64006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b81800640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b64006a20 0x7f4b64006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b81800640 1 -- 172.21.15.84:0/2280402208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b64005d60 msgr2=0x7f4b64006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b81800640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b64005d60 0x7f4b64006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.666+0000 7f4b81800640 1 -- 172.21.15.84:0/2280402208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b64005740 con 0x7f4b640073e0 2024-03-07T07:31:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b81800640 1 -- 172.21.15.84:0/2280402208 reap_dead start 2024-03-07T07:31:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b81800640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b640073e0 0x7f4b6400dbe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b74001fd0 tx=0x7f4b7401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48576f28a7292c02 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74001c20 con 0x7f4b640073e0 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74003b80 con 0x7f4b640073e0 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b7b400640 1 -- 172.21.15.84:0/2280402208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740050d0 con 0x7f4b640073e0 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 -- 172.21.15.84:0/2280402208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b640073e0 msgr2=0x7f4b6400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b640073e0 0x7f4b6400dbe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b74001fd0 tx=0x7f4b7401c900 comp rx=0 tx=0).stop 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 -- 172.21.15.84:0/2280402208 shutdown_connections 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 --2- 172.21.15.84:0/2280402208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b640073e0 0x7f4b6400dbe0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 -- 172.21.15.84:0/2280402208 >> 172.21.15.84:0/2280402208 conn(0x7f4b7c0704b0 msgr2=0x7f4b7c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 -- 172.21.15.84:0/2280402208 shutdown_connections 2024-03-07T07:31:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 -- 172.21.15.84:0/2280402208 wait complete. 2024-03-07T07:31:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 Processor -- start 2024-03-07T07:31:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.670+0000 7f4b83800640 1 -- start start 2024-03-07T07:31:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b640073e0 0x7f4b7c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c1e5820 0x7f4b7c1f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b7c13e050 0x7f4b7c13e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0cd400 con 0x7f4b7c13e050 2024-03-07T07:31:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0cf050 con 0x7f4b7c1e5820 2024-03-07T07:31:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0cd6e0 con 0x7f4b640073e0 2024-03-07T07:31:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b7c13e050 0x7f4b7c13e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b7c13e050 0x7f4b7c13e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41360/0 (socket says 172.21.15.84:41360) 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 -- 172.21.15.84:0/1029152394 learned_addr learned my addr 172.21.15.84:0/1029152394 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b7be00640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c1e5820 0x7f4b7c1f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b80e00640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b640073e0 0x7f4b7c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 -- 172.21.15.84:0/1029152394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b640073e0 msgr2=0x7f4b7c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b640073e0 0x7f4b7c14ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 -- 172.21.15.84:0/1029152394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c1e5820 msgr2=0x7f4b7c1f31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c1e5820 0x7f4b7c1f31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 -- 172.21.15.84:0/1029152394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c1e5de0 con 0x7f4b7c13e050 2024-03-07T07:31:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b81800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b7c13e050 0x7f4b7c13e4d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b7401d1a0 tx=0x7f4b64007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:38.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b78c00640 1 -- 172.21.15.84:0/1029152394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74001c00 con 0x7f4b7c13e050 2024-03-07T07:31:38.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b78c00640 1 -- 172.21.15.84:0/1029152394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74003980 con 0x7f4b7c13e050 2024-03-07T07:31:38.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b78c00640 1 -- 172.21.15.84:0/1029152394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74006d80 con 0x7f4b7c13e050 2024-03-07T07:31:38.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c1e60c0 con 0x7f4b7c13e050 2024-03-07T07:31:38.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c1e6680 con 0x7f4b7c13e050 2024-03-07T07:31:38.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c062d40 con 0x7f4b7c13e050 2024-03-07T07:31:38.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.674+0000 7f4b78c00640 1 -- 172.21.15.84:0/1029152394 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f4b740b6030 con 0x7f4b7c13e050 2024-03-07T07:31:38.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.678+0000 7f4b78c00640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b5c066f90 0x7f4b5c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:38.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.678+0000 7f4b78c00640 1 -- 172.21.15.84:0/1029152394 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b7411ede0 con 0x7f4b7c13e050 2024-03-07T07:31:38.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.678+0000 7f4b80e00640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b5c066f90 0x7f4b5c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:38.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.678+0000 7f4b80e00640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b5c066f90 0x7f4b5c069450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b70000c10 tx=0x7f4b70001120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:38.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.682+0000 7f4b78c00640 1 -- 172.21.15.84:0/1029152394 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f4b74016610 con 0x7f4b7c13e050 2024-03-07T07:31:38.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.866+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b7c15b1f0 con 0x7f4b7c13e050 2024-03-07T07:31:38.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b78c00640 1 -- 172.21.15.84:0/1029152394 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4b740ef700 con 0x7f4b7c13e050 2024-03-07T07:31:38.873 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b5c066f90 msgr2=0x7f4b5c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b5c066f90 0x7f4b5c069450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b70000c10 tx=0x7f4b70001120 comp rx=0 tx=0).stop 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b7c13e050 msgr2=0x7f4b7c13e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b7c13e050 0x7f4b7c13e4d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b7401d1a0 tx=0x7f4b64007a50 comp rx=0 tx=0).stop 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 shutdown_connections 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b5c066f90 0x7f4b5c069450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b7c13e050 0x7f4b7c13e4d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c1e5820 0x7f4b7c1f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 --2- 172.21.15.84:0/1029152394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b640073e0 0x7f4b7c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 >> 172.21.15.84:0/1029152394 conn(0x7f4b7c0704b0 msgr2=0x7f4b7c072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 shutdown_connections 2024-03-07T07:31:38.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:38.874+0000 7f4b83800640 1 -- 172.21.15.84:0/1029152394 wait complete. 2024-03-07T07:31:38.894 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-07T07:31:38.894 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-07T07:31:38.894 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-03-07T07:31:38.895 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-07T07:31:38.895 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-07T07:31:38.895 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-07T07:31:38.895 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-07T07:31:38.895 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-07T07:31:38.895 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-07T07:31:38.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:38.895 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-03-07T07:31:38.904 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-03-07T07:31:38.905 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42452sec preferred_lft 42452sec 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:42:a1:31:1c:4f brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-07T07:31:38.906 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-07T07:31:38.907 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:38.907 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-07T07:31:38.907 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:38.907 INFO:teuthology.orchestra.run.smithi161.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-07T07:31:38.907 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-07T07:31:38.907 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-03-07T07:31:38.907 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:38.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:38.907 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-07T07:31:38.967 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-03-07T07:31:38.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:38.970 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:31:39.020 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-07T07:31:39.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.021 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:39.021 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:39.021 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-07T07:31:39.021 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-07T07:31:39.021 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-07T07:31:39.021 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:39.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.109 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-03-07T07:31:39.117 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-07T07:31:39.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.119 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-03-07T07:31:39.169 INFO:teuthology.orchestra.run.smithi161.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-07T07:31:39.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.170 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:39.170 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:39.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-07T07:31:39.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-07T07:31:39.170 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:39.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.251 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-07T07:31:39.313 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:31:39.313 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:31:39.313 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:31:39.313 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:39.313 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-03-07T07:31:39.313 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:39.313 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-07T07:31:39.314 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 26:e5:10:46:06:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-07T07:31:39.314 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-07T07:31:39.314 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:39.314 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::24e5:10ff:fe46:6cf/64 scope link 2024-03-07T07:31:39.314 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:39.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.315 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-07T07:31:39.377 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:31:39.377 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:31:39.377 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:31:39.377 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:39.377 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-03-07T07:31:39.377 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:39.378 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-07T07:31:39.378 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 26:e5:10:46:06:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-07T07:31:39.378 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-07T07:31:39.378 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:39.378 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::24e5:10ff:fe46:6cf/64 scope link 2024-03-07T07:31:39.378 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:31:39.379 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-07T07:31:39.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.379 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:39.379 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:39.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-07T07:31:39.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-07T07:31:39.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-07T07:31:39.380 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-07T07:31:39.380 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-07T07:31:39.380 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:39.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.515 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-03-07T07:31:39.515 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-03-07T07:31:39.515 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.1 up 2024-03-07T07:31:39.515 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.1 master ceph-brx 2024-03-07T07:31:39.515 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-03-07T07:31:39.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:31:39.552 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-07T07:31:39.601 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-07T07:31:39.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:31:39.602 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-07T07:31:39.653 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-03-07T07:31:39.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:39.741 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:39.741 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:31:39.753 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:31:39.754 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:31:39.754 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-03-07T07:31:39.754 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with new device syntax: 3@9dc7a008-fd12-4491-ba8d-83bae22f3106.cephfs=/ 2024-03-07T07:31:39.754 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.84:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-03-07T07:31:39.757 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-07T07:31:39.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.757 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-07T07:31:39.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.777 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:39.828 INFO:teuthology.orchestra.run.smithi161.stdout:client4771 2024-03-07T07:31:39.828 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:31:39.828 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:39.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.878 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:39.928 INFO:teuthology.orchestra.run.smithi161.stdout:client4771 2024-03-07T07:31:39.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.928 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:31:39.980 INFO:teuthology.orchestra.run.smithi161.stdout:client4771 2024-03-07T07:31:39.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:39.980 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9dc7a008-fd12-4491-ba8d-83bae22f3106.client4771/status') 2024-03-07T07:31:40.040 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4771 (3)192.168.0.2:0/2940184174 2024-03-07T07:31:40.040 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2024-03-07T07:31:40.041 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2024-03-07T07:31:40.041 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2024-03-07T07:31:40.041 INFO:teuthology.orchestra.run.smithi161.stderr:69 bytes copied, 8.7241e-05 s, 791 kB/s 2024-03-07T07:31:40.042 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-07T07:31:40.059 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:40.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6123400640 1 Processor -- start 2024-03-07T07:31:40.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6123400640 1 -- start start 2024-03-07T07:31:40.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6123400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f611c0730e0 0x7f611c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6123400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611c06d780 con 0x7f611c0a9540 2024-03-07T07:31:40.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6123400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611c06da60 con 0x7f611c145a30 2024-03-07T07:31:40.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6123400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611c06dd40 con 0x7f611c0730e0 2024-03-07T07:31:40.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6113e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f611c0a9540 0x7f611c15c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44404/0 (socket says 172.21.15.84:44404) 2024-03-07T07:31:40.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6113e00640 1 -- 172.21.15.84:0/2091908355 learned_addr learned my addr 172.21.15.84:0/2091908355 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:40.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6121400640 1 --2- 172.21.15.84:0/2091908355 >> v2:172.21.15.84:3300/0 conn(0x7f611c0730e0 0x7f611c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f611be00640 1 -- 172.21.15.84:0/2091908355 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583496908 0 0) 0x7f611c06d780 con 0x7f611c0a9540 2024-03-07T07:31:40.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f611be00640 1 -- 172.21.15.84:0/2091908355 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6100003530 con 0x7f611c0a9540 2024-03-07T07:31:40.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f611be00640 1 -- 172.21.15.84:0/2091908355 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448570132 0 0) 0x7f611c06da60 con 0x7f611c145a30 2024-03-07T07:31:40.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f611be00640 1 -- 172.21.15.84:0/2091908355 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f611c06d780 con 0x7f611c145a30 2024-03-07T07:31:40.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6121400640 1 -- 172.21.15.84:0/2091908355 >> v1:172.21.15.161:6789/0 conn(0x7f611c145a30 legacy=0x7f611c0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6121400640 1 -- 172.21.15.84:0/2091908355 >> v1:172.21.15.84:6789/0 conn(0x7f611c0a9540 legacy=0x7f611c15c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.202+0000 7f6121400640 1 -- 172.21.15.84:0/2091908355 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c06e020 con 0x7f611c0730e0 2024-03-07T07:31:40.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f6121400640 1 --2- 172.21.15.84:0/2091908355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c0730e0 0x7f611c15cef0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6114009d90 tx=0x7f611c15dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f01d640c72c896e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f611be00640 1 -- 172.21.15.84:0/2091908355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140b2070 con 0x7f611c0730e0 2024-03-07T07:31:40.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f611be00640 1 -- 172.21.15.84:0/2091908355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61140a5820 con 0x7f611c0730e0 2024-03-07T07:31:40.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f611be00640 1 -- 172.21.15.84:0/2091908355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140a5bf0 con 0x7f611c0730e0 2024-03-07T07:31:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f6123400640 1 -- 172.21.15.84:0/2091908355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c0730e0 msgr2=0x7f611c15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f6123400640 1 --2- 172.21.15.84:0/2091908355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c0730e0 0x7f611c15cef0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6114009d90 tx=0x7f611c15dc40 comp rx=0 tx=0).stop 2024-03-07T07:31:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f6123400640 1 -- 172.21.15.84:0/2091908355 shutdown_connections 2024-03-07T07:31:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f6123400640 1 --2- 172.21.15.84:0/2091908355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c0730e0 0x7f611c15cef0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f6123400640 1 -- 172.21.15.84:0/2091908355 >> 172.21.15.84:0/2091908355 conn(0x7f611c0704b0 msgr2=0x7f611c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f6123400640 1 -- 172.21.15.84:0/2091908355 shutdown_connections 2024-03-07T07:31:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.206+0000 7f6123400640 1 -- 172.21.15.84:0/2091908355 wait complete. 2024-03-07T07:31:40.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 Processor -- start 2024-03-07T07:31:40.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 -- start start 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f611c0730e0 0x7f611c13f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c145a30 0x7f611c0aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c13d750 0x7f611c0acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c169d70 con 0x7f611c145a30 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c169bf0 con 0x7f611c13d750 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c169ef0 con 0x7f611c0730e0 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c145a30 0x7f611c0aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c145a30 0x7f611c0aca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41370/0 (socket says 172.21.15.84:41370) 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 -- 172.21.15.84:0/2728589297 learned_addr learned my addr 172.21.15.84:0/2728589297 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6120a00640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f611c0730e0 0x7f611c13f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6121400640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c13d750 0x7f611c0acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 -- 172.21.15.84:0/2728589297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f611c0730e0 msgr2=0x7f611c13f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f611c0730e0 0x7f611c13f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 -- 172.21.15.84:0/2728589297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c13d750 msgr2=0x7f611c0acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c13d750 0x7f611c0acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 -- 172.21.15.84:0/2728589297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0ac3d0 con 0x7f611c145a30 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6113e00640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c145a30 0x7f611c0aca80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f610400c4d0 tx=0x7f610400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6119600640 1 -- 172.21.15.84:0/2728589297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104017070 con 0x7f611c145a30 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6119600640 1 -- 172.21.15.84:0/2728589297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104005cf0 con 0x7f611c145a30 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6119600640 1 -- 172.21.15.84:0/2728589297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040072b0 con 0x7f611c145a30 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c1574a0 con 0x7f611c145a30 2024-03-07T07:31:40.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.210+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c157a60 con 0x7f611c145a30 2024-03-07T07:31:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.214+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c062d40 con 0x7f611c145a30 2024-03-07T07:31:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.214+0000 7f6119600640 1 -- 172.21.15.84:0/2728589297 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f610401a070 con 0x7f611c145a30 2024-03-07T07:31:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.214+0000 7f6119600640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f60f8066f60 0x7f60f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.214+0000 7f6119600640 1 -- 172.21.15.84:0/2728589297 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6104084450 con 0x7f611c145a30 2024-03-07T07:31:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.214+0000 7f6120a00640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f60f8066f60 0x7f60f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.214+0000 7f6120a00640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f60f8066f60 0x7f60f8069420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f611c0b1a00 tx=0x7f610c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.218+0000 7f6119600640 1 -- 172.21.15.84:0/2728589297 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6104055450 con 0x7f611c145a30 2024-03-07T07:31:40.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.374+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f611c0b2a60 con 0x7f611c145a30 2024-03-07T07:31:40.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6119600640 1 -- 172.21.15.84:0/2728589297 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f6104054d50 con 0x7f611c145a30 2024-03-07T07:31:40.377 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:40.377 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:40.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f60f8066f60 msgr2=0x7f60f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f60f8066f60 0x7f60f8069420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f611c0b1a00 tx=0x7f610c009040 comp rx=0 tx=0).stop 2024-03-07T07:31:40.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c145a30 msgr2=0x7f611c0aca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c145a30 0x7f611c0aca80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f610400c4d0 tx=0x7f610400c990 comp rx=0 tx=0).stop 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 shutdown_connections 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f60f8066f60 0x7f60f8069420 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f611c13d750 0x7f611c0acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f611c145a30 0x7f611c0aca80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 --2- 172.21.15.84:0/2728589297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f611c0730e0 0x7f611c13f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 >> 172.21.15.84:0/2728589297 conn(0x7f611c0704b0 msgr2=0x7f611c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 shutdown_connections 2024-03-07T07:31:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.378+0000 7f6123400640 1 -- 172.21.15.84:0/2728589297 wait complete. 2024-03-07T07:31:40.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:40.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af7a00640 1 Processor -- start 2024-03-07T07:31:40.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af7a00640 1 -- start start 2024-03-07T07:31:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af7a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8af01442a0 0x7f8af00b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af7a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3ec0 0x7f8af006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af7a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af00b51f0 con 0x7f8af00b3350 2024-03-07T07:31:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af7a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af006eec0 con 0x7f8af01442a0 2024-03-07T07:31:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af7a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af006f1a0 con 0x7f8af00b3ec0 2024-03-07T07:31:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3ec0 0x7f8af006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3ec0 0x7f8af006dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:34208/0 (socket says 172.21.15.84:34208) 2024-03-07T07:31:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5a00640 1 -- 172.21.15.84:0/3506963149 learned_addr learned my addr 172.21.15.84:0/3506963149 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8aefe00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8af00b3350 0x7f8af00b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:50636/0 (socket says 172.21.15.84:50636) 2024-03-07T07:31:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5000640 1 --2- 172.21.15.84:0/3506963149 >> v2:172.21.15.161:3300/0 conn(0x7f8af01442a0 0x7f8af00b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8aef400640 1 -- 172.21.15.84:0/3506963149 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506752176 0 0) 0x7f8af00b51f0 con 0x7f8af00b3350 2024-03-07T07:31:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8aef400640 1 -- 172.21.15.84:0/3506963149 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad4003530 con 0x7f8af00b3350 2024-03-07T07:31:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5a00640 1 -- 172.21.15.84:0/3506963149 >> v2:172.21.15.161:3300/0 conn(0x7f8af01442a0 msgr2=0x7f8af00b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5a00640 1 --2- 172.21.15.84:0/3506963149 >> v2:172.21.15.161:3300/0 conn(0x7f8af01442a0 0x7f8af00b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5a00640 1 -- 172.21.15.84:0/3506963149 >> v1:172.21.15.161:6789/0 conn(0x7f8af00b3350 legacy=0x7f8af00b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5a00640 1 -- 172.21.15.84:0/3506963149 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af00cc800 con 0x7f8af00b3ec0 2024-03-07T07:31:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.538+0000 7f8af5000640 1 --2- 172.21.15.84:0/3506963149 >> v2:172.21.15.161:3300/0 conn(0x7f8af01442a0 0x7f8af00b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:40.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af5a00640 1 --2- 172.21.15.84:0/3506963149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3ec0 0x7f8af006dc40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800bb10 tx=0x7f8ae801ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d089711d9ca0316c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8aef400640 1 -- 172.21.15.84:0/3506963149 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80b4070 con 0x7f8af00b3ec0 2024-03-07T07:31:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8aef400640 1 -- 172.21.15.84:0/3506963149 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae80a7c20 con 0x7f8af00b3ec0 2024-03-07T07:31:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8aef400640 1 -- 172.21.15.84:0/3506963149 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80af440 con 0x7f8af00b3ec0 2024-03-07T07:31:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af7a00640 1 -- 172.21.15.84:0/3506963149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3ec0 msgr2=0x7f8af006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af7a00640 1 --2- 172.21.15.84:0/3506963149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3ec0 0x7f8af006dc40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800bb10 tx=0x7f8ae801ec30 comp rx=0 tx=0).stop 2024-03-07T07:31:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af7a00640 1 -- 172.21.15.84:0/3506963149 shutdown_connections 2024-03-07T07:31:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af7a00640 1 --2- 172.21.15.84:0/3506963149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3ec0 0x7f8af006dc40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af7a00640 1 --2- 172.21.15.84:0/3506963149 >> v2:172.21.15.161:3300/0 conn(0x7f8af01442a0 0x7f8af00b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af7a00640 1 -- 172.21.15.84:0/3506963149 >> 172.21.15.84:0/3506963149 conn(0x7f8af00b1c50 msgr2=0x7f8af00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af7a00640 1 -- 172.21.15.84:0/3506963149 shutdown_connections 2024-03-07T07:31:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.542+0000 7f8af7a00640 1 -- 172.21.15.84:0/3506963149 wait complete. 2024-03-07T07:31:40.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 Processor -- start 2024-03-07T07:31:40.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 -- start start 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3350 0x7f8af0141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8af00b3ec0 0x7f8af013b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8af01442a0 0x7f8af013b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af006eb10 con 0x7f8af00b3ec0 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af006e990 con 0x7f8af01442a0 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0072250 con 0x7f8af00b3350 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8af00b3ec0 0x7f8af013b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8af00b3ec0 0x7f8af013b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41372/0 (socket says 172.21.15.84:41372) 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 -- 172.21.15.84:0/78529535 learned_addr learned my addr 172.21.15.84:0/78529535 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af5000640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3350 0x7f8af0141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af5a00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8af01442a0 0x7f8af013b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 -- 172.21.15.84:0/78529535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3350 msgr2=0x7f8af0141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3350 0x7f8af0141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 -- 172.21.15.84:0/78529535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8af01442a0 msgr2=0x7f8af013b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8af01442a0 0x7f8af013b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 -- 172.21.15.84:0/78529535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af013d960 con 0x7f8af00b3ec0 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aefe00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8af00b3ec0 0x7f8af013b060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00c430 tx=0x7f8adc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aecc00640 1 -- 172.21.15.84:0/78529535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0074e0 con 0x7f8af00b3ec0 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aecc00640 1 -- 172.21.15.84:0/78529535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0047f0 con 0x7f8af00b3ec0 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af013dc40 con 0x7f8af00b3ec0 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8aecc00640 1 -- 172.21.15.84:0/78529535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0076a0 con 0x7f8af00b3ec0 2024-03-07T07:31:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.546+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af013e200 con 0x7f8af00b3ec0 2024-03-07T07:31:40.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.550+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af0062d40 con 0x7f8af00b3ec0 2024-03-07T07:31:40.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.550+0000 7f8aecc00640 1 -- 172.21.15.84:0/78529535 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f8adc01a020 con 0x7f8af00b3ec0 2024-03-07T07:31:40.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.550+0000 7f8aecc00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8ad0066f90 0x7f8ad0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.550+0000 7f8aecc00640 1 -- 172.21.15.84:0/78529535 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8adc084840 con 0x7f8af00b3ec0 2024-03-07T07:31:40.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.550+0000 7f8af5000640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8ad0066f90 0x7f8ad0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.550+0000 7f8af5000640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8ad0066f90 0x7f8ad0069450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8af0142330 tx=0x7f8ae000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.554+0000 7f8aecc00640 1 -- 172.21.15.84:0/78529535 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f8adc055160 con 0x7f8af00b3ec0 2024-03-07T07:31:40.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8af0071c80 con 0x7f8af00b3ec0 2024-03-07T07:31:40.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8aecc00640 1 -- 172.21.15.84:0/78529535 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8adc059200 con 0x7f8af00b3ec0 2024-03-07T07:31:40.709 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8ad0066f90 msgr2=0x7f8ad0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8ad0066f90 0x7f8ad0069450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8af0142330 tx=0x7f8ae000b040 comp rx=0 tx=0).stop 2024-03-07T07:31:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8af00b3ec0 msgr2=0x7f8af013b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8af00b3ec0 0x7f8af013b060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00c430 tx=0x7f8adc00c8f0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 shutdown_connections 2024-03-07T07:31:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8ad0066f90 0x7f8ad0069450 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8af01442a0 0x7f8af013b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8af00b3ec0 0x7f8af013b060 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 --2- 172.21.15.84:0/78529535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8af00b3350 0x7f8af0141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 >> 172.21.15.84:0/78529535 conn(0x7f8af00b1c50 msgr2=0x7f8af0143150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 shutdown_connections 2024-03-07T07:31:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.710+0000 7f8af7a00640 1 -- 172.21.15.84:0/78529535 wait complete. 2024-03-07T07:31:40.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5fa1400640 1 Processor -- start 2024-03-07T07:31:40.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5fa1400640 1 -- start start 2024-03-07T07:31:40.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5fa1400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f9c154910 0x7f5f9c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5fa1400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5f9c06f120 0x7f5f9c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5fa1400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c15b920 con 0x7f5f9c15b0a0 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5fa1400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c06e090 con 0x7f5f9c154910 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5fa1400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c06d2d0 con 0x7f5f9c06f120 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5f9a800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f9c154910 0x7f5f9c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5f9b200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5f9c15b0a0 0x7f5f9c15e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44416/0 (socket says 172.21.15.84:44416) 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5f9a800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f9c154910 0x7f5f9c06ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41384/0 (socket says 172.21.15.84:41384) 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5f9b200640 1 -- 172.21.15.84:0/832912341 learned_addr learned my addr 172.21.15.84:0/832912341 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.866+0000 7f5f91e00640 1 --2- 172.21.15.84:0/832912341 >> v2:172.21.15.161:3300/0 conn(0x7f5f9c06f120 0x7f5f9c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f9a800640 1 -- 172.21.15.84:0/832912341 >> v2:172.21.15.161:3300/0 conn(0x7f5f9c06f120 msgr2=0x7f5f9c15ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f9a800640 1 --2- 172.21.15.84:0/832912341 >> v2:172.21.15.161:3300/0 conn(0x7f5f9c06f120 0x7f5f9c15ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f9a800640 1 -- 172.21.15.84:0/832912341 >> v1:172.21.15.84:6789/0 conn(0x7f5f9c15b0a0 legacy=0x7f5f9c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f9a800640 1 -- 172.21.15.84:0/832912341 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c06d5b0 con 0x7f5f9c154910 2024-03-07T07:31:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f99e00640 1 -- 172.21.15.84:0/832912341 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397113815 0 0) 0x7f5f9c15b920 con 0x7f5f9c15b0a0 2024-03-07T07:31:40.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f9a800640 1 --2- 172.21.15.84:0/832912341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c06ebe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0cf250 tx=0x7f5f8c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11ca00e7830c49e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f99e00640 1 -- 172.21.15.84:0/832912341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0b0070 con 0x7f5f9c154910 2024-03-07T07:31:40.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f99e00640 1 -- 172.21.15.84:0/832912341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c0ab600 con 0x7f5f9c154910 2024-03-07T07:31:40.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5f99e00640 1 -- 172.21.15.84:0/832912341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0ab9d0 con 0x7f5f9c154910 2024-03-07T07:31:40.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5fa1400640 1 -- 172.21.15.84:0/832912341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 msgr2=0x7f5f9c06ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5fa1400640 1 --2- 172.21.15.84:0/832912341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c06ebe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0cf250 tx=0x7f5f8c01c480 comp rx=0 tx=0).stop 2024-03-07T07:31:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5fa1400640 1 -- 172.21.15.84:0/832912341 shutdown_connections 2024-03-07T07:31:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5fa1400640 1 --2- 172.21.15.84:0/832912341 >> v2:172.21.15.161:3300/0 conn(0x7f5f9c06f120 0x7f5f9c15ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5fa1400640 1 --2- 172.21.15.84:0/832912341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c06ebe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.870+0000 7f5fa1400640 1 -- 172.21.15.84:0/832912341 >> 172.21.15.84:0/832912341 conn(0x7f5f9c0b1c50 msgr2=0x7f5f9c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 -- 172.21.15.84:0/832912341 shutdown_connections 2024-03-07T07:31:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 -- 172.21.15.84:0/832912341 wait complete. 2024-03-07T07:31:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 Processor -- start 2024-03-07T07:31:40.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 -- start start 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c06f120 0x7f5f9c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c0b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c15b0a0 0x7f5f9c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c154e70 con 0x7f5f9c154910 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c154cf0 con 0x7f5f9c06f120 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c15b4b0 con 0x7f5f9c15b0a0 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c0b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c0b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41396/0 (socket says 172.21.15.84:41396) 2024-03-07T07:31:40.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 -- 172.21.15.84:0/1837254237 learned_addr learned my addr 172.21.15.84:0/1837254237 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f9a800640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c06f120 0x7f5f9c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f9b200640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c15b0a0 0x7f5f9c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 -- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c15b0a0 msgr2=0x7f5f9c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c15b0a0 0x7f5f9c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 -- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c06f120 msgr2=0x7f5f9c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c06f120 0x7f5f9c13fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 -- 172.21.15.84:0/1837254237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c0a96f0 con 0x7f5f9c154910 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f9b200640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c15b0a0 0x7f5f9c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f91e00640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c0b4a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400e870 tx=0x7f5f8400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f93400640 1 -- 172.21.15.84:0/1837254237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84017070 con 0x7f5f9c154910 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f93400640 1 -- 172.21.15.84:0/1837254237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8400c940 con 0x7f5f9c154910 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c0b3760 con 0x7f5f9c154910 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5f93400640 1 -- 172.21.15.84:0/1837254237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400ccf0 con 0x7f5f9c154910 2024-03-07T07:31:40.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.874+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c0b3d20 con 0x7f5f9c154910 2024-03-07T07:31:40.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.878+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c062d40 con 0x7f5f9c154910 2024-03-07T07:31:40.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.878+0000 7f5f93400640 1 -- 172.21.15.84:0/1837254237 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f5f8401a070 con 0x7f5f9c154910 2024-03-07T07:31:40.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.878+0000 7f5f93400640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5f78066f60 0x7f5f78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:40.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.878+0000 7f5f93400640 1 -- 172.21.15.84:0/1837254237 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f84084ea0 con 0x7f5f9c154910 2024-03-07T07:31:40.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.878+0000 7f5f9a800640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5f78066f60 0x7f5f78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:40.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.878+0000 7f5f9a800640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5f78066f60 0x7f5f78069420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0ad000 tx=0x7f5f8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:40.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:40.882+0000 7f5f93400640 1 -- 172.21.15.84:0/1837254237 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f5f840557d0 con 0x7f5f9c154910 2024-03-07T07:31:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.038+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f9c06e790 con 0x7f5f9c154910 2024-03-07T07:31:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.038+0000 7f5f93400640 1 -- 172.21.15.84:0/1837254237 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f84059870 con 0x7f5f9c154910 2024-03-07T07:31:41.040 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5f78066f60 msgr2=0x7f5f78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5f78066f60 0x7f5f78069420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0ad000 tx=0x7f5f8c008040 comp rx=0 tx=0).stop 2024-03-07T07:31:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 msgr2=0x7f5f9c0b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c0b4a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400e870 tx=0x7f5f8400ec70 comp rx=0 tx=0).stop 2024-03-07T07:31:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 shutdown_connections 2024-03-07T07:31:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5f78066f60 0x7f5f78069420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f9c15b0a0 0x7f5f9c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f9c154910 0x7f5f9c0b4a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 --2- 172.21.15.84:0/1837254237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f9c06f120 0x7f5f9c13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 >> 172.21.15.84:0/1837254237 conn(0x7f5f9c0b1c50 msgr2=0x7f5f9c0b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 shutdown_connections 2024-03-07T07:31:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.042+0000 7f5fa1400640 1 -- 172.21.15.84:0/1837254237 wait complete. 2024-03-07T07:31:41.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7294200640 1 Processor -- start 2024-03-07T07:31:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7294200640 1 -- start start 2024-03-07T07:31:41.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7294200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f728c15f640 0x7f728c09a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7294200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c06cbc0 con 0x7f728c09af20 2024-03-07T07:31:41.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7294200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c06cea0 con 0x7f728c0b4660 2024-03-07T07:31:41.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7294200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c09b390 con 0x7f728c15f640 2024-03-07T07:31:41.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7292200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f728c09af20 0x7f728c06c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44424/0 (socket says 172.21.15.84:44424) 2024-03-07T07:31:41.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7292200640 1 -- 172.21.15.84:0/4100510446 learned_addr learned my addr 172.21.15.84:0/4100510446 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:41.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7291800640 1 --2- 172.21.15.84:0/4100510446 >> v2:172.21.15.161:3300/0 conn(0x7f728c15f640 0x7f728c09a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f728be00640 1 -- 172.21.15.84:0/4100510446 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538610586 0 0) 0x7f728c06cbc0 con 0x7f728c09af20 2024-03-07T07:31:41.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f728be00640 1 -- 172.21.15.84:0/4100510446 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7274003530 con 0x7f728c09af20 2024-03-07T07:31:41.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f728be00640 1 -- 172.21.15.84:0/4100510446 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781084551 0 0) 0x7f728c06cea0 con 0x7f728c0b4660 2024-03-07T07:31:41.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7291800640 1 -- 172.21.15.84:0/4100510446 >> v1:172.21.15.161:6789/0 conn(0x7f728c0b4660 legacy=0x7f728c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7291800640 1 -- 172.21.15.84:0/4100510446 >> v1:172.21.15.84:6789/0 conn(0x7f728c09af20 legacy=0x7f728c06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.198+0000 7f7291800640 1 -- 172.21.15.84:0/4100510446 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c06d180 con 0x7f728c15f640 2024-03-07T07:31:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f7291800640 1 --2- 172.21.15.84:0/4100510446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 0x7f728c09a9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f72800097c0 tx=0x7f728001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df3bc3261c26921a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f728be00640 1 -- 172.21.15.84:0/4100510446 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800b0070 con 0x7f728c15f640 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f728be00640 1 -- 172.21.15.84:0/4100510446 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72800ab600 con 0x7f728c15f640 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f728be00640 1 -- 172.21.15.84:0/4100510446 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800ab9b0 con 0x7f728c15f640 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f7294200640 1 -- 172.21.15.84:0/4100510446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 msgr2=0x7f728c09a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f7294200640 1 --2- 172.21.15.84:0/4100510446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 0x7f728c09a9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f72800097c0 tx=0x7f728001c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f7294200640 1 -- 172.21.15.84:0/4100510446 shutdown_connections 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f7294200640 1 --2- 172.21.15.84:0/4100510446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 0x7f728c09a9e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f7294200640 1 -- 172.21.15.84:0/4100510446 >> 172.21.15.84:0/4100510446 conn(0x7f728c0b3b40 msgr2=0x7f728c0b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:41.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f7294200640 1 -- 172.21.15.84:0/4100510446 shutdown_connections 2024-03-07T07:31:41.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.202+0000 7f7294200640 1 -- 172.21.15.84:0/4100510446 wait complete. 2024-03-07T07:31:41.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 Processor -- start 2024-03-07T07:31:41.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 -- start start 2024-03-07T07:31:41.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c09af20 0x7f728c14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c0b4660 0x7f728c14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 0x7f728c14fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0ce470 con 0x7f728c09af20 2024-03-07T07:31:41.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0ce2f0 con 0x7f728c15f640 2024-03-07T07:31:41.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0cccf0 con 0x7f728c0b4660 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c09af20 0x7f728c14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c09af20 0x7f728c14d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41406/0 (socket says 172.21.15.84:41406) 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 -- 172.21.15.84:0/3632486017 learned_addr learned my addr 172.21.15.84:0/3632486017 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7290e00640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c0b4660 0x7f728c14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7292200640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 0x7f728c14fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 -- 172.21.15.84:0/3632486017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c0b4660 msgr2=0x7f728c14dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c0b4660 0x7f728c14dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 -- 172.21.15.84:0/3632486017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 msgr2=0x7f728c14fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 0x7f728c14fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 -- 172.21.15.84:0/3632486017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c073640 con 0x7f728c09af20 2024-03-07T07:31:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7291800640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c09af20 0x7f728c14d070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72800ae040 tx=0x7f728001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7289600640 1 -- 172.21.15.84:0/3632486017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800b0050 con 0x7f728c09af20 2024-03-07T07:31:41.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7289600640 1 -- 172.21.15.84:0/3632486017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72800b1040 con 0x7f728c09af20 2024-03-07T07:31:41.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c14ffb0 con 0x7f728c09af20 2024-03-07T07:31:41.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7289600640 1 -- 172.21.15.84:0/3632486017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800b5810 con 0x7f728c09af20 2024-03-07T07:31:41.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.206+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c0b1780 con 0x7f728c09af20 2024-03-07T07:31:41.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.210+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c062d40 con 0x7f728c09af20 2024-03-07T07:31:41.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.210+0000 7f7289600640 1 -- 172.21.15.84:0/3632486017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f72800be030 con 0x7f728c09af20 2024-03-07T07:31:41.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.210+0000 7f7289600640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f726c066f60 0x7f726c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.210+0000 7f7289600640 1 -- 172.21.15.84:0/3632486017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f728011f090 con 0x7f728c09af20 2024-03-07T07:31:41.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.210+0000 7f7290e00640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f726c066f60 0x7f726c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.210+0000 7f7290e00640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f726c066f60 0x7f726c069420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f728c14dd20 tx=0x7f7278009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.214+0000 7f7289600640 1 -- 172.21.15.84:0/3632486017 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f72800c5020 con 0x7f728c09af20 2024-03-07T07:31:41.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:31:41.236 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:31:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.370+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f728c15e510 con 0x7f728c09af20 2024-03-07T07:31:41.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.370+0000 7f7289600640 1 -- 172.21.15.84:0/3632486017 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7280016090 con 0x7f728c09af20 2024-03-07T07:31:41.372 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f726c066f60 msgr2=0x7f726c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f726c066f60 0x7f726c069420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f728c14dd20 tx=0x7f7278009040 comp rx=0 tx=0).stop 2024-03-07T07:31:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c09af20 msgr2=0x7f728c14d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c09af20 0x7f728c14d070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72800ae040 tx=0x7f728001ace0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 shutdown_connections 2024-03-07T07:31:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f726c066f60 0x7f726c069420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c15f640 0x7f728c14fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c0b4660 0x7f728c14dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 --2- 172.21.15.84:0/3632486017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c09af20 0x7f728c14d070 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 >> 172.21.15.84:0/3632486017 conn(0x7f728c0b3b40 msgr2=0x7f728c0b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 shutdown_connections 2024-03-07T07:31:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.374+0000 7f7294200640 1 -- 172.21.15.84:0/3632486017 wait complete. 2024-03-07T07:31:41.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:41.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.526+0000 7fb8e9200640 1 Processor -- start 2024-03-07T07:31:41.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.526+0000 7fb8e9200640 1 -- start start 2024-03-07T07:31:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8e9200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8e40a9540 0x7fb8e415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8e9200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e406d780 con 0x7fb8e4145a30 2024-03-07T07:31:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8e9200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e406da60 con 0x7fb8e40730e0 2024-03-07T07:31:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8e9200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e406dd40 con 0x7fb8e40a9540 2024-03-07T07:31:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8e1e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb8e4145a30 0x7fb8e40729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44436/0 (socket says 172.21.15.84:44436) 2024-03-07T07:31:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8e1e00640 1 -- 172.21.15.84:0/603745896 learned_addr learned my addr 172.21.15.84:0/603745896 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:41.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8d9400640 1 --2- 172.21.15.84:0/603745896 >> v2:172.21.15.161:3300/0 conn(0x7fb8e40a9540 0x7fb8e415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8e1400640 1 -- 172.21.15.84:0/603745896 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130652491 0 0) 0x7fb8e406d780 con 0x7fb8e4145a30 2024-03-07T07:31:41.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8e1400640 1 -- 172.21.15.84:0/603745896 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c8003530 con 0x7fb8e4145a30 2024-03-07T07:31:41.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8d9400640 1 -- 172.21.15.84:0/603745896 >> v1:172.21.15.161:6789/0 conn(0x7fb8e40730e0 legacy=0x7fb8e415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8d9400640 1 -- 172.21.15.84:0/603745896 >> v1:172.21.15.84:6789/0 conn(0x7fb8e4145a30 legacy=0x7fb8e40729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.530+0000 7fb8d9400640 1 -- 172.21.15.84:0/603745896 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e406e020 con 0x7fb8e40a9540 2024-03-07T07:31:41.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8d9400640 1 --2- 172.21.15.84:0/603745896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40a9540 0x7fb8e415c7e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097c0 tx=0x7fb8e415dc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30437a57fb1d1a3e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e1400640 1 -- 172.21.15.84:0/603745896 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0b0070 con 0x7fb8e40a9540 2024-03-07T07:31:41.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e1400640 1 -- 172.21.15.84:0/603745896 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0ab600 con 0x7fb8e40a9540 2024-03-07T07:31:41.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e1400640 1 -- 172.21.15.84:0/603745896 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0ab9d0 con 0x7fb8e40a9540 2024-03-07T07:31:41.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- 172.21.15.84:0/603745896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40a9540 msgr2=0x7fb8e415c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 --2- 172.21.15.84:0/603745896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40a9540 0x7fb8e415c7e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097c0 tx=0x7fb8e415dc40 comp rx=0 tx=0).stop 2024-03-07T07:31:41.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- 172.21.15.84:0/603745896 shutdown_connections 2024-03-07T07:31:41.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 --2- 172.21.15.84:0/603745896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40a9540 0x7fb8e415c7e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- 172.21.15.84:0/603745896 >> 172.21.15.84:0/603745896 conn(0x7fb8e40704b0 msgr2=0x7fb8e40708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:41.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- 172.21.15.84:0/603745896 shutdown_connections 2024-03-07T07:31:41.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- 172.21.15.84:0/603745896 wait complete. 2024-03-07T07:31:41.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 Processor -- start 2024-03-07T07:31:41.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- start start 2024-03-07T07:31:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40730e0 0x7fb8e4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8e4145a30 0x7fb8e415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4155870 0x7fb8e4155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4169d70 con 0x7fb8e4155870 2024-03-07T07:31:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4169bf0 con 0x7fb8e40730e0 2024-03-07T07:31:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e9200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4169ef0 con 0x7fb8e4145a30 2024-03-07T07:31:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4155870 0x7fb8e4155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e1e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40730e0 0x7fb8e4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4155870 0x7fb8e4155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41420/0 (socket says 172.21.15.84:41420) 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8e2800640 1 -- 172.21.15.84:0/1535355905 learned_addr learned my addr 172.21.15.84:0/1535355905 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.534+0000 7fb8d9400640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8e4145a30 0x7fb8e415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e1e00640 1 -- 172.21.15.84:0/1535355905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8e4145a30 msgr2=0x7fb8e415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e1e00640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8e4145a30 0x7fb8e415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e1e00640 1 -- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4155870 msgr2=0x7fb8e4155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e1e00640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4155870 0x7fb8e4155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e1e00640 1 -- 172.21.15.84:0/1535355905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e413eef0 con 0x7fb8e40730e0 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e2800640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4155870 0x7fb8e4155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e1e00640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40730e0 0x7fb8e4152f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400caa0 tx=0x7fb8d400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8daa00640 1 -- 172.21.15.84:0/1535355905 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4017070 con 0x7fb8e40730e0 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8daa00640 1 -- 172.21.15.84:0/1535355905 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d400ac00 con 0x7fb8e40730e0 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e415ab30 con 0x7fb8e40730e0 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8daa00640 1 -- 172.21.15.84:0/1535355905 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4012400 con 0x7fb8e40730e0 2024-03-07T07:31:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e415b0f0 con 0x7fb8e40730e0 2024-03-07T07:31:41.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e4062d40 con 0x7fb8e40730e0 2024-03-07T07:31:41.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8daa00640 1 -- 172.21.15.84:0/1535355905 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb8d401a070 con 0x7fb8e40730e0 2024-03-07T07:31:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8daa00640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8c0066f60 0x7fb8c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8daa00640 1 -- 172.21.15.84:0/1535355905 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8d4084b70 con 0x7fb8e40730e0 2024-03-07T07:31:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.538+0000 7fb8d9400640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8c0066f60 0x7fb8c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.542+0000 7fb8d9400640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8c0066f60 0x7fb8c0069420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0ad000 tx=0x7fb8cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.542+0000 7fb8daa00640 1 -- 172.21.15.84:0/1535355905 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb8d40555a0 con 0x7fb8e40730e0 2024-03-07T07:31:41.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.698+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8e40b2c10 con 0x7fb8e40730e0 2024-03-07T07:31:41.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.698+0000 7fb8daa00640 1 -- 172.21.15.84:0/1535355905 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7fb8d4059640 con 0x7fb8e40730e0 2024-03-07T07:31:41.700 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:41.700 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:41.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8c0066f60 msgr2=0x7fb8c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8c0066f60 0x7fb8c0069420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0ad000 tx=0x7fb8cc008040 comp rx=0 tx=0).stop 2024-03-07T07:31:41.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40730e0 msgr2=0x7fb8e4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40730e0 0x7fb8e4152f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400caa0 tx=0x7fb8d400cf60 comp rx=0 tx=0).stop 2024-03-07T07:31:41.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 shutdown_connections 2024-03-07T07:31:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8c0066f60 0x7fb8c0069420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4155870 0x7fb8e4155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8e4145a30 0x7fb8e415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 --2- 172.21.15.84:0/1535355905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8e40730e0 0x7fb8e4152f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 >> 172.21.15.84:0/1535355905 conn(0x7fb8e40704b0 msgr2=0x7fb8e415e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 shutdown_connections 2024-03-07T07:31:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.702+0000 7fb8e9200640 1 -- 172.21.15.84:0/1535355905 wait complete. 2024-03-07T07:31:41.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:41.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:41.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.858+0000 7ff83f200640 1 Processor -- start 2024-03-07T07:31:41.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.858+0000 7ff83f200640 1 -- start start 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff83f200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff83815c3d0 0x7ff8380cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff83f200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 0x7ff8380724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff83f200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8380b4a60 con 0x7ff838145090 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff83f200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8380cddc0 con 0x7ff83815c3d0 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff83f200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380b4d40 con 0x7ff8380cd950 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff837e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff838145090 0x7ff8380cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41204/0 (socket says 172.21.15.84:41204) 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff82f400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff83815c3d0 0x7ff8380cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff837e00640 1 -- 172.21.15.84:0/22860647 learned_addr learned my addr 172.21.15.84:0/22860647 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff83d200640 1 --2- 172.21.15.84:0/22860647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 0x7ff8380724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff82f400640 1 -- 172.21.15.84:0/22860647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 msgr2=0x7ff8380724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:41.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff82f400640 1 --2- 172.21.15.84:0/22860647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 0x7ff8380724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff82f400640 1 -- 172.21.15.84:0/22860647 >> v1:172.21.15.84:6789/0 conn(0x7ff838145090 legacy=0x7ff8380cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff82f400640 1 -- 172.21.15.84:0/22860647 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8380719c0 con 0x7ff83815c3d0 2024-03-07T07:31:41.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff837400640 1 -- 172.21.15.84:0/22860647 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902189144 0 0) 0x7ff8380b4a60 con 0x7ff838145090 2024-03-07T07:31:41.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff82f400640 1 --2- 172.21.15.84:0/22860647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff8380cd410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8200097c0 tx=0x7ff82001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa10174184911012 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff837400640 1 -- 172.21.15.84:0/22860647 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8200a7070 con 0x7ff83815c3d0 2024-03-07T07:31:41.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff837400640 1 -- 172.21.15.84:0/22860647 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8200b0070 con 0x7ff83815c3d0 2024-03-07T07:31:41.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.862+0000 7ff837400640 1 -- 172.21.15.84:0/22860647 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8200ab890 con 0x7ff83815c3d0 2024-03-07T07:31:41.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- 172.21.15.84:0/22860647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 msgr2=0x7ff8380cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 --2- 172.21.15.84:0/22860647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff8380cd410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8200097c0 tx=0x7ff82001c470 comp rx=0 tx=0).stop 2024-03-07T07:31:41.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- 172.21.15.84:0/22860647 shutdown_connections 2024-03-07T07:31:41.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 --2- 172.21.15.84:0/22860647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 0x7ff8380724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 --2- 172.21.15.84:0/22860647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff8380cd410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- 172.21.15.84:0/22860647 >> 172.21.15.84:0/22860647 conn(0x7ff8380b1c50 msgr2=0x7ff8380b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:41.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- 172.21.15.84:0/22860647 shutdown_connections 2024-03-07T07:31:41.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- 172.21.15.84:0/22860647 wait complete. 2024-03-07T07:31:41.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 Processor -- start 2024-03-07T07:31:41.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- start start 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 0x7ff838166170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff838145090 0x7ff83813f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff83815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838145830 con 0x7ff83815c3d0 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380b4710 con 0x7ff838145090 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83f200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8381459b0 con 0x7ff8380cd950 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff83815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff83815ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42972/0 (socket says 172.21.15.84:42972) 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83d200640 1 -- 172.21.15.84:0/2213650363 learned_addr learned my addr 172.21.15.84:0/2213650363 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff82f400640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff838145090 0x7ff83813f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff837e00640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 0x7ff838166170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83d200640 1 -- 172.21.15.84:0/2213650363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 msgr2=0x7ff838166170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83d200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 0x7ff838166170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83d200640 1 -- 172.21.15.84:0/2213650363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff838145090 msgr2=0x7ff83813f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83d200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff838145090 0x7ff83813f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.866+0000 7ff83d200640 1 -- 172.21.15.84:0/2213650363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83806d2d0 con 0x7ff83815c3d0 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff83d200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff83815ae50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff83000e930 tx=0x7ff83000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff834c00640 1 -- 172.21.15.84:0/2213650363 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830017070 con 0x7ff83815c3d0 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff834c00640 1 -- 172.21.15.84:0/2213650363 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83000c9a0 con 0x7ff83815c3d0 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83813eb60 con 0x7ff83815c3d0 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff834c00640 1 -- 172.21.15.84:0/2213650363 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000cd70 con 0x7ff83815c3d0 2024-03-07T07:31:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83813ee40 con 0x7ff83815c3d0 2024-03-07T07:31:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff838062d40 con 0x7ff83815c3d0 2024-03-07T07:31:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff834c00640 1 -- 172.21.15.84:0/2213650363 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7ff83001a070 con 0x7ff83815c3d0 2024-03-07T07:31:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff834c00640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff814066f60 0x7ff814069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff834c00640 1 -- 172.21.15.84:0/2213650363 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff830084f10 con 0x7ff83815c3d0 2024-03-07T07:31:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff837e00640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff814066f60 0x7ff814069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.870+0000 7ff837e00640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff814066f60 0x7ff814069420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8280012f0 tx=0x7ff828009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:41.874+0000 7ff834c00640 1 -- 172.21.15.84:0/2213650363 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7ff830055a20 con 0x7ff83815c3d0 2024-03-07T07:31:42.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.030+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff83813c4a0 con 0x7ff83815c3d0 2024-03-07T07:31:42.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.030+0000 7ff834c00640 1 -- 172.21.15.84:0/2213650363 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff830059ac0 con 0x7ff83815c3d0 2024-03-07T07:31:42.031 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff814066f60 msgr2=0x7ff814069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff814066f60 0x7ff814069420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8280012f0 tx=0x7ff828009040 comp rx=0 tx=0).stop 2024-03-07T07:31:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 msgr2=0x7ff83815ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff83815ae50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff83000e930 tx=0x7ff83000edf0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 shutdown_connections 2024-03-07T07:31:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff814066f60 0x7ff814069420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff83815c3d0 0x7ff83815ae50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff838145090 0x7ff83813f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 --2- 172.21.15.84:0/2213650363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8380cd950 0x7ff838166170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 >> 172.21.15.84:0/2213650363 conn(0x7ff8380b1c50 msgr2=0x7ff838142a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 shutdown_connections 2024-03-07T07:31:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.034+0000 7ff83f200640 1 -- 172.21.15.84:0/2213650363 wait complete. 2024-03-07T07:31:42.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:42.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f3a05200640 1 Processor -- start 2024-03-07T07:31:42.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f3a05200640 1 -- start start 2024-03-07T07:31:42.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f3a05200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a0015c3d0 0x7f3a000cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f3a05200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a000cd950 0x7f3a000724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f3a05200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a000b4a60 con 0x7f3a00145090 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f3a05200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a000cddc0 con 0x7f3a0015c3d0 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f3a05200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a000b4d40 con 0x7f3a000cd950 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f39fde00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3a00145090 0x7f3a000cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33170/0 (socket says 172.21.15.84:33170) 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f39fde00640 1 -- 172.21.15.84:0/1261414374 learned_addr learned my addr 172.21.15.84:0/1261414374 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f39fe800640 1 --2- 172.21.15.84:0/1261414374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a000cd950 0x7f3a000724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.190+0000 7f39fd400640 1 --2- 172.21.15.84:0/1261414374 >> v2:172.21.15.161:3300/0 conn(0x7f3a0015c3d0 0x7f3a000cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fca00640 1 -- 172.21.15.84:0/1261414374 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101464598 0 0) 0x7f3a000b4a60 con 0x7f3a00145090 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fe800640 1 -- 172.21.15.84:0/1261414374 >> v2:172.21.15.161:3300/0 conn(0x7f3a0015c3d0 msgr2=0x7f3a000cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fe800640 1 --2- 172.21.15.84:0/1261414374 >> v2:172.21.15.161:3300/0 conn(0x7f3a0015c3d0 0x7f3a000cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fe800640 1 -- 172.21.15.84:0/1261414374 >> v1:172.21.15.161:6789/0 conn(0x7f3a00145090 legacy=0x7f3a000cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fe800640 1 -- 172.21.15.84:0/1261414374 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000719c0 con 0x7f3a000cd950 2024-03-07T07:31:42.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fe800640 1 --2- 172.21.15.84:0/1261414374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a000cd950 0x7f3a000724a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009d90 tx=0x7f39f801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c6bb27853759f23 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fca00640 1 -- 172.21.15.84:0/1261414374 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80b2070 con 0x7f3a000cd950 2024-03-07T07:31:42.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fca00640 1 -- 172.21.15.84:0/1261414374 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f80a5a00 con 0x7f3a000cd950 2024-03-07T07:31:42.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f39fca00640 1 -- 172.21.15.84:0/1261414374 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80a5dd0 con 0x7f3a000cd950 2024-03-07T07:31:42.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f3a05200640 1 -- 172.21.15.84:0/1261414374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a000cd950 msgr2=0x7f3a000724a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.194+0000 7f3a05200640 1 --2- 172.21.15.84:0/1261414374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a000cd950 0x7f3a000724a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009d90 tx=0x7f39f801c940 comp rx=0 tx=0).stop 2024-03-07T07:31:42.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- 172.21.15.84:0/1261414374 shutdown_connections 2024-03-07T07:31:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 --2- 172.21.15.84:0/1261414374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a000cd950 0x7f3a000724a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 --2- 172.21.15.84:0/1261414374 >> v2:172.21.15.161:3300/0 conn(0x7f3a0015c3d0 0x7f3a000cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- 172.21.15.84:0/1261414374 >> 172.21.15.84:0/1261414374 conn(0x7f3a000b1c50 msgr2=0x7f3a000b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- 172.21.15.84:0/1261414374 shutdown_connections 2024-03-07T07:31:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- 172.21.15.84:0/1261414374 wait complete. 2024-03-07T07:31:42.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 Processor -- start 2024-03-07T07:31:42.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- start start 2024-03-07T07:31:42.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a000cd950 0x7f3a001f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a00145090 0x7f3a0015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a0015c3d0 0x7f3a00139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a00145830 con 0x7f3a000cd950 2024-03-07T07:31:42.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a000b4710 con 0x7f3a00145090 2024-03-07T07:31:42.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a001459b0 con 0x7f3a0015c3d0 2024-03-07T07:31:42.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a000cd950 0x7f3a001f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a000cd950 0x7f3a001f7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42978/0 (socket says 172.21.15.84:42978) 2024-03-07T07:31:42.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 -- 172.21.15.84:0/2097029603 learned_addr learned my addr 172.21.15.84:0/2097029603 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:42.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fe800640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a0015c3d0 0x7f3a00139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fd400640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a00145090 0x7f3a0015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 -- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a0015c3d0 msgr2=0x7f3a00139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a0015c3d0 0x7f3a00139a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 -- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a00145090 msgr2=0x7f3a0015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a00145090 0x7f3a0015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 -- 172.21.15.84:0/2097029603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0013a310 con 0x7f3a000cd950 2024-03-07T07:31:42.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fe800640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a0015c3d0 0x7f3a00139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:42.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39fde00640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a000cd950 0x7f3a001f7bc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f39e800c480 tx=0x7f39e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39f6000640 1 -- 172.21.15.84:0/2097029603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8005cf0 con 0x7f3a000cd950 2024-03-07T07:31:42.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39f6000640 1 -- 172.21.15.84:0/2097029603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e8007070 con 0x7f3a000cd950 2024-03-07T07:31:42.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a001f70e0 con 0x7f3a000cd950 2024-03-07T07:31:42.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.198+0000 7f39f6000640 1 -- 172.21.15.84:0/2097029603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e80074a0 con 0x7f3a000cd950 2024-03-07T07:31:42.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.202+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a00139f70 con 0x7f3a000cd950 2024-03-07T07:31:42.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.202+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a00062d40 con 0x7f3a000cd950 2024-03-07T07:31:42.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.202+0000 7f39f6000640 1 -- 172.21.15.84:0/2097029603 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f39e801b400 con 0x7f3a000cd950 2024-03-07T07:31:42.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.202+0000 7f39f6000640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39dc066f60 0x7f39dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.202+0000 7f39f6000640 1 -- 172.21.15.84:0/2097029603 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39e8084c10 con 0x7f3a000cd950 2024-03-07T07:31:42.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.202+0000 7f39fd400640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39dc066f60 0x7f39dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.202+0000 7f39fd400640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39dc066f60 0x7f39dc069420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3a0015bed0 tx=0x7f39f0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.206+0000 7f39f6000640 1 -- 172.21.15.84:0/2097029603 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f39e80555c0 con 0x7f3a000cd950 2024-03-07T07:31:42.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a00144180 con 0x7f3a000cd950 2024-03-07T07:31:42.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f39f6000640 1 -- 172.21.15.84:0/2097029603 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39e8059660 con 0x7f3a000cd950 2024-03-07T07:31:42.369 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39dc066f60 msgr2=0x7f39dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39dc066f60 0x7f39dc069420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3a0015bed0 tx=0x7f39f0009190 comp rx=0 tx=0).stop 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a000cd950 msgr2=0x7f3a001f7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a000cd950 0x7f3a001f7bc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f39e800c480 tx=0x7f39e800c940 comp rx=0 tx=0).stop 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 shutdown_connections 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39dc066f60 0x7f39dc069420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a0015c3d0 0x7f3a00139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a00145090 0x7f3a0015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 --2- 172.21.15.84:0/2097029603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a000cd950 0x7f3a001f7bc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 >> 172.21.15.84:0/2097029603 conn(0x7f3a000b1c50 msgr2=0x7f3a00141300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 shutdown_connections 2024-03-07T07:31:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.370+0000 7f3a05200640 1 -- 172.21.15.84:0/2097029603 wait complete. 2024-03-07T07:31:42.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:42.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff7600640 1 Processor -- start 2024-03-07T07:31:42.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff7600640 1 -- start start 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff7600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ff015e1b0 0x7f5ff00ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff7600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ff015e590 0x7f5ff00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff7600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff015f6a0 con 0x7f5ff00b0510 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff7600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff015ea20 con 0x7f5ff015e590 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff7600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff015ed00 con 0x7f5ff015e1b0 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5fe7e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ff015e590 0x7f5ff00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff5600640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5ff00b0510 0x7f5ff00704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41218/0 (socket says 172.21.15.84:41218) 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5fe7e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ff015e590 0x7f5ff00affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42990/0 (socket says 172.21.15.84:42990) 2024-03-07T07:31:42.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff5600640 1 -- 172.21.15.84:0/1814743698 learned_addr learned my addr 172.21.15.84:0/1814743698 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:42.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5ff4c00640 1 --2- 172.21.15.84:0/1814743698 >> v2:172.21.15.161:3300/0 conn(0x7f5ff015e1b0 0x7f5ff00ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5fe7e00640 1 -- 172.21.15.84:0/1814743698 >> v2:172.21.15.161:3300/0 conn(0x7f5ff015e1b0 msgr2=0x7f5ff00ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:42.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5fe7e00640 1 --2- 172.21.15.84:0/1814743698 >> v2:172.21.15.161:3300/0 conn(0x7f5ff015e1b0 0x7f5ff00ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5fe7e00640 1 -- 172.21.15.84:0/1814743698 >> v1:172.21.15.84:6789/0 conn(0x7f5ff00b0510 legacy=0x7f5ff00704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5fe7e00640 1 -- 172.21.15.84:0/1814743698 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff015efe0 con 0x7f5ff015e590 2024-03-07T07:31:42.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.530+0000 7f5fefe00640 1 -- 172.21.15.84:0/1814743698 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104129394 0 0) 0x7f5ff015f6a0 con 0x7f5ff00b0510 2024-03-07T07:31:42.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5fe7e00640 1 --2- 172.21.15.84:0/1814743698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e590 0x7f5ff00affd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ff006f7c0 tx=0x7f5fd801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c9b8315d92f3e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5fefe00640 1 -- 172.21.15.84:0/1814743698 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80ab610 con 0x7f5ff015e590 2024-03-07T07:31:42.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5fefe00640 1 -- 172.21.15.84:0/1814743698 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd80b0070 con 0x7f5ff015e590 2024-03-07T07:31:42.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5fefe00640 1 -- 172.21.15.84:0/1814743698 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80ab9d0 con 0x7f5ff015e590 2024-03-07T07:31:42.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 -- 172.21.15.84:0/1814743698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e590 msgr2=0x7f5ff00affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 --2- 172.21.15.84:0/1814743698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e590 0x7f5ff00affd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ff006f7c0 tx=0x7f5fd801c3f0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 -- 172.21.15.84:0/1814743698 shutdown_connections 2024-03-07T07:31:42.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 --2- 172.21.15.84:0/1814743698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e590 0x7f5ff00affd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 --2- 172.21.15.84:0/1814743698 >> v2:172.21.15.161:3300/0 conn(0x7f5ff015e1b0 0x7f5ff00ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 -- 172.21.15.84:0/1814743698 >> 172.21.15.84:0/1814743698 conn(0x7f5ff0071600 msgr2=0x7f5ff0071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:42.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 -- 172.21.15.84:0/1814743698 shutdown_connections 2024-03-07T07:31:42.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 -- 172.21.15.84:0/1814743698 wait complete. 2024-03-07T07:31:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 Processor -- start 2024-03-07T07:31:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.534+0000 7f5ff7600640 1 -- start start 2024-03-07T07:31:42.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ff00b0510 0x7f5ff015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e1b0 0x7f5ff0154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff01550b0 0x7f5ff015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff006edf0 con 0x7f5ff015e1b0 2024-03-07T07:31:42.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff006ef70 con 0x7f5ff01550b0 2024-03-07T07:31:42.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff006f0f0 con 0x7f5ff00b0510 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e1b0 0x7f5ff0154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e1b0 0x7f5ff0154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42992/0 (socket says 172.21.15.84:42992) 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 -- 172.21.15.84:0/204148706 learned_addr learned my addr 172.21.15.84:0/204148706 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff4c00640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ff00b0510 0x7f5ff015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff5600640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff01550b0 0x7f5ff015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 -- 172.21.15.84:0/204148706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ff00b0510 msgr2=0x7f5ff015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ff00b0510 0x7f5ff015cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 -- 172.21.15.84:0/204148706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff01550b0 msgr2=0x7f5ff015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff01550b0 0x7f5ff015af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 -- 172.21.15.84:0/204148706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff01555a0 con 0x7f5ff015e1b0 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fe7e00640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e1b0 0x7f5ff0154b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8019000 tx=0x7f5fd8019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fed600640 1 -- 172.21.15.84:0/204148706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8004220 con 0x7f5ff015e1b0 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fed600640 1 -- 172.21.15.84:0/204148706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd80043c0 con 0x7f5ff015e1b0 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fed600640 1 -- 172.21.15.84:0/204148706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80abb00 con 0x7f5ff015e1b0 2024-03-07T07:31:42.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff0155880 con 0x7f5ff015e1b0 2024-03-07T07:31:42.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff0155e40 con 0x7f5ff015e1b0 2024-03-07T07:31:42.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff0062d40 con 0x7f5ff015e1b0 2024-03-07T07:31:42.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.538+0000 7f5fed600640 1 -- 172.21.15.84:0/204148706 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f5fd80abca0 con 0x7f5ff015e1b0 2024-03-07T07:31:42.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.542+0000 7f5fed600640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5fcc066f90 0x7f5fcc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.542+0000 7f5fed600640 1 -- 172.21.15.84:0/204148706 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fd811f2b0 con 0x7f5ff015e1b0 2024-03-07T07:31:42.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.542+0000 7f5ff4c00640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5fcc066f90 0x7f5fcc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.542+0000 7f5ff4c00640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5fcc066f90 0x7f5fcc069450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009b60 tx=0x7f5fe0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.546+0000 7f5fed600640 1 -- 172.21.15.84:0/204148706 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f5fd80b9070 con 0x7f5ff015e1b0 2024-03-07T07:31:42.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.698+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ff00722d0 con 0x7f5ff015e1b0 2024-03-07T07:31:42.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.698+0000 7f5fed600640 1 -- 172.21.15.84:0/204148706 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fd80a8050 con 0x7f5ff015e1b0 2024-03-07T07:31:42.699 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5fcc066f90 msgr2=0x7f5fcc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5fcc066f90 0x7f5fcc069450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009b60 tx=0x7f5fe0009190 comp rx=0 tx=0).stop 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e1b0 msgr2=0x7f5ff0154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e1b0 0x7f5ff0154b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8019000 tx=0x7f5fd8019190 comp rx=0 tx=0).stop 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 shutdown_connections 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5fcc066f90 0x7f5fcc069450 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ff01550b0 0x7f5ff015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ff015e1b0 0x7f5ff0154b70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 --2- 172.21.15.84:0/204148706 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ff00b0510 0x7f5ff015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 >> 172.21.15.84:0/204148706 conn(0x7f5ff0071600 msgr2=0x7f5ff00b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:42.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 shutdown_connections 2024-03-07T07:31:42.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.702+0000 7f5ff7600640 1 -- 172.21.15.84:0/204148706 wait complete. 2024-03-07T07:31:42.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:42.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3707e00640 1 Processor -- start 2024-03-07T07:31:42.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3707e00640 1 -- start start 2024-03-07T07:31:42.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3707e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3700144360 0x7f37000cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3707e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37000cc880 con 0x7f3700143dd0 2024-03-07T07:31:42.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3707e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37000ccb60 con 0x7f37000730e0 2024-03-07T07:31:42.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3707e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37001441b0 con 0x7f3700144360 2024-03-07T07:31:42.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3705e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3700144360 0x7f37000cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3705400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3700143dd0 0x7f37000729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41222/0 (socket says 172.21.15.84:41222) 2024-03-07T07:31:42.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3705400640 1 -- 172.21.15.84:0/1500106052 learned_addr learned my addr 172.21.15.84:0/1500106052 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:42.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3705e00640 1 --2- 172.21.15.84:0/1500106052 >> v2:172.21.15.84:3300/0 conn(0x7f3700144360 0x7f37000cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43008/0 (socket says 172.21.15.84:43008) 2024-03-07T07:31:42.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3705e00640 1 -- 172.21.15.84:0/1500106052 >> v1:172.21.15.161:6789/0 conn(0x7f37000730e0 legacy=0x7f370015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3705e00640 1 -- 172.21.15.84:0/1500106052 >> v1:172.21.15.84:6789/0 conn(0x7f3700143dd0 legacy=0x7f37000729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.854+0000 7f3705e00640 1 -- 172.21.15.84:0/1500106052 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000cce40 con 0x7f3700144360 2024-03-07T07:31:42.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f3705e00640 1 --2- 172.21.15.84:0/1500106052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700144360 0x7f37000cdc00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f36f800ba60 tx=0x7f36f801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afa752d165dddb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f36ffe00640 1 -- 172.21.15.84:0/1500106052 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80b4070 con 0x7f3700144360 2024-03-07T07:31:42.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f36ffe00640 1 -- 172.21.15.84:0/1500106052 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f80a7b60 con 0x7f3700144360 2024-03-07T07:31:42.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f36ffe00640 1 -- 172.21.15.84:0/1500106052 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80af440 con 0x7f3700144360 2024-03-07T07:31:42.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f3707e00640 1 -- 172.21.15.84:0/1500106052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700144360 msgr2=0x7f37000cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f3707e00640 1 --2- 172.21.15.84:0/1500106052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700144360 0x7f37000cdc00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f36f800ba60 tx=0x7f36f801eb70 comp rx=0 tx=0).stop 2024-03-07T07:31:42.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f3707e00640 1 -- 172.21.15.84:0/1500106052 shutdown_connections 2024-03-07T07:31:42.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f3707e00640 1 --2- 172.21.15.84:0/1500106052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700144360 0x7f37000cdc00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f3707e00640 1 -- 172.21.15.84:0/1500106052 >> 172.21.15.84:0/1500106052 conn(0x7f37000704b0 msgr2=0x7f37000708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:42.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f3707e00640 1 -- 172.21.15.84:0/1500106052 shutdown_connections 2024-03-07T07:31:42.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.858+0000 7f3707e00640 1 -- 172.21.15.84:0/1500106052 wait complete. 2024-03-07T07:31:42.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 Processor -- start 2024-03-07T07:31:42.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 -- start start 2024-03-07T07:31:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37000730e0 0x7f3700153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700143dd0 0x7f37000b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3700144360 0x7f37001416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370015bf30 con 0x7f3700143dd0 2024-03-07T07:31:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000cf050 con 0x7f37000730e0 2024-03-07T07:31:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370015c0b0 con 0x7f3700144360 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700143dd0 0x7f37000b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700143dd0 0x7f37000b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43022/0 (socket says 172.21.15.84:43022) 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 -- 172.21.15.84:0/3181203473 learned_addr learned my addr 172.21.15.84:0/3181203473 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3705400640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37000730e0 0x7f3700153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3705e00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3700144360 0x7f37001416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 -- 172.21.15.84:0/3181203473 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3700144360 msgr2=0x7f37001416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3700144360 0x7f37001416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 -- 172.21.15.84:0/3181203473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37000730e0 msgr2=0x7f3700153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37000730e0 0x7f3700153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 -- 172.21.15.84:0/3181203473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37001580e0 con 0x7f3700143dd0 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3704a00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700143dd0 0x7f37000b1090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00c500 tx=0x7f36ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f36fd600640 1 -- 172.21.15.84:0/3181203473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec016020 con 0x7f3700143dd0 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f36fd600640 1 -- 172.21.15.84:0/3181203473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec005220 con 0x7f3700143dd0 2024-03-07T07:31:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f36fd600640 1 -- 172.21.15.84:0/3181203473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec007030 con 0x7f3700143dd0 2024-03-07T07:31:42.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3700158380 con 0x7f3700143dd0 2024-03-07T07:31:42.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.862+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37001589c0 con 0x7f3700143dd0 2024-03-07T07:31:42.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.866+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3700062d40 con 0x7f3700143dd0 2024-03-07T07:31:42.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.866+0000 7f36fd600640 1 -- 172.21.15.84:0/3181203473 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f36ec0071f0 con 0x7f3700143dd0 2024-03-07T07:31:42.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.866+0000 7f36fd600640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f36e0066f60 0x7f36e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:42.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.866+0000 7f36fd600640 1 -- 172.21.15.84:0/3181203473 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36ec084920 con 0x7f3700143dd0 2024-03-07T07:31:42.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.866+0000 7f3705400640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f36e0066f60 0x7f36e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:42.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.866+0000 7f3705400640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f36e0066f60 0x7f36e0069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f36f40012f0 tx=0x7f36f4001a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:42.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:42.870+0000 7f36fd600640 1 -- 172.21.15.84:0/3181203473 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f36ec020020 con 0x7f3700143dd0 2024-03-07T07:31:43.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.026+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3700139890 con 0x7f3700143dd0 2024-03-07T07:31:43.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f36fd600640 1 -- 172.21.15.84:0/3181203473 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f36ec055250 con 0x7f3700143dd0 2024-03-07T07:31:43.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:43.029 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:43.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f36e0066f60 msgr2=0x7f36e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f36e0066f60 0x7f36e0069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f36f40012f0 tx=0x7f36f4001a40 comp rx=0 tx=0).stop 2024-03-07T07:31:43.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700143dd0 msgr2=0x7f37000b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700143dd0 0x7f37000b1090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00c500 tx=0x7f36ec00c9c0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 shutdown_connections 2024-03-07T07:31:43.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f36e0066f60 0x7f36e0069420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3700144360 0x7f37001416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3700143dd0 0x7f37000b1090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 --2- 172.21.15.84:0/3181203473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37000730e0 0x7f3700153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 >> 172.21.15.84:0/3181203473 conn(0x7f37000704b0 msgr2=0x7f37000ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:43.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 shutdown_connections 2024-03-07T07:31:43.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.030+0000 7f3707e00640 1 -- 172.21.15.84:0/3181203473 wait complete. 2024-03-07T07:31:43.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:43.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:43.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.186+0000 7fa60ea00640 1 Processor -- start 2024-03-07T07:31:43.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.186+0000 7fa60ea00640 1 -- start start 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.186+0000 7fa60ea00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa608145090 0x7fa6080cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.186+0000 7fa60ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa60815c3d0 0x7fa6080cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.186+0000 7fa60ea00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6080cdd70 con 0x7fa6080cd950 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.186+0000 7fa60ea00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6080b4a60 con 0x7fa608145090 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.186+0000 7fa60ea00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6080b4d40 con 0x7fa60815c3d0 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa608145090 0x7fa6080cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa608145090 0x7fa6080cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43030/0 (socket says 172.21.15.84:43030) 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607e00640 1 -- 172.21.15.84:0/3684874673 learned_addr learned my addr 172.21.15.84:0/3684874673 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa5ff400640 1 --2- 172.21.15.84:0/3684874673 >> v2:172.21.15.161:3300/0 conn(0x7fa60815c3d0 0x7fa6080cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607e00640 1 -- 172.21.15.84:0/3684874673 >> v2:172.21.15.161:3300/0 conn(0x7fa60815c3d0 msgr2=0x7fa6080cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607e00640 1 --2- 172.21.15.84:0/3684874673 >> v2:172.21.15.161:3300/0 conn(0x7fa60815c3d0 0x7fa6080cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607e00640 1 -- 172.21.15.84:0/3684874673 >> v1:172.21.15.161:6789/0 conn(0x7fa6080cd950 legacy=0x7fa60815f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607e00640 1 -- 172.21.15.84:0/3684874673 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080719c0 con 0x7fa608145090 2024-03-07T07:31:43.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607e00640 1 --2- 172.21.15.84:0/3684874673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa608145090 0x7fa6080cf540 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa608160a60 tx=0x7fa5f801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26057177c6d8b2a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607400640 1 -- 172.21.15.84:0/3684874673 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b2070 con 0x7fa608145090 2024-03-07T07:31:43.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607400640 1 -- 172.21.15.84:0/3684874673 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80ad680 con 0x7fa608145090 2024-03-07T07:31:43.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.190+0000 7fa607400640 1 -- 172.21.15.84:0/3684874673 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80ada50 con 0x7fa608145090 2024-03-07T07:31:43.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- 172.21.15.84:0/3684874673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa608145090 msgr2=0x7fa6080cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 --2- 172.21.15.84:0/3684874673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa608145090 0x7fa6080cf540 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa608160a60 tx=0x7fa5f801c460 comp rx=0 tx=0).stop 2024-03-07T07:31:43.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- 172.21.15.84:0/3684874673 shutdown_connections 2024-03-07T07:31:43.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 --2- 172.21.15.84:0/3684874673 >> v2:172.21.15.161:3300/0 conn(0x7fa60815c3d0 0x7fa6080cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 --2- 172.21.15.84:0/3684874673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa608145090 0x7fa6080cf540 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- 172.21.15.84:0/3684874673 >> 172.21.15.84:0/3684874673 conn(0x7fa6080b1c50 msgr2=0x7fa6080b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:43.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- 172.21.15.84:0/3684874673 shutdown_connections 2024-03-07T07:31:43.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- 172.21.15.84:0/3684874673 wait complete. 2024-03-07T07:31:43.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 Processor -- start 2024-03-07T07:31:43.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- start start 2024-03-07T07:31:43.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6080cd950 0x7fa608141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa608145090 0x7fa60815ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa60815c3d0 0x7fa60813ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080b4710 con 0x7fa6080cd950 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080cfa80 con 0x7fa60815c3d0 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608145830 con 0x7fa608145090 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6080cd950 0x7fa608141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6080cd950 0x7fa608141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43032/0 (socket says 172.21.15.84:43032) 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 -- 172.21.15.84:0/894658974 learned_addr learned my addr 172.21.15.84:0/894658974 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa60ca00640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa60815c3d0 0x7fa60813ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa5ff400640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa608145090 0x7fa60815ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 -- 172.21.15.84:0/894658974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa608145090 msgr2=0x7fa60815ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa608145090 0x7fa60815ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 -- 172.21.15.84:0/894658974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa60815c3d0 msgr2=0x7fa60813ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa60815c3d0 0x7fa60813ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 -- 172.21.15.84:0/894658974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60815f280 con 0x7fa6080cd950 2024-03-07T07:31:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.194+0000 7fa607e00640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6080cd950 0x7fa608141390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5f801a090 tx=0x7fa5f801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa604c00640 1 -- 172.21.15.84:0/894658974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b2040 con 0x7fa6080cd950 2024-03-07T07:31:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa604c00640 1 -- 172.21.15.84:0/894658974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80bd070 con 0x7fa6080cd950 2024-03-07T07:31:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa604c00640 1 -- 172.21.15.84:0/894658974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80addb0 con 0x7fa6080cd950 2024-03-07T07:31:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa60ea00640 1 -- 172.21.15.84:0/894658974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60815f560 con 0x7fa6080cd950 2024-03-07T07:31:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa60ea00640 1 -- 172.21.15.84:0/894658974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60815fb20 con 0x7fa6080cd950 2024-03-07T07:31:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa5fd600640 1 -- 172.21.15.84:0/894658974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d80052a0 con 0x7fa6080cd950 2024-03-07T07:31:43.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa604c00640 1 -- 172.21.15.84:0/894658974 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa5f80c2460 con 0x7fa6080cd950 2024-03-07T07:31:43.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa604c00640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa604c00640 1 -- 172.21.15.84:0/894658974 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5f811f050 con 0x7fa6080cd950 2024-03-07T07:31:43.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa5ff400640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.198+0000 7fa5ff400640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa5e4066f60 0x7fa5e4069420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6081405e0 tx=0x7fa5f0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.202+0000 7fa604c00640 1 -- 172.21.15.84:0/894658974 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa5f8016110 con 0x7fa6080cd950 2024-03-07T07:31:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 -- 172.21.15.84:0/894658974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5d8005860 con 0x7fa6080cd950 2024-03-07T07:31:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa604c00640 1 -- 172.21.15.84:0/894658974 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5f80ad650 con 0x7fa6080cd950 2024-03-07T07:31:43.358 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 -- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa5e4066f60 msgr2=0x7fa5e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa5e4066f60 0x7fa5e4069420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6081405e0 tx=0x7fa5f0009190 comp rx=0 tx=0).stop 2024-03-07T07:31:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 -- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6080cd950 msgr2=0x7fa608141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6080cd950 0x7fa608141390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5f801a090 tx=0x7fa5f801aca0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 -- 172.21.15.84:0/894658974 shutdown_connections 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa60815c3d0 0x7fa60813ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa608145090 0x7fa60815ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 --2- 172.21.15.84:0/894658974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6080cd950 0x7fa608141390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.358+0000 7fa5fd600640 1 -- 172.21.15.84:0/894658974 >> 172.21.15.84:0/894658974 conn(0x7fa6080b1c50 msgr2=0x7fa6081440d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.362+0000 7fa5fd600640 1 -- 172.21.15.84:0/894658974 shutdown_connections 2024-03-07T07:31:43.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.362+0000 7fa5fd600640 1 -- 172.21.15.84:0/894658974 wait complete. 2024-03-07T07:31:43.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:43.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3217000640 1 Processor -- start 2024-03-07T07:31:43.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3217000640 1 -- start start 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3217000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32100cebb0 0x7f32100d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3217000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32100b2b60 0x7f32100b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3217000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3210071530 con 0x7f321015c140 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3217000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3210070a00 con 0x7f32100cebb0 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3217000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321015d130 con 0x7f32100b2b60 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3215c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32100cebb0 0x7f32100d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3215c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32100cebb0 0x7f32100d0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43044/0 (socket says 172.21.15.84:43044) 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3215200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f321015c140 0x7f3210070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41228/0 (socket says 172.21.15.84:41228) 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3215c00640 1 -- 172.21.15.84:0/2001825654 learned_addr learned my addr 172.21.15.84:0/2001825654 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:43.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3216600640 1 --2- 172.21.15.84:0/2001825654 >> v2:172.21.15.161:3300/0 conn(0x7f32100b2b60 0x7f32100b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3215c00640 1 -- 172.21.15.84:0/2001825654 >> v2:172.21.15.161:3300/0 conn(0x7f32100b2b60 msgr2=0x7f32100b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:43.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3215c00640 1 --2- 172.21.15.84:0/2001825654 >> v2:172.21.15.161:3300/0 conn(0x7f32100b2b60 0x7f32100b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3215c00640 1 -- 172.21.15.84:0/2001825654 >> v1:172.21.15.84:6789/0 conn(0x7f321015c140 legacy=0x7f3210070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f3215c00640 1 -- 172.21.15.84:0/2001825654 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100b34d0 con 0x7f32100cebb0 2024-03-07T07:31:43.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.518+0000 7f320fe00640 1 -- 172.21.15.84:0/2001825654 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714218353 0 0) 0x7f3210071530 con 0x7f321015c140 2024-03-07T07:31:43.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3215c00640 1 --2- 172.21.15.84:0/2001825654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32100d0310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f32100d0c10 tx=0x7f320401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265cb35406907cee server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f320fe00640 1 -- 172.21.15.84:0/2001825654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040a5820 con 0x7f32100cebb0 2024-03-07T07:31:43.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f320fe00640 1 -- 172.21.15.84:0/2001825654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32040a59c0 con 0x7f32100cebb0 2024-03-07T07:31:43.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f320fe00640 1 -- 172.21.15.84:0/2001825654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040a5d90 con 0x7f32100cebb0 2024-03-07T07:31:43.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 -- 172.21.15.84:0/2001825654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 msgr2=0x7f32100d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 --2- 172.21.15.84:0/2001825654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32100d0310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f32100d0c10 tx=0x7f320401c960 comp rx=0 tx=0).stop 2024-03-07T07:31:43.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 -- 172.21.15.84:0/2001825654 shutdown_connections 2024-03-07T07:31:43.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 --2- 172.21.15.84:0/2001825654 >> v2:172.21.15.161:3300/0 conn(0x7f32100b2b60 0x7f32100b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 --2- 172.21.15.84:0/2001825654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32100d0310 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 -- 172.21.15.84:0/2001825654 >> 172.21.15.84:0/2001825654 conn(0x7f3210072ae0 msgr2=0x7f3210072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:43.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 -- 172.21.15.84:0/2001825654 shutdown_connections 2024-03-07T07:31:43.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 -- 172.21.15.84:0/2001825654 wait complete. 2024-03-07T07:31:43.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 Processor -- start 2024-03-07T07:31:43.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.522+0000 7f3217000640 1 -- start start 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32100b2b60 0x7f321014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32101f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f321015c140 0x7f321015ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321006e3e0 con 0x7f32100cebb0 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321015ce50 con 0x7f32100b2b60 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3210168b20 con 0x7f321015c140 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32101f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32101f6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43048/0 (socket says 172.21.15.84:43048) 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 -- 172.21.15.84:0/3726573851 learned_addr learned my addr 172.21.15.84:0/3726573851 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3216600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f321015c140 0x7f321015ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215c00640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32100b2b60 0x7f321014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 -- 172.21.15.84:0/3726573851 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f321015c140 msgr2=0x7f321015ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f321015c140 0x7f321015ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 -- 172.21.15.84:0/3726573851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32100b2b60 msgr2=0x7f321014b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32100b2b60 0x7f321014b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 -- 172.21.15.84:0/3726573851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321014d210 con 0x7f32100cebb0 2024-03-07T07:31:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215c00640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32100b2b60 0x7f321014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3215200640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32101f6dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c480 tx=0x7f31fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f320d600640 1 -- 172.21.15.84:0/3726573851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc018070 con 0x7f32100cebb0 2024-03-07T07:31:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f320d600640 1 -- 172.21.15.84:0/3726573851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc007500 con 0x7f32100cebb0 2024-03-07T07:31:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f320d600640 1 -- 172.21.15.84:0/3726573851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc004a30 con 0x7f32100cebb0 2024-03-07T07:31:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321014d4f0 con 0x7f32100cebb0 2024-03-07T07:31:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321014dab0 con 0x7f32100cebb0 2024-03-07T07:31:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32100b5b20 con 0x7f32100cebb0 2024-03-07T07:31:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.526+0000 7f320d600640 1 -- 172.21.15.84:0/3726573851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f31fc01b070 con 0x7f32100cebb0 2024-03-07T07:31:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.530+0000 7f320d600640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f31f0066f60 0x7f31f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.530+0000 7f320d600640 1 -- 172.21.15.84:0/3726573851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31fc084350 con 0x7f32100cebb0 2024-03-07T07:31:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.530+0000 7f3215c00640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f31f0066f60 0x7f31f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.530+0000 7f3215c00640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f31f0066f60 0x7f31f0069420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f32040ae000 tx=0x7f32040a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.534+0000 7f320d600640 1 -- 172.21.15.84:0/3726573851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f31fc054d10 con 0x7f32100cebb0 2024-03-07T07:31:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.686+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f321006f7a0 con 0x7f32100cebb0 2024-03-07T07:31:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f320d600640 1 -- 172.21.15.84:0/3726573851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31fc058db0 con 0x7f32100cebb0 2024-03-07T07:31:43.689 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f31f0066f60 msgr2=0x7f31f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f31f0066f60 0x7f31f0069420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f32040ae000 tx=0x7f32040a7070 comp rx=0 tx=0).stop 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 msgr2=0x7f32101f6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32101f6dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c480 tx=0x7f31fc00c940 comp rx=0 tx=0).stop 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 shutdown_connections 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f31f0066f60 0x7f31f0069420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f321015c140 0x7f321015ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32100cebb0 0x7f32101f6dd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 --2- 172.21.15.84:0/3726573851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32100b2b60 0x7f321014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 >> 172.21.15.84:0/3726573851 conn(0x7f3210072ae0 msgr2=0x7f321015f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 shutdown_connections 2024-03-07T07:31:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.690+0000 7f3217000640 1 -- 172.21.15.84:0/3726573851 wait complete. 2024-03-07T07:31:43.710 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:43.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.846+0000 7f7c5c600640 1 Processor -- start 2024-03-07T07:31:43.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.846+0000 7f7c5c600640 1 -- start start 2024-03-07T07:31:43.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.846+0000 7f7c5c600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c54145090 0x7f7c540cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.846+0000 7f7c5c600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c5415c3d0 0x7f7c540cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.846+0000 7f7c5c600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540b4a60 con 0x7f7c540cd950 2024-03-07T07:31:43.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.846+0000 7f7c5c600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540cdda0 con 0x7f7c54145090 2024-03-07T07:31:43.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.846+0000 7f7c5c600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540b4d40 con 0x7f7c5415c3d0 2024-03-07T07:31:43.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.846+0000 7f7c59c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c54145090 0x7f7c540cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c59200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c5415c3d0 0x7f7c540cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c5a600640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7c540cd950 0x7f7c5415f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33196/0 (socket says 172.21.15.84:33196) 2024-03-07T07:31:43.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c59c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c54145090 0x7f7c540cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43058/0 (socket says 172.21.15.84:43058) 2024-03-07T07:31:43.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c5a600640 1 -- 172.21.15.84:0/3492626365 learned_addr learned my addr 172.21.15.84:0/3492626365 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:43.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c59c00640 1 -- 172.21.15.84:0/3492626365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c5415c3d0 msgr2=0x7f7c540cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:43.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c59c00640 1 --2- 172.21.15.84:0/3492626365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c5415c3d0 0x7f7c540cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c59c00640 1 -- 172.21.15.84:0/3492626365 >> v1:172.21.15.161:6789/0 conn(0x7f7c540cd950 legacy=0x7f7c5415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c59c00640 1 -- 172.21.15.84:0/3492626365 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540719c0 con 0x7f7c54145090 2024-03-07T07:31:43.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c59c00640 1 --2- 172.21.15.84:0/3492626365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c54145090 0x7f7c540cf540 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7c480097c0 tx=0x7f7c4801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277381a302ba8de2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c53e00640 1 -- 172.21.15.84:0/3492626365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480b2070 con 0x7f7c54145090 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c53e00640 1 -- 172.21.15.84:0/3492626365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c480ad640 con 0x7f7c54145090 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.850+0000 7f7c53e00640 1 -- 172.21.15.84:0/3492626365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480ada10 con 0x7f7c54145090 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- 172.21.15.84:0/3492626365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c54145090 msgr2=0x7f7c540cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3492626365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c54145090 0x7f7c540cf540 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7c480097c0 tx=0x7f7c4801c470 comp rx=0 tx=0).stop 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- 172.21.15.84:0/3492626365 shutdown_connections 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3492626365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c5415c3d0 0x7f7c540cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3492626365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c54145090 0x7f7c540cf540 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- 172.21.15.84:0/3492626365 >> 172.21.15.84:0/3492626365 conn(0x7f7c540b1c50 msgr2=0x7f7c540b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- 172.21.15.84:0/3492626365 shutdown_connections 2024-03-07T07:31:43.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- 172.21.15.84:0/3492626365 wait complete. 2024-03-07T07:31:43.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 Processor -- start 2024-03-07T07:31:43.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- start start 2024-03-07T07:31:43.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c540cd950 0x7f7c5415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c54145090 0x7f7c5413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c5415c3d0 0x7f7c54165e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540b4710 con 0x7f7c5415c3d0 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540cfa80 con 0x7f7c54145090 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54145830 con 0x7f7c540cd950 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c5415c3d0 0x7f7c54165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c5415c3d0 0x7f7c54165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43070/0 (socket says 172.21.15.84:43070) 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 -- 172.21.15.84:0/3218246682 learned_addr learned my addr 172.21.15.84:0/3218246682 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c59200640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c54145090 0x7f7c5413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c59c00640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c540cd950 0x7f7c5415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 -- 172.21.15.84:0/3218246682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c540cd950 msgr2=0x7f7c5415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c540cd950 0x7f7c5415aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 -- 172.21.15.84:0/3218246682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c54145090 msgr2=0x7f7c5413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c54145090 0x7f7c5413c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 -- 172.21.15.84:0/3218246682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c541439a0 con 0x7f7c5415c3d0 2024-03-07T07:31:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5a600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c5415c3d0 0x7f7c54165e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00ca80 tx=0x7f7c4c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c51600640 1 -- 172.21.15.84:0/3218246682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c017070 con 0x7f7c5415c3d0 2024-03-07T07:31:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c51600640 1 -- 172.21.15.84:0/3218246682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c00ac30 con 0x7f7c5415c3d0 2024-03-07T07:31:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c51600640 1 -- 172.21.15.84:0/3218246682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c012400 con 0x7f7c5415c3d0 2024-03-07T07:31:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.854+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5413ce20 con 0x7f7c5415c3d0 2024-03-07T07:31:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.858+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c54143f20 con 0x7f7c5415c3d0 2024-03-07T07:31:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.858+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c54062d40 con 0x7f7c5415c3d0 2024-03-07T07:31:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.858+0000 7f7c51600640 1 -- 172.21.15.84:0/3218246682 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f7c4c01a070 con 0x7f7c5415c3d0 2024-03-07T07:31:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.858+0000 7f7c51600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7c34066f60 0x7f7c34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.858+0000 7f7c51600640 1 -- 172.21.15.84:0/3218246682 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c4c084bc0 con 0x7f7c5415c3d0 2024-03-07T07:31:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.858+0000 7f7c59c00640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7c34066f60 0x7f7c34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.858+0000 7f7c59c00640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7c34066f60 0x7f7c34069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c480af000 tx=0x7f7c48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:43.862+0000 7f7c51600640 1 -- 172.21.15.84:0/3218246682 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f7c4c055570 con 0x7f7c5415c3d0 2024-03-07T07:31:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.018+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c540b3320 con 0x7f7c5415c3d0 2024-03-07T07:31:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.018+0000 7f7c51600640 1 -- 172.21.15.84:0/3218246682 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c4c059610 con 0x7f7c5415c3d0 2024-03-07T07:31:44.019 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7c34066f60 msgr2=0x7f7c34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7c34066f60 0x7f7c34069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c480af000 tx=0x7f7c48008040 comp rx=0 tx=0).stop 2024-03-07T07:31:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c5415c3d0 msgr2=0x7f7c54165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c5415c3d0 0x7f7c54165e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00ca80 tx=0x7f7c4c00cf40 comp rx=0 tx=0).stop 2024-03-07T07:31:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 shutdown_connections 2024-03-07T07:31:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7c34066f60 0x7f7c34069420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c5415c3d0 0x7f7c54165e90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c54145090 0x7f7c5413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 --2- 172.21.15.84:0/3218246682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c540cd950 0x7f7c5415aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 >> 172.21.15.84:0/3218246682 conn(0x7f7c540b1c50 msgr2=0x7f7c541405c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 shutdown_connections 2024-03-07T07:31:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.022+0000 7f7c5c600640 1 -- 172.21.15.84:0/3218246682 wait complete. 2024-03-07T07:31:44.041 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:44.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.174+0000 7f1e0c800640 1 Processor -- start 2024-03-07T07:31:44.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.174+0000 7f1e0c800640 1 -- start start 2024-03-07T07:31:44.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.174+0000 7f1e0c800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e04143dd0 0x7f1e040cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.174+0000 7f1e0c800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e04144360 0x7f1e040729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.174+0000 7f1e0c800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 0x7f1e04072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.174+0000 7f1e0c800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e041441b0 con 0x7f1e04144360 2024-03-07T07:31:44.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.174+0000 7f1e0c800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e040cf050 con 0x7f1e04143dd0 2024-03-07T07:31:44.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e0c800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040cc880 con 0x7f1e041448b0 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e04144360 0x7f1e040729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e04144360 0x7f1e040729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43076/0 (socket says 172.21.15.84:43076) 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e04143dd0 0x7f1e040cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 -- 172.21.15.84:0/307913503 learned_addr learned my addr 172.21.15.84:0/307913503 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e0a800640 1 --2- 172.21.15.84:0/307913503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 0x7f1e04072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 -- 172.21.15.84:0/307913503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 msgr2=0x7f1e04072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 --2- 172.21.15.84:0/307913503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 0x7f1e04072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 -- 172.21.15.84:0/307913503 >> v2:172.21.15.161:3300/0 conn(0x7f1e04143dd0 msgr2=0x7f1e040cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 --2- 172.21.15.84:0/307913503 >> v2:172.21.15.161:3300/0 conn(0x7f1e04143dd0 0x7f1e040cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 -- 172.21.15.84:0/307913503 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040ccb60 con 0x7f1e04144360 2024-03-07T07:31:44.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09e00640 1 --2- 172.21.15.84:0/307913503 >> v2:172.21.15.161:3300/0 conn(0x7f1e04143dd0 0x7f1e040cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:44.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e09400640 1 --2- 172.21.15.84:0/307913503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e040729d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e040b2c40 tx=0x7f1df401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa4bb9cb1a15d8f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e08a00640 1 -- 172.21.15.84:0/307913503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df40b1070 con 0x7f1e04144360 2024-03-07T07:31:44.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e08a00640 1 -- 172.21.15.84:0/307913503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df40ac620 con 0x7f1e04144360 2024-03-07T07:31:44.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.178+0000 7f1e08a00640 1 -- 172.21.15.84:0/307913503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df40ac9f0 con 0x7f1e04144360 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- 172.21.15.84:0/307913503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 msgr2=0x7f1e040729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 --2- 172.21.15.84:0/307913503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e040729d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e040b2c40 tx=0x7f1df401c4f0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- 172.21.15.84:0/307913503 shutdown_connections 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 --2- 172.21.15.84:0/307913503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 0x7f1e04072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 --2- 172.21.15.84:0/307913503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e040729d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 --2- 172.21.15.84:0/307913503 >> v2:172.21.15.161:3300/0 conn(0x7f1e04143dd0 0x7f1e040cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- 172.21.15.84:0/307913503 >> 172.21.15.84:0/307913503 conn(0x7f1e040704b0 msgr2=0x7f1e040708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- 172.21.15.84:0/307913503 shutdown_connections 2024-03-07T07:31:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- 172.21.15.84:0/307913503 wait complete. 2024-03-07T07:31:44.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 Processor -- start 2024-03-07T07:31:44.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- start start 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e04143dd0 0x7f1e0415a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e041ec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 0x7f1e041e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0415bc20 con 0x7f1e04144360 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040cd6e0 con 0x7f1e04143dd0 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0c800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0415bda0 con 0x7f1e041448b0 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e041ec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e041ec1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43080/0 (socket says 172.21.15.84:43080) 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09400640 1 -- 172.21.15.84:0/1856477550 learned_addr learned my addr 172.21.15.84:0/1856477550 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09e00640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e04143dd0 0x7f1e0415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e0a800640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 0x7f1e041e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09400640 1 -- 172.21.15.84:0/1856477550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 msgr2=0x7f1e041e24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09400640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 0x7f1e041e24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09400640 1 -- 172.21.15.84:0/1856477550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e04143dd0 msgr2=0x7f1e0415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09400640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e04143dd0 0x7f1e0415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.182+0000 7f1e09400640 1 -- 172.21.15.84:0/1856477550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e041e1ba0 con 0x7f1e04144360 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1e09400640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e041ec1e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1df40af040 tx=0x7f1df4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1dfe000640 1 -- 172.21.15.84:0/1856477550 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df40b1040 con 0x7f1e04144360 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1dfe000640 1 -- 172.21.15.84:0/1856477550 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df40b5420 con 0x7f1e04144360 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e041e1e80 con 0x7f1e04144360 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1dfe000640 1 -- 172.21.15.84:0/1856477550 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df40b5810 con 0x7f1e04144360 2024-03-07T07:31:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e041ec720 con 0x7f1e04144360 2024-03-07T07:31:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e04062d40 con 0x7f1e04144360 2024-03-07T07:31:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1dfe000640 1 -- 172.21.15.84:0/1856477550 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f1df40b59b0 con 0x7f1e04144360 2024-03-07T07:31:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1dfe000640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1de8066f60 0x7f1de8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1dfe000640 1 -- 172.21.15.84:0/1856477550 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1df411ebe0 con 0x7f1e04144360 2024-03-07T07:31:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.186+0000 7f1e09e00640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1de8066f60 0x7f1de8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.190+0000 7f1e09e00640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1de8066f60 0x7f1de8069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b820 tx=0x7f1df800b3a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.190+0000 7f1dfe000640 1 -- 172.21.15.84:0/1856477550 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f1df4016110 con 0x7f1e04144360 2024-03-07T07:31:44.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.346+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e0415b1f0 con 0x7f1e04144360 2024-03-07T07:31:44.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.346+0000 7f1dfe000640 1 -- 172.21.15.84:0/1856477550 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f1df40efd00 con 0x7f1e04144360 2024-03-07T07:31:44.347 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:44.347 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1de8066f60 msgr2=0x7f1de8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1de8066f60 0x7f1de8069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b820 tx=0x7f1df800b3a0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 msgr2=0x7f1e041ec1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e041ec1e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1df40af040 tx=0x7f1df4019290 comp rx=0 tx=0).stop 2024-03-07T07:31:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 shutdown_connections 2024-03-07T07:31:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1de8066f60 0x7f1de8069420 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e041448b0 0x7f1e041e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e04144360 0x7f1e041ec1e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 --2- 172.21.15.84:0/1856477550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e04143dd0 0x7f1e0415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 >> 172.21.15.84:0/1856477550 conn(0x7f1e040704b0 msgr2=0x7f1e040729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:44.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 shutdown_connections 2024-03-07T07:31:44.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.350+0000 7f1e0c800640 1 -- 172.21.15.84:0/1856477550 wait complete. 2024-03-07T07:31:44.369 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:44.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.506+0000 7f0bd6c00640 1 Processor -- start 2024-03-07T07:31:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.506+0000 7f0bd6c00640 1 -- start start 2024-03-07T07:31:44.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bd6c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bd015c3d0 0x7f0bd00cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bd6c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0bd00cd950 0x7f0bd00724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bd6c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd00cdd70 con 0x7f0bd0145090 2024-03-07T07:31:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bd6c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00b4a60 con 0x7f0bd015c3d0 2024-03-07T07:31:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bd6c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00b4d40 con 0x7f0bd00cd950 2024-03-07T07:31:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bc7400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bd015c3d0 0x7f0bd00cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bc7400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bd015c3d0 0x7f0bd00cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43086/0 (socket says 172.21.15.84:43086) 2024-03-07T07:31:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bc7400640 1 -- 172.21.15.84:0/4071684829 learned_addr learned my addr 172.21.15.84:0/4071684829 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bd4c00640 1 --2- 172.21.15.84:0/4071684829 >> v2:172.21.15.161:3300/0 conn(0x7f0bd00cd950 0x7f0bd00724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bc7400640 1 -- 172.21.15.84:0/4071684829 >> v2:172.21.15.161:3300/0 conn(0x7f0bd00cd950 msgr2=0x7f0bd00724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bc7400640 1 --2- 172.21.15.84:0/4071684829 >> v2:172.21.15.161:3300/0 conn(0x7f0bd00cd950 0x7f0bd00724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bc7400640 1 -- 172.21.15.84:0/4071684829 >> v1:172.21.15.161:6789/0 conn(0x7f0bd0145090 legacy=0x7f0bd00cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.510+0000 7f0bc7400640 1 -- 172.21.15.84:0/4071684829 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00719c0 con 0x7f0bd015c3d0 2024-03-07T07:31:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bc7400640 1 --2- 172.21.15.84:0/4071684829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd00cd410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00b3a10 tx=0x7f0bb801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f61b710d2ed623a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bcf400640 1 -- 172.21.15.84:0/4071684829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80aa650 con 0x7f0bd015c3d0 2024-03-07T07:31:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bcf400640 1 -- 172.21.15.84:0/4071684829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb80af070 con 0x7f0bd015c3d0 2024-03-07T07:31:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bcf400640 1 -- 172.21.15.84:0/4071684829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80aaa10 con 0x7f0bd015c3d0 2024-03-07T07:31:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 -- 172.21.15.84:0/4071684829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 msgr2=0x7f0bd00cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/4071684829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd00cd410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00b3a10 tx=0x7f0bb801c4f0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 -- 172.21.15.84:0/4071684829 shutdown_connections 2024-03-07T07:31:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/4071684829 >> v2:172.21.15.161:3300/0 conn(0x7f0bd00cd950 0x7f0bd00724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/4071684829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd00cd410 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 -- 172.21.15.84:0/4071684829 >> 172.21.15.84:0/4071684829 conn(0x7f0bd00b1c50 msgr2=0x7f0bd00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 -- 172.21.15.84:0/4071684829 shutdown_connections 2024-03-07T07:31:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 -- 172.21.15.84:0/4071684829 wait complete. 2024-03-07T07:31:44.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 Processor -- start 2024-03-07T07:31:44.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.514+0000 7f0bd6c00640 1 -- start start 2024-03-07T07:31:44.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bd00cd950 0x7f0bd015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bd0145090 0x7f0bd015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd013fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0145830 con 0x7f0bd015c3d0 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00b4710 con 0x7f0bd0145090 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd01459b0 con 0x7f0bd00cd950 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd013fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd013fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43102/0 (socket says 172.21.15.84:43102) 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 -- 172.21.15.84:0/2078467984 learned_addr learned my addr 172.21.15.84:0/2078467984 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bcfe00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bd00cd950 0x7f0bd015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bc7400640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bd0145090 0x7f0bd015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 -- 172.21.15.84:0/2078467984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bd00cd950 msgr2=0x7f0bd015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bd00cd950 0x7f0bd015e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 -- 172.21.15.84:0/2078467984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bd0145090 msgr2=0x7f0bd015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bd0145090 0x7f0bd015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 -- 172.21.15.84:0/2078467984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd015d120 con 0x7f0bd015c3d0 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd4c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd013fa10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800e930 tx=0x7f0bc800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bccc00640 1 -- 172.21.15.84:0/2078467984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8017070 con 0x7f0bd015c3d0 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bccc00640 1 -- 172.21.15.84:0/2078467984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800c9a0 con 0x7f0bd015c3d0 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bccc00640 1 -- 172.21.15.84:0/2078467984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800cd70 con 0x7f0bd015c3d0 2024-03-07T07:31:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd015ed70 con 0x7f0bd015c3d0 2024-03-07T07:31:44.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd015f610 con 0x7f0bd015c3d0 2024-03-07T07:31:44.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd0062d40 con 0x7f0bd015c3d0 2024-03-07T07:31:44.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bccc00640 1 -- 172.21.15.84:0/2078467984 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f0bc801a070 con 0x7f0bd015c3d0 2024-03-07T07:31:44.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.518+0000 7f0bccc00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bac066f90 0x7f0bac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.522+0000 7f0bccc00640 1 -- 172.21.15.84:0/2078467984 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bc8084fe0 con 0x7f0bd015c3d0 2024-03-07T07:31:44.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.522+0000 7f0bcfe00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bac066f90 0x7f0bac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.522+0000 7f0bcfe00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bac066f90 0x7f0bac069450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0bd013ae80 tx=0x7f0bc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.526+0000 7f0bccc00640 1 -- 172.21.15.84:0/2078467984 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f0bc80559c0 con 0x7f0bd015c3d0 2024-03-07T07:31:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.678+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0bd0166920 con 0x7f0bd015c3d0 2024-03-07T07:31:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.678+0000 7f0bccc00640 1 -- 172.21.15.84:0/2078467984 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bc8059a60 con 0x7f0bd015c3d0 2024-03-07T07:31:44.681 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bac066f90 msgr2=0x7f0bac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bac066f90 0x7f0bac069450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0bd013ae80 tx=0x7f0bc0009040 comp rx=0 tx=0).stop 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 msgr2=0x7f0bd013fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd013fa10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800e930 tx=0x7f0bc800edf0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 shutdown_connections 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0bac066f90 0x7f0bac069450 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bd015c3d0 0x7f0bd013fa10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0bd0145090 0x7f0bd015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 --2- 172.21.15.84:0/2078467984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0bd00cd950 0x7f0bd015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 >> 172.21.15.84:0/2078467984 conn(0x7f0bd00b1c50 msgr2=0x7f0bd00cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 shutdown_connections 2024-03-07T07:31:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.682+0000 7f0bd6c00640 1 -- 172.21.15.84:0/2078467984 wait complete. 2024-03-07T07:31:44.701 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1817a00640 1 Processor -- start 2024-03-07T07:31:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1817a00640 1 -- start start 2024-03-07T07:31:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1817a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18100ce3d0 0x7f18100ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1817a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ced70 0x7f181006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1817a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181006eec0 con 0x7f18101442a0 2024-03-07T07:31:44.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1817a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181006f1a0 con 0x7f18100ce3d0 2024-03-07T07:31:44.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1817a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18100cc800 con 0x7f18100ced70 2024-03-07T07:31:44.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f180fe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18100ce3d0 0x7f18100ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1815000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f18101442a0 0x7f18100b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33214/0 (socket says 172.21.15.84:33214) 2024-03-07T07:31:44.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1815000640 1 -- 172.21.15.84:0/377296705 learned_addr learned my addr 172.21.15.84:0/377296705 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:44.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.838+0000 7f1815a00640 1 --2- 172.21.15.84:0/377296705 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ced70 0x7f181006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180fe00640 1 -- 172.21.15.84:0/377296705 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ced70 msgr2=0x7f181006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:44.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180fe00640 1 --2- 172.21.15.84:0/377296705 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ced70 0x7f181006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180fe00640 1 -- 172.21.15.84:0/377296705 >> v1:172.21.15.161:6789/0 conn(0x7f18101442a0 legacy=0x7f18100b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180fe00640 1 -- 172.21.15.84:0/377296705 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100b4460 con 0x7f18100ce3d0 2024-03-07T07:31:44.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180f400640 1 -- 172.21.15.84:0/377296705 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266419270 0 0) 0x7f181006eec0 con 0x7f18101442a0 2024-03-07T07:31:44.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180fe00640 1 --2- 172.21.15.84:0/377296705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ce3d0 0x7f18100ce830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0097c0 tx=0x7f17fc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3aa51509702797 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180f400640 1 -- 172.21.15.84:0/377296705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0b0070 con 0x7f18100ce3d0 2024-03-07T07:31:44.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180f400640 1 -- 172.21.15.84:0/377296705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc0ab600 con 0x7f18100ce3d0 2024-03-07T07:31:44.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f180f400640 1 -- 172.21.15.84:0/377296705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0ab9d0 con 0x7f18100ce3d0 2024-03-07T07:31:44.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f1817a00640 1 -- 172.21.15.84:0/377296705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ce3d0 msgr2=0x7f18100ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f1817a00640 1 --2- 172.21.15.84:0/377296705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ce3d0 0x7f18100ce830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0097c0 tx=0x7f17fc01c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f1817a00640 1 -- 172.21.15.84:0/377296705 shutdown_connections 2024-03-07T07:31:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f1817a00640 1 --2- 172.21.15.84:0/377296705 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ced70 0x7f181006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f1817a00640 1 --2- 172.21.15.84:0/377296705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ce3d0 0x7f18100ce830 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.842+0000 7f1817a00640 1 -- 172.21.15.84:0/377296705 >> 172.21.15.84:0/377296705 conn(0x7f18100b1c50 msgr2=0x7f18100b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 -- 172.21.15.84:0/377296705 shutdown_connections 2024-03-07T07:31:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 -- 172.21.15.84:0/377296705 wait complete. 2024-03-07T07:31:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 Processor -- start 2024-03-07T07:31:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 -- start start 2024-03-07T07:31:44.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ce3d0 0x7f18100ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ced70 0x7f1810157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18101442a0 0x7f1810155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181006eb10 con 0x7f18100ced70 2024-03-07T07:31:44.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181006e990 con 0x7f18101442a0 2024-03-07T07:31:44.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18101679d0 con 0x7f18100ce3d0 2024-03-07T07:31:44.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ced70 0x7f1810157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ced70 0x7f1810157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43120/0 (socket says 172.21.15.84:43120) 2024-03-07T07:31:44.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 -- 172.21.15.84:0/1645348061 learned_addr learned my addr 172.21.15.84:0/1645348061 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:44.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1815000640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ce3d0 0x7f18100ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1815a00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18101442a0 0x7f1810155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 -- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ce3d0 msgr2=0x7f18100ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ce3d0 0x7f18100ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 -- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18101442a0 msgr2=0x7f1810155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:44.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18101442a0 0x7f1810155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:44.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 -- 172.21.15.84:0/1645348061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810154f40 con 0x7f18100ced70 2024-03-07T07:31:44.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1815000640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ce3d0 0x7f18100ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:44.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180fe00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ced70 0x7f1810157b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f17fc01ab50 tx=0x7f17fc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180cc00640 1 -- 172.21.15.84:0/1645348061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0bc070 con 0x7f18100ced70 2024-03-07T07:31:44.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180cc00640 1 -- 172.21.15.84:0/1645348061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc004030 con 0x7f18100ced70 2024-03-07T07:31:44.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1810155220 con 0x7f18100ced70 2024-03-07T07:31:44.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.846+0000 7f180cc00640 1 -- 172.21.15.84:0/1645348061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0b0040 con 0x7f18100ced70 2024-03-07T07:31:44.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.850+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18101557e0 con 0x7f18100ced70 2024-03-07T07:31:44.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.850+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1810062d40 con 0x7f18100ced70 2024-03-07T07:31:44.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.850+0000 7f180cc00640 1 -- 172.21.15.84:0/1645348061 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f17fc0bf070 con 0x7f18100ced70 2024-03-07T07:31:44.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.850+0000 7f180cc00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f17f0066f60 0x7f17f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:44.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.850+0000 7f180cc00640 1 -- 172.21.15.84:0/1645348061 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17fc11e600 con 0x7f18100ced70 2024-03-07T07:31:44.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.850+0000 7f1815000640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f17f0066f60 0x7f17f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:44.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.850+0000 7f1815000640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f17f0066f60 0x7f17f0069420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1804007fd0 tx=0x7f1804007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:44.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:44.854+0000 7f180cc00640 1 -- 172.21.15.84:0/1645348061 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f17fc016090 con 0x7f18100ced70 2024-03-07T07:31:45.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.010+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f181015ac80 con 0x7f18100ced70 2024-03-07T07:31:45.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.010+0000 7f180cc00640 1 -- 172.21.15.84:0/1645348061 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17fc0eef20 con 0x7f18100ced70 2024-03-07T07:31:45.012 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:45.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f17f0066f60 msgr2=0x7f17f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f17f0066f60 0x7f17f0069420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1804007fd0 tx=0x7f1804007d60 comp rx=0 tx=0).stop 2024-03-07T07:31:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ced70 msgr2=0x7f1810157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ced70 0x7f1810157b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f17fc01ab50 tx=0x7f17fc01ace0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 shutdown_connections 2024-03-07T07:31:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f17f0066f60 0x7f17f0069420 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1804007fd0 tx=0x7f1804007d60 comp rx=0 tx=0).stop 2024-03-07T07:31:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18101442a0 0x7f1810155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18100ced70 0x7f1810157b90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 --2- 172.21.15.84:0/1645348061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18100ce3d0 0x7f18100ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 >> 172.21.15.84:0/1645348061 conn(0x7f18100b1c50 msgr2=0x7f1810142b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 shutdown_connections 2024-03-07T07:31:45.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.014+0000 7f1817a00640 1 -- 172.21.15.84:0/1645348061 wait complete. 2024-03-07T07:31:45.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:45.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc687800640 1 Processor -- start 2024-03-07T07:31:45.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc687800640 1 -- start start 2024-03-07T07:31:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc687800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc680147b50 0x7fc680073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc687800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc68006d360 0x7fc680071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc687800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc680073640 con 0x7fc68015f210 2024-03-07T07:31:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc687800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6800cfa70 con 0x7fc68006d360 2024-03-07T07:31:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc687800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6800cfd50 con 0x7fc680147b50 2024-03-07T07:31:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc685800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc68006d360 0x7fc680071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc685800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc68006d360 0x7fc680071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43132/0 (socket says 172.21.15.84:43132) 2024-03-07T07:31:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc685800640 1 -- 172.21.15.84:0/3142359017 learned_addr learned my addr 172.21.15.84:0/3142359017 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc684e00640 1 --2- 172.21.15.84:0/3142359017 >> v2:172.21.15.161:3300/0 conn(0x7fc680147b50 0x7fc680073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc685800640 1 -- 172.21.15.84:0/3142359017 >> v2:172.21.15.161:3300/0 conn(0x7fc680147b50 msgr2=0x7fc680073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc685800640 1 --2- 172.21.15.84:0/3142359017 >> v2:172.21.15.161:3300/0 conn(0x7fc680147b50 0x7fc680073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc685800640 1 -- 172.21.15.84:0/3142359017 >> v1:172.21.15.161:6789/0 conn(0x7fc68015f210 legacy=0x7fc68006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc685800640 1 -- 172.21.15.84:0/3142359017 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800d1740 con 0x7fc68006d360 2024-03-07T07:31:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.170+0000 7fc67f400640 1 -- 172.21.15.84:0/3142359017 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559006700 0 0) 0x7fc680073640 con 0x7fc68015f210 2024-03-07T07:31:45.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc685800640 1 --2- 172.21.15.84:0/3142359017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc680071870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc68006a610 tx=0x7fc67801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d98fbad971ae2d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc67f400640 1 -- 172.21.15.84:0/3142359017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780a5670 con 0x7fc68006d360 2024-03-07T07:31:45.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc67f400640 1 -- 172.21.15.84:0/3142359017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6780a5810 con 0x7fc68006d360 2024-03-07T07:31:45.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc67f400640 1 -- 172.21.15.84:0/3142359017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780a5be0 con 0x7fc68006d360 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc687800640 1 -- 172.21.15.84:0/3142359017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 msgr2=0x7fc680071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc687800640 1 --2- 172.21.15.84:0/3142359017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc680071870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc68006a610 tx=0x7fc67801c8a0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc687800640 1 -- 172.21.15.84:0/3142359017 shutdown_connections 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc687800640 1 --2- 172.21.15.84:0/3142359017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc680071870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc687800640 1 --2- 172.21.15.84:0/3142359017 >> v2:172.21.15.161:3300/0 conn(0x7fc680147b50 0x7fc680073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc687800640 1 -- 172.21.15.84:0/3142359017 >> 172.21.15.84:0/3142359017 conn(0x7fc6800b3aa0 msgr2=0x7fc6800b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc687800640 1 -- 172.21.15.84:0/3142359017 shutdown_connections 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.174+0000 7fc687800640 1 -- 172.21.15.84:0/3142359017 wait complete. 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 Processor -- start 2024-03-07T07:31:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 -- start start 2024-03-07T07:31:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc68013b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc680147b50 0x7fc68013d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc68015f210 0x7fc68013da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc680072740 con 0x7fc68006d360 2024-03-07T07:31:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800725c0 con 0x7fc680147b50 2024-03-07T07:31:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800728c0 con 0x7fc68015f210 2024-03-07T07:31:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc68013b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc68013b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43134/0 (socket says 172.21.15.84:43134) 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 -- 172.21.15.84:0/1253851469 learned_addr learned my addr 172.21.15.84:0/1253851469 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc67fe00640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc680147b50 0x7fc68013d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc685800640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc68015f210 0x7fc68013da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 -- 172.21.15.84:0/1253851469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc68015f210 msgr2=0x7fc68013da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc68015f210 0x7fc68013da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 -- 172.21.15.84:0/1253851469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc680147b50 msgr2=0x7fc68013d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc680147b50 0x7fc68013d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 -- 172.21.15.84:0/1253851469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680140a30 con 0x7fc68006d360 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc684e00640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc68013b820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc67400e870 tx=0x7fc67400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc67cc00640 1 -- 172.21.15.84:0/1253851469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674017070 con 0x7fc68006d360 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc67cc00640 1 -- 172.21.15.84:0/1253851469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67400c940 con 0x7fc68006d360 2024-03-07T07:31:45.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68015e0b0 con 0x7fc68006d360 2024-03-07T07:31:45.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc67cc00640 1 -- 172.21.15.84:0/1253851469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400ccf0 con 0x7fc68006d360 2024-03-07T07:31:45.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68013ead0 con 0x7fc68006d360 2024-03-07T07:31:45.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.178+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc680062d40 con 0x7fc68006d360 2024-03-07T07:31:45.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.182+0000 7fc67cc00640 1 -- 172.21.15.84:0/1253851469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc67401a070 con 0x7fc68006d360 2024-03-07T07:31:45.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.182+0000 7fc67cc00640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc660066f60 0x7fc660069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.182+0000 7fc67cc00640 1 -- 172.21.15.84:0/1253851469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc674084f00 con 0x7fc68006d360 2024-03-07T07:31:45.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.182+0000 7fc67fe00640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc660066f60 0x7fc660069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.182+0000 7fc67fe00640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc660066f60 0x7fc660069420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc6800b7ed0 tx=0x7fc66c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.186+0000 7fc67cc00640 1 -- 172.21.15.84:0/1253851469 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc674055820 con 0x7fc68006d360 2024-03-07T07:31:45.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc680143d90 con 0x7fc68006d360 2024-03-07T07:31:45.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc67cc00640 1 -- 172.21.15.84:0/1253851469 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6740598c0 con 0x7fc68006d360 2024-03-07T07:31:45.342 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc660066f60 msgr2=0x7fc660069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc660066f60 0x7fc660069420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc6800b7ed0 tx=0x7fc66c009040 comp rx=0 tx=0).stop 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 msgr2=0x7fc68013b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc68013b820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc67400e870 tx=0x7fc67400ec70 comp rx=0 tx=0).stop 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 shutdown_connections 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc660066f60 0x7fc660069420 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc68015f210 0x7fc68013da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc680147b50 0x7fc68013d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 --2- 172.21.15.84:0/1253851469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68006d360 0x7fc68013b820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 >> 172.21.15.84:0/1253851469 conn(0x7fc6800b3aa0 msgr2=0x7fc6801453d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 shutdown_connections 2024-03-07T07:31:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.342+0000 7fc687800640 1 -- 172.21.15.84:0/1253851469 wait complete. 2024-03-07T07:31:45.382 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-03-07T07:31:45.383 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:45.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6808a00640 1 Processor -- start 2024-03-07T07:31:45.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6808a00640 1 -- start start 2024-03-07T07:31:45.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6808a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6804071600 0x7f6804072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6808a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68040d0c00 0x7f68040d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6808a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040d1550 con 0x7f68041478c0 2024-03-07T07:31:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6808a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6804071be0 con 0x7f6804071600 2024-03-07T07:31:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6808a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6804071ec0 con 0x7f68040d0c00 2024-03-07T07:31:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6801e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6804071600 0x7f6804072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6802800640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f68041478c0 0x7f68040cfd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41240/0 (socket says 172.21.15.84:41240) 2024-03-07T07:31:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6802800640 1 -- 172.21.15.84:0/1996405723 learned_addr learned my addr 172.21.15.84:0/1996405723 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6803200640 1 --2- 172.21.15.84:0/1996405723 >> v2:172.21.15.161:3300/0 conn(0x7f68040d0c00 0x7f68040d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6801e00640 1 -- 172.21.15.84:0/1996405723 >> v2:172.21.15.161:3300/0 conn(0x7f68040d0c00 msgr2=0x7f68040d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6801e00640 1 --2- 172.21.15.84:0/1996405723 >> v2:172.21.15.161:3300/0 conn(0x7f68040d0c00 0x7f68040d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6801e00640 1 -- 172.21.15.84:0/1996405723 >> v1:172.21.15.84:6789/0 conn(0x7f68041478c0 legacy=0x7f68040cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6801e00640 1 -- 172.21.15.84:0/1996405723 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040721a0 con 0x7f6804071600 2024-03-07T07:31:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.518+0000 7f6801400640 1 -- 172.21.15.84:0/1996405723 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316675727 0 0) 0x7f67f4001120 con 0x7f68041478c0 2024-03-07T07:31:45.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6801e00640 1 --2- 172.21.15.84:0/1996405723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6804071600 0x7f6804072c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f680406eb70 tx=0x7f67f001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46925e374cc2b1a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6801400640 1 -- 172.21.15.84:0/1996405723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00ab650 con 0x7f6804071600 2024-03-07T07:31:45.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6801400640 1 -- 172.21.15.84:0/1996405723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f00b0070 con 0x7f6804071600 2024-03-07T07:31:45.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6801400640 1 -- 172.21.15.84:0/1996405723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00aba10 con 0x7f6804071600 2024-03-07T07:31:45.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6808a00640 1 -- 172.21.15.84:0/1996405723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6804071600 msgr2=0x7f6804072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6808a00640 1 --2- 172.21.15.84:0/1996405723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6804071600 0x7f6804072c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f680406eb70 tx=0x7f67f001c450 comp rx=0 tx=0).stop 2024-03-07T07:31:45.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6808a00640 1 -- 172.21.15.84:0/1996405723 shutdown_connections 2024-03-07T07:31:45.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6808a00640 1 --2- 172.21.15.84:0/1996405723 >> v2:172.21.15.161:3300/0 conn(0x7f68040d0c00 0x7f68040d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6808a00640 1 --2- 172.21.15.84:0/1996405723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6804071600 0x7f6804072c80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.522+0000 7f6808a00640 1 -- 172.21.15.84:0/1996405723 >> 172.21.15.84:0/1996405723 conn(0x7f680406b5c0 msgr2=0x7f680406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 -- 172.21.15.84:0/1996405723 shutdown_connections 2024-03-07T07:31:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 -- 172.21.15.84:0/1996405723 wait complete. 2024-03-07T07:31:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 Processor -- start 2024-03-07T07:31:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 -- start start 2024-03-07T07:31:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6804071600 0x7f680413eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68040d0c00 0x7f680415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68041478c0 0x7f680415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040ccb10 con 0x7f68041478c0 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040cc990 con 0x7f6804071600 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6808a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040ccc90 con 0x7f68040d0c00 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68041478c0 0x7f680415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6802800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6804071600 0x7f680413eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68041478c0 0x7f680415ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43138/0 (socket says 172.21.15.84:43138) 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 -- 172.21.15.84:0/2202870103 learned_addr learned my addr 172.21.15.84:0/2202870103 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6801e00640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68040d0c00 0x7f680415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 -- 172.21.15.84:0/2202870103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68040d0c00 msgr2=0x7f680415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68040d0c00 0x7f680415d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 -- 172.21.15.84:0/2202870103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6804071600 msgr2=0x7f680413eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6804071600 0x7f680413eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 -- 172.21.15.84:0/2202870103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680413f440 con 0x7f68041478c0 2024-03-07T07:31:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6802800640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6804071600 0x7f680413eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.526+0000 7f6803200640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68041478c0 0x7f680415ccc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00efc0 tx=0x7f67fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f67faa00640 1 -- 172.21.15.84:0/2202870103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc018020 con 0x7f68041478c0 2024-03-07T07:31:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f67faa00640 1 -- 172.21.15.84:0/2202870103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc014480 con 0x7f68041478c0 2024-03-07T07:31:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680415bf00 con 0x7f68041478c0 2024-03-07T07:31:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f67faa00640 1 -- 172.21.15.84:0/2202870103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc014870 con 0x7f68041478c0 2024-03-07T07:31:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680415c4c0 con 0x7f68041478c0 2024-03-07T07:31:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6804062d40 con 0x7f68041478c0 2024-03-07T07:31:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f67faa00640 1 -- 172.21.15.84:0/2202870103 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f67fc01b020 con 0x7f68041478c0 2024-03-07T07:31:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f67faa00640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f67e4066f60 0x7f67e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f67faa00640 1 -- 172.21.15.84:0/2202870103 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67fc0859a0 con 0x7f68041478c0 2024-03-07T07:31:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.530+0000 7f6802800640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f67e4066f60 0x7f67e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.534+0000 7f6802800640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f67e4066f60 0x7f67e4069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f67f4000f70 tx=0x7f67f4007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.534+0000 7f67faa00640 1 -- 172.21.15.84:0/2202870103 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f67fc022070 con 0x7f68041478c0 2024-03-07T07:31:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.690+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f680406c2f0 con 0x7f68041478c0 2024-03-07T07:31:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.690+0000 7f67faa00640 1 -- 172.21.15.84:0/2202870103 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f67fc010040 con 0x7f68041478c0 2024-03-07T07:31:45.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:45.692 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f67e4066f60 msgr2=0x7f67e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f67e4066f60 0x7f67e4069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f67f4000f70 tx=0x7f67f4007df0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68041478c0 msgr2=0x7f680415ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68041478c0 0x7f680415ccc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00efc0 tx=0x7f67fc00c490 comp rx=0 tx=0).stop 2024-03-07T07:31:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 shutdown_connections 2024-03-07T07:31:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f67e4066f60 0x7f67e4069420 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68041478c0 0x7f680415ccc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68040d0c00 0x7f680415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 --2- 172.21.15.84:0/2202870103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6804071600 0x7f680413eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 >> 172.21.15.84:0/2202870103 conn(0x7f680406b5c0 msgr2=0x7f68041468f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 shutdown_connections 2024-03-07T07:31:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.694+0000 7f6808a00640 1 -- 172.21.15.84:0/2202870103 wait complete. 2024-03-07T07:31:45.713 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:45.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:45.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab16c00640 1 Processor -- start 2024-03-07T07:31:45.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab16c00640 1 -- start start 2024-03-07T07:31:45.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab16c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab100b3df0 0x7fab10169040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab16c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100704b0 con 0x7fab1015e2e0 2024-03-07T07:31:45.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab16c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100b4800 con 0x7fab1015df00 2024-03-07T07:31:45.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab16c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab100b45b0 con 0x7fab100b3df0 2024-03-07T07:31:45.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab07400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fab1015e2e0 0x7fab100b36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41250/0 (socket says 172.21.15.84:41250) 2024-03-07T07:31:45.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab07400640 1 -- 172.21.15.84:0/2579058772 learned_addr learned my addr 172.21.15.84:0/2579058772 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:45.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab14c00640 1 --2- 172.21.15.84:0/2579058772 >> v2:172.21.15.84:3300/0 conn(0x7fab100b3df0 0x7fab10169040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab0f400640 1 -- 172.21.15.84:0/2579058772 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530778703 0 0) 0x7fab100b4800 con 0x7fab1015df00 2024-03-07T07:31:45.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab14c00640 1 -- 172.21.15.84:0/2579058772 >> v1:172.21.15.161:6789/0 conn(0x7fab1015df00 legacy=0x7fab1006f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab14c00640 1 -- 172.21.15.84:0/2579058772 >> v1:172.21.15.84:6789/0 conn(0x7fab1015e2e0 legacy=0x7fab100b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.850+0000 7fab14c00640 1 -- 172.21.15.84:0/2579058772 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100b4ae0 con 0x7fab100b3df0 2024-03-07T07:31:45.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab14c00640 1 --2- 172.21.15.84:0/2579058772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab100b3df0 0x7fab10169040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab08009d90 tx=0x7fab0801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdf16a01f1170b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab0f400640 1 -- 172.21.15.84:0/2579058772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080b2070 con 0x7fab100b3df0 2024-03-07T07:31:45.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab0f400640 1 -- 172.21.15.84:0/2579058772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080a5920 con 0x7fab100b3df0 2024-03-07T07:31:45.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab0f400640 1 -- 172.21.15.84:0/2579058772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080a5cf0 con 0x7fab100b3df0 2024-03-07T07:31:45.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab16c00640 1 -- 172.21.15.84:0/2579058772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab100b3df0 msgr2=0x7fab10169040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab16c00640 1 --2- 172.21.15.84:0/2579058772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab100b3df0 0x7fab10169040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab08009d90 tx=0x7fab0801c970 comp rx=0 tx=0).stop 2024-03-07T07:31:45.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab16c00640 1 -- 172.21.15.84:0/2579058772 shutdown_connections 2024-03-07T07:31:45.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab16c00640 1 --2- 172.21.15.84:0/2579058772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab100b3df0 0x7fab10169040 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab16c00640 1 -- 172.21.15.84:0/2579058772 >> 172.21.15.84:0/2579058772 conn(0x7fab100cd530 msgr2=0x7fab100cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:45.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab16c00640 1 -- 172.21.15.84:0/2579058772 shutdown_connections 2024-03-07T07:31:45.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.854+0000 7fab16c00640 1 -- 172.21.15.84:0/2579058772 wait complete. 2024-03-07T07:31:45.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 Processor -- start 2024-03-07T07:31:45.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 -- start start 2024-03-07T07:31:45.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab100b3df0 0x7fab100cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1015df00 0x7fab1014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1015e2e0 0x7fab10152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1016bf20 con 0x7fab1015e2e0 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1016bda0 con 0x7fab100b3df0 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1016c0a0 con 0x7fab1015df00 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1015e2e0 0x7fab10152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1015e2e0 0x7fab10152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43164/0 (socket says 172.21.15.84:43164) 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 -- 172.21.15.84:0/92141881 learned_addr learned my addr 172.21.15.84:0/92141881 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab0fe00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab100b3df0 0x7fab100cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab07400640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1015df00 0x7fab1014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 -- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1015df00 msgr2=0x7fab1014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1015df00 0x7fab1014a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 -- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab100b3df0 msgr2=0x7fab100cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab100b3df0 0x7fab100cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 -- 172.21.15.84:0/92141881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab101510a0 con 0x7fab1015e2e0 2024-03-07T07:31:45.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab0fe00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab100b3df0 0x7fab100cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:45.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab14c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1015e2e0 0x7fab10152400 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fab080b0040 tx=0x7fab08019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab0cc00640 1 -- 172.21.15.84:0/92141881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080bd030 con 0x7fab1015e2e0 2024-03-07T07:31:45.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab0cc00640 1 -- 172.21.15.84:0/92141881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080ad580 con 0x7fab1015e2e0 2024-03-07T07:31:45.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab0cc00640 1 -- 172.21.15.84:0/92141881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080b2040 con 0x7fab1015e2e0 2024-03-07T07:31:45.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab10150dc0 con 0x7fab1015e2e0 2024-03-07T07:31:45.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1014bc80 con 0x7fab1015e2e0 2024-03-07T07:31:45.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.858+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab10062d40 con 0x7fab1015e2e0 2024-03-07T07:31:45.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.862+0000 7fab0cc00640 1 -- 172.21.15.84:0/92141881 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fab080c0070 con 0x7fab1015e2e0 2024-03-07T07:31:45.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.862+0000 7fab0cc00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faaec066f60 0x7faaec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:45.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.862+0000 7fab0cc00640 1 -- 172.21.15.84:0/92141881 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab0811faf0 con 0x7fab1015e2e0 2024-03-07T07:31:45.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.862+0000 7fab0fe00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faaec066f60 0x7faaec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:45.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.862+0000 7fab0fe00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faaec066f60 0x7faaec069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab1015c750 tx=0x7fab00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:45.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:45.866+0000 7fab0cc00640 1 -- 172.21.15.84:0/92141881 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fab080c8020 con 0x7fab1015e2e0 2024-03-07T07:31:46.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.022+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab10071440 con 0x7fab1015e2e0 2024-03-07T07:31:46.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.022+0000 7fab0cc00640 1 -- 172.21.15.84:0/92141881 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab08016560 con 0x7fab1015e2e0 2024-03-07T07:31:46.024 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:46.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faaec066f60 msgr2=0x7faaec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faaec066f60 0x7faaec069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab1015c750 tx=0x7fab00009040 comp rx=0 tx=0).stop 2024-03-07T07:31:46.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1015e2e0 msgr2=0x7fab10152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1015e2e0 0x7fab10152400 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fab080b0040 tx=0x7fab08019710 comp rx=0 tx=0).stop 2024-03-07T07:31:46.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 shutdown_connections 2024-03-07T07:31:46.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faaec066f60 0x7faaec069420 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1015e2e0 0x7fab10152400 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1015df00 0x7fab1014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 --2- 172.21.15.84:0/92141881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab100b3df0 0x7fab100cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 >> 172.21.15.84:0/92141881 conn(0x7fab100cd530 msgr2=0x7fab100cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:46.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 shutdown_connections 2024-03-07T07:31:46.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.026+0000 7fab16c00640 1 -- 172.21.15.84:0/92141881 wait complete. 2024-03-07T07:31:46.045 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:46.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.182+0000 7fb935000640 1 Processor -- start 2024-03-07T07:31:46.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb935000640 1 -- start start 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb935000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 0x7fb9300cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb935000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb93015fa50 0x7fb93006c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb935000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300d0720 con 0x7fb9300b46c0 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb935000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300d0ce0 con 0x7fb93015fa50 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb935000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93006b6e0 con 0x7fb93009ac40 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb92e800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb93015fa50 0x7fb93006c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb92de00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 0x7fb9300cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb927e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb9300b46c0 0x7fb93015f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41260/0 (socket says 172.21.15.84:41260) 2024-03-07T07:31:46.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb927e00640 1 -- 172.21.15.84:0/2662208461 learned_addr learned my addr 172.21.15.84:0/2662208461 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:46.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb92e800640 1 -- 172.21.15.84:0/2662208461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 msgr2=0x7fb9300cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:46.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb92e800640 1 --2- 172.21.15.84:0/2662208461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 0x7fb9300cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb92e800640 1 -- 172.21.15.84:0/2662208461 >> v1:172.21.15.84:6789/0 conn(0x7fb9300b46c0 legacy=0x7fb93015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb92e800640 1 -- 172.21.15.84:0/2662208461 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300d0a00 con 0x7fb93015fa50 2024-03-07T07:31:46.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.186+0000 7fb92d400640 1 -- 172.21.15.84:0/2662208461 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512654273 0 0) 0x7fb9300d0720 con 0x7fb9300b46c0 2024-03-07T07:31:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb92e800640 1 --2- 172.21.15.84:0/2662208461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 0x7fb93006c130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb928009d90 tx=0x7fb92801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1af1b263785b28e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb92d400640 1 -- 172.21.15.84:0/2662208461 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9280b2070 con 0x7fb93015fa50 2024-03-07T07:31:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb92d400640 1 -- 172.21.15.84:0/2662208461 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9280a5830 con 0x7fb93015fa50 2024-03-07T07:31:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb92d400640 1 -- 172.21.15.84:0/2662208461 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9280a5c00 con 0x7fb93015fa50 2024-03-07T07:31:46.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 -- 172.21.15.84:0/2662208461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 msgr2=0x7fb93006c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 --2- 172.21.15.84:0/2662208461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 0x7fb93006c130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb928009d90 tx=0x7fb92801c970 comp rx=0 tx=0).stop 2024-03-07T07:31:46.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 -- 172.21.15.84:0/2662208461 shutdown_connections 2024-03-07T07:31:46.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 --2- 172.21.15.84:0/2662208461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 0x7fb93006c130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 --2- 172.21.15.84:0/2662208461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 0x7fb9300cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 -- 172.21.15.84:0/2662208461 >> 172.21.15.84:0/2662208461 conn(0x7fb9300b3ba0 msgr2=0x7fb9300b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 -- 172.21.15.84:0/2662208461 shutdown_connections 2024-03-07T07:31:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 -- 172.21.15.84:0/2662208461 wait complete. 2024-03-07T07:31:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 Processor -- start 2024-03-07T07:31:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.190+0000 7fb935000640 1 -- start start 2024-03-07T07:31:46.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 0x7fb930157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9300b46c0 0x7fb93015c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 0x7fb9301648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93006d210 con 0x7fb9300b46c0 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93006d090 con 0x7fb93015fa50 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93006d390 con 0x7fb93009ac40 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9300b46c0 0x7fb93015c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb92de00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 0x7fb930157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9300b46c0 0x7fb93015c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43170/0 (socket says 172.21.15.84:43170) 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 -- 172.21.15.84:0/2890027747 learned_addr learned my addr 172.21.15.84:0/2890027747 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb92e800640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 0x7fb9301648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 -- 172.21.15.84:0/2890027747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 msgr2=0x7fb930157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 0x7fb930157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 -- 172.21.15.84:0/2890027747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 msgr2=0x7fb9301648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 0x7fb9301648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 -- 172.21.15.84:0/2890027747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300b1070 con 0x7fb9300b46c0 2024-03-07T07:31:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb927e00640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9300b46c0 0x7fb93015c4e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c480 tx=0x7fb91800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb926000640 1 -- 172.21.15.84:0/2890027747 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918018070 con 0x7fb9300b46c0 2024-03-07T07:31:46.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb926000640 1 -- 172.21.15.84:0/2890027747 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918007500 con 0x7fb9300b46c0 2024-03-07T07:31:46.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9300affd0 con 0x7fb9300b46c0 2024-03-07T07:31:46.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb926000640 1 -- 172.21.15.84:0/2890027747 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918004a30 con 0x7fb9300b46c0 2024-03-07T07:31:46.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9300b0590 con 0x7fb9300b46c0 2024-03-07T07:31:46.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb930062d40 con 0x7fb9300b46c0 2024-03-07T07:31:46.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.194+0000 7fb926000640 1 -- 172.21.15.84:0/2890027747 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb91801b070 con 0x7fb9300b46c0 2024-03-07T07:31:46.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.198+0000 7fb926000640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb90c066f90 0x7fb90c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.198+0000 7fb926000640 1 -- 172.21.15.84:0/2890027747 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9180842a0 con 0x7fb9300b46c0 2024-03-07T07:31:46.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.198+0000 7fb92de00640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb90c066f90 0x7fb90c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.198+0000 7fb92de00640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb90c066f90 0x7fb90c069450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb920009ac0 tx=0x7fb920009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.202+0000 7fb926000640 1 -- 172.21.15.84:0/2890027747 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb918054c50 con 0x7fb9300b46c0 2024-03-07T07:31:46.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.354+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb93015e890 con 0x7fb9300b46c0 2024-03-07T07:31:46.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.354+0000 7fb926000640 1 -- 172.21.15.84:0/2890027747 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb918058cf0 con 0x7fb9300b46c0 2024-03-07T07:31:46.356 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb90c066f90 msgr2=0x7fb90c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb90c066f90 0x7fb90c069450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb920009ac0 tx=0x7fb920009190 comp rx=0 tx=0).stop 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9300b46c0 msgr2=0x7fb93015c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9300b46c0 0x7fb93015c4e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c480 tx=0x7fb91800c940 comp rx=0 tx=0).stop 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 shutdown_connections 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb90c066f90 0x7fb90c069450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb93015fa50 0x7fb9301648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9300b46c0 0x7fb93015c4e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 --2- 172.21.15.84:0/2890027747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb93009ac40 0x7fb930157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 >> 172.21.15.84:0/2890027747 conn(0x7fb9300b3ba0 msgr2=0x7fb9300cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:46.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 shutdown_connections 2024-03-07T07:31:46.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.358+0000 7fb935000640 1 -- 172.21.15.84:0/2890027747 wait complete. 2024-03-07T07:31:46.377 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:46.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8db600640 1 Processor -- start 2024-03-07T07:31:46.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8db600640 1 -- start start 2024-03-07T07:31:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8db600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8d40ce3d0 0x7fa8d40ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8db600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d406eec0 con 0x7fa8d41442a0 2024-03-07T07:31:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8db600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d406f1a0 con 0x7fa8d40ced70 2024-03-07T07:31:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8db600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d40cc800 con 0x7fa8d40ce3d0 2024-03-07T07:31:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8cbe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8d40ce3d0 0x7fa8d40ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8d8c00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa8d41442a0 0x7fa8d40b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41276/0 (socket says 172.21.15.84:41276) 2024-03-07T07:31:46.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8d8c00640 1 -- 172.21.15.84:0/1667784346 learned_addr learned my addr 172.21.15.84:0/1667784346 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:46.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.514+0000 7fa8cbe00640 1 --2- 172.21.15.84:0/1667784346 >> v2:172.21.15.84:3300/0 conn(0x7fa8d40ce3d0 0x7fa8d40ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43184/0 (socket says 172.21.15.84:43184) 2024-03-07T07:31:46.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8cbe00640 1 -- 172.21.15.84:0/1667784346 >> v1:172.21.15.161:6789/0 conn(0x7fa8d40ced70 legacy=0x7fa8d406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8cbe00640 1 -- 172.21.15.84:0/1667784346 >> v1:172.21.15.84:6789/0 conn(0x7fa8d41442a0 legacy=0x7fa8d40b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8d3e00640 1 -- 172.21.15.84:0/1667784346 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404270552 0 0) 0x7fa8d406f1a0 con 0x7fa8d40ced70 2024-03-07T07:31:46.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8cbe00640 1 -- 172.21.15.84:0/1667784346 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40b4460 con 0x7fa8d40ce3d0 2024-03-07T07:31:46.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8cbe00640 1 --2- 172.21.15.84:0/1667784346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ce3d0 0x7fa8d40ce830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00ba60 tx=0x7fa8bc01ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc13bf62b8a86dda server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8d3e00640 1 -- 172.21.15.84:0/1667784346 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0b4070 con 0x7fa8d40ce3d0 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8d3e00640 1 -- 172.21.15.84:0/1667784346 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0a78f0 con 0x7fa8d40ce3d0 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8d3e00640 1 -- 172.21.15.84:0/1667784346 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0a7cc0 con 0x7fa8d40ce3d0 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8db600640 1 -- 172.21.15.84:0/1667784346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ce3d0 msgr2=0x7fa8d40ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8db600640 1 --2- 172.21.15.84:0/1667784346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ce3d0 0x7fa8d40ce830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00ba60 tx=0x7fa8bc01ea00 comp rx=0 tx=0).stop 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8db600640 1 -- 172.21.15.84:0/1667784346 shutdown_connections 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8db600640 1 --2- 172.21.15.84:0/1667784346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ce3d0 0x7fa8d40ce830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8db600640 1 -- 172.21.15.84:0/1667784346 >> 172.21.15.84:0/1667784346 conn(0x7fa8d40b1c50 msgr2=0x7fa8d40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8db600640 1 -- 172.21.15.84:0/1667784346 shutdown_connections 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.518+0000 7fa8db600640 1 -- 172.21.15.84:0/1667784346 wait complete. 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 Processor -- start 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 -- start start 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8d40ce3d0 0x7fa8d4164640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ced70 0x7fa8d415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8d41442a0 0x7fa8d4162a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40723d0 con 0x7fa8d40ced70 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4072250 con 0x7fa8d41442a0 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4072550 con 0x7fa8d40ce3d0 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ced70 0x7fa8d415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ced70 0x7fa8d415fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43196/0 (socket says 172.21.15.84:43196) 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 -- 172.21.15.84:0/1716922265 learned_addr learned my addr 172.21.15.84:0/1716922265 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8d8c00640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8d40ce3d0 0x7fa8d4164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8d9600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8d41442a0 0x7fa8d4162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 -- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8d40ce3d0 msgr2=0x7fa8d4164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8d40ce3d0 0x7fa8d4164640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 -- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8d41442a0 msgr2=0x7fa8d4162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8d41442a0 0x7fa8d4162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 -- 172.21.15.84:0/1716922265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4164d90 con 0x7fa8d40ced70 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8d9600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8d41442a0 0x7fa8d4162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8cbe00640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ced70 0x7fa8d415fe40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0b2040 tx=0x7fa8bc01b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8d1600640 1 -- 172.21.15.84:0/1716922265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0b4040 con 0x7fa8d40ced70 2024-03-07T07:31:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8d1600640 1 -- 172.21.15.84:0/1716922265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc004220 con 0x7fa8d40ced70 2024-03-07T07:31:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8d1600640 1 -- 172.21.15.84:0/1716922265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc003620 con 0x7fa8d40ced70 2024-03-07T07:31:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d4165070 con 0x7fa8d40ced70 2024-03-07T07:31:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.522+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d4165630 con 0x7fa8d40ced70 2024-03-07T07:31:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.526+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d4062d40 con 0x7fa8d40ced70 2024-03-07T07:31:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.526+0000 7fa8d1600640 1 -- 172.21.15.84:0/1716922265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa8bc0c4060 con 0x7fa8d40ced70 2024-03-07T07:31:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.526+0000 7fa8d1600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa8b0066f60 0x7fa8b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.526+0000 7fa8d1600640 1 -- 172.21.15.84:0/1716922265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8bc1215e0 con 0x7fa8d40ced70 2024-03-07T07:31:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.526+0000 7fa8d8c00640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa8b0066f60 0x7fa8b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.526+0000 7fa8d8c00640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa8b0066f60 0x7fa8b0069420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4000f70 tx=0x7fa8c4007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.530+0000 7fa8d1600640 1 -- 172.21.15.84:0/1716922265 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa8bc018680 con 0x7fa8d40ced70 2024-03-07T07:31:46.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.682+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8d4071c80 con 0x7fa8d40ced70 2024-03-07T07:31:46.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.682+0000 7fa8d1600640 1 -- 172.21.15.84:0/1716922265 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8bc0f2560 con 0x7fa8d40ced70 2024-03-07T07:31:46.684 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa8b0066f60 msgr2=0x7fa8b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa8b0066f60 0x7fa8b0069420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4000f70 tx=0x7fa8c4007e30 comp rx=0 tx=0).stop 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ced70 msgr2=0x7fa8d415fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ced70 0x7fa8d415fe40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0b2040 tx=0x7fa8bc01b7a0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 shutdown_connections 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa8b0066f60 0x7fa8b0069420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8d41442a0 0x7fa8d4162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d40ced70 0x7fa8d415fe40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 --2- 172.21.15.84:0/1716922265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8d40ce3d0 0x7fa8d4164640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 >> 172.21.15.84:0/1716922265 conn(0x7fa8d40b1c50 msgr2=0x7fa8d4142020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:46.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 shutdown_connections 2024-03-07T07:31:46.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.686+0000 7fa8db600640 1 -- 172.21.15.84:0/1716922265 wait complete. 2024-03-07T07:31:46.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-03-07T07:31:46.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.838+0000 7f21bfa00640 1 Processor -- start 2024-03-07T07:31:46.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.838+0000 7f21bfa00640 1 -- start start 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bfa00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f21b80a9540 0x7f21b815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bfa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b80730e0 0x7f21b815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bfa00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b806d780 con 0x7f21b8145a30 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bfa00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b806da60 con 0x7f21b80a9540 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bfa00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b806dd40 con 0x7f21b80730e0 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bd000640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f21b8145a30 0x7f21b80729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33256/0 (socket says 172.21.15.84:33256) 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bd000640 1 -- 172.21.15.84:0/2813112188 learned_addr learned my addr 172.21.15.84:0/2813112188 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bda00640 1 --2- 172.21.15.84:0/2813112188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b80730e0 0x7f21b815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21b7e00640 1 --2- 172.21.15.84:0/2813112188 >> v2:172.21.15.161:3300/0 conn(0x7f21b80a9540 0x7f21b815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21b7400640 1 -- 172.21.15.84:0/2813112188 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230779386 0 0) 0x7f21b806d780 con 0x7f21b8145a30 2024-03-07T07:31:46.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21b7400640 1 -- 172.21.15.84:0/2813112188 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f219c003530 con 0x7f21b8145a30 2024-03-07T07:31:46.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bda00640 1 -- 172.21.15.84:0/2813112188 >> v2:172.21.15.161:3300/0 conn(0x7f21b80a9540 msgr2=0x7f21b815c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:46.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bda00640 1 --2- 172.21.15.84:0/2813112188 >> v2:172.21.15.161:3300/0 conn(0x7f21b80a9540 0x7f21b815c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bda00640 1 -- 172.21.15.84:0/2813112188 >> v1:172.21.15.161:6789/0 conn(0x7f21b8145a30 legacy=0x7f21b80729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21bda00640 1 -- 172.21.15.84:0/2813112188 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b806e020 con 0x7f21b80730e0 2024-03-07T07:31:46.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.842+0000 7f21b7e00640 1 --2- 172.21.15.84:0/2813112188 >> v2:172.21.15.161:3300/0 conn(0x7f21b80a9540 0x7f21b815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:46.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bda00640 1 --2- 172.21.15.84:0/2813112188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b80730e0 0x7f21b815cd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21b00097c0 tx=0x7f21b001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2751b7ee2ee61e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21b7400640 1 -- 172.21.15.84:0/2813112188 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b00b0070 con 0x7f21b80730e0 2024-03-07T07:31:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21b7400640 1 -- 172.21.15.84:0/2813112188 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b00ab600 con 0x7f21b80730e0 2024-03-07T07:31:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21b7400640 1 -- 172.21.15.84:0/2813112188 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b00ab9d0 con 0x7f21b80730e0 2024-03-07T07:31:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 -- 172.21.15.84:0/2813112188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b80730e0 msgr2=0x7f21b815cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 --2- 172.21.15.84:0/2813112188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b80730e0 0x7f21b815cd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21b00097c0 tx=0x7f21b001c380 comp rx=0 tx=0).stop 2024-03-07T07:31:46.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 -- 172.21.15.84:0/2813112188 shutdown_connections 2024-03-07T07:31:46.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 --2- 172.21.15.84:0/2813112188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b80730e0 0x7f21b815cd20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 --2- 172.21.15.84:0/2813112188 >> v2:172.21.15.161:3300/0 conn(0x7f21b80a9540 0x7f21b815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 -- 172.21.15.84:0/2813112188 >> 172.21.15.84:0/2813112188 conn(0x7f21b80704b0 msgr2=0x7f21b80708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:46.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 -- 172.21.15.84:0/2813112188 shutdown_connections 2024-03-07T07:31:46.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 -- 172.21.15.84:0/2813112188 wait complete. 2024-03-07T07:31:46.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.846+0000 7f21bfa00640 1 Processor -- start 2024-03-07T07:31:46.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 -- start start 2024-03-07T07:31:46.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21b80730e0 0x7f21b815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b8145a30 0x7f21b80cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b813e230 0x7f21b813e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8168d60 con 0x7f21b80730e0 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8168be0 con 0x7f21b813e230 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8168ee0 con 0x7f21b8145a30 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21b80730e0 0x7f21b815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21b80730e0 0x7f21b815baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43200/0 (socket says 172.21.15.84:43200) 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 -- 172.21.15.84:0/3423365360 learned_addr learned my addr 172.21.15.84:0/3423365360 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21b7e00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b8145a30 0x7f21b80cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bda00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b813e230 0x7f21b813e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 -- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b8145a30 msgr2=0x7f21b80cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b8145a30 0x7f21b80cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 -- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b813e230 msgr2=0x7f21b813e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b813e230 0x7f21b813e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 -- 172.21.15.84:0/3423365360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b813ecf0 con 0x7f21b80730e0 2024-03-07T07:31:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bda00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b813e230 0x7f21b813e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bd000640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21b80730e0 0x7f21b815baf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f21a800caa0 tx=0x7f21a800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21b4c00640 1 -- 172.21.15.84:0/3423365360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8017070 con 0x7f21b80730e0 2024-03-07T07:31:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21b4c00640 1 -- 172.21.15.84:0/3423365360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a800ac00 con 0x7f21b80730e0 2024-03-07T07:31:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b813efd0 con 0x7f21b80730e0 2024-03-07T07:31:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21b4c00640 1 -- 172.21.15.84:0/3423365360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8012400 con 0x7f21b80730e0 2024-03-07T07:31:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b80cd8e0 con 0x7f21b80730e0 2024-03-07T07:31:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.850+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b8062d40 con 0x7f21b80730e0 2024-03-07T07:31:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.854+0000 7f21b4c00640 1 -- 172.21.15.84:0/3423365360 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f21a801a070 con 0x7f21b80730e0 2024-03-07T07:31:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.854+0000 7f21b4c00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2198066f60 0x7f2198069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.854+0000 7f21b4c00640 1 -- 172.21.15.84:0/3423365360 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21a8084da0 con 0x7f21b80730e0 2024-03-07T07:31:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.854+0000 7f21b7e00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2198066f60 0x7f2198069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.854+0000 7f21b7e00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2198066f60 0x7f2198069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009580 tx=0x7f21a4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:46.858+0000 7f21b4c00640 1 -- 172.21.15.84:0/3423365360 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f21a80556d0 con 0x7f21b80730e0 2024-03-07T07:31:47.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.066+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7f21b8072d50 con 0x7f21b80730e0 2024-03-07T07:31:47.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.454+0000 7f21b4c00640 1 -- 172.21.15.84:0/3423365360 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v58) v1 ==== 123+0+0 (secure 0 0 0) 0x7f21a8059770 con 0x7f21b80730e0 2024-03-07T07:31:47.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2198066f60 msgr2=0x7f2198069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2198066f60 0x7f2198069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009580 tx=0x7f21a4009190 comp rx=0 tx=0).stop 2024-03-07T07:31:47.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21b80730e0 msgr2=0x7f21b815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21b80730e0 0x7f21b815baf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f21a800caa0 tx=0x7f21a800cf60 comp rx=0 tx=0).stop 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 shutdown_connections 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2198066f60 0x7f2198069420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b813e230 0x7f21b813e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21b8145a30 0x7f21b80cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 --2- 172.21.15.84:0/3423365360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21b80730e0 0x7f21b815baf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 >> 172.21.15.84:0/3423365360 conn(0x7f21b80704b0 msgr2=0x7f21b8166200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 shutdown_connections 2024-03-07T07:31:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.458+0000 7f21bfa00640 1 -- 172.21.15.84:0/3423365360 wait complete. 2024-03-07T07:31:47.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-07T07:31:47.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe333200640 1 Processor -- start 2024-03-07T07:31:47.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe333200640 1 -- start start 2024-03-07T07:31:47.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe333200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe32c147730 0x7fe32c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe333200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c162bc0 con 0x7fe32c0aea80 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe333200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c06e800 con 0x7fe32c147150 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe333200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c06ee50 con 0x7fe32c147730 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe32b400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe32c147730 0x7fe32c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe32b400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe32c147730 0x7fe32c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43202/0 (socket says 172.21.15.84:43202) 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe32b400640 1 -- 172.21.15.84:0/1920157358 learned_addr learned my addr 172.21.15.84:0/1920157358 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe32be00640 1 --1- 172.21.15.84:0/1920157358 >> v1:172.21.15.161:6789/0 conn(0x7fe32c147150 0x7fe32c06f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33258/0 (socket says 172.21.15.84:33258) 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe331200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe32c0aea80 0x7fe32c0b3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41290/0 (socket says 172.21.15.84:41290) 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe32b400640 1 -- 172.21.15.84:0/1920157358 >> v1:172.21.15.161:6789/0 conn(0x7fe32c147150 legacy=0x7fe32c06f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe32b400640 1 -- 172.21.15.84:0/1920157358 >> v1:172.21.15.84:6789/0 conn(0x7fe32c0aea80 legacy=0x7fe32c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe32b400640 1 -- 172.21.15.84:0/1920157358 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c06eae0 con 0x7fe32c147730 2024-03-07T07:31:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.618+0000 7fe32aa00640 1 -- 172.21.15.84:0/1920157358 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862497422 0 0) 0x7fe32c06e800 con 0x7fe32c147150 2024-03-07T07:31:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe32b400640 1 --2- 172.21.15.84:0/1920157358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c147730 0x7fe32c06bc10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe318009870 tx=0x7fe31801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51585f29bc3f5a2e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:47.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe32aa00640 1 -- 172.21.15.84:0/1920157358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180b0070 con 0x7fe32c147730 2024-03-07T07:31:47.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe32aa00640 1 -- 172.21.15.84:0/1920157358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3180ab600 con 0x7fe32c147730 2024-03-07T07:31:47.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe32aa00640 1 -- 172.21.15.84:0/1920157358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180ab9d0 con 0x7fe32c147730 2024-03-07T07:31:47.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 -- 172.21.15.84:0/1920157358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c147730 msgr2=0x7fe32c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 --2- 172.21.15.84:0/1920157358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c147730 0x7fe32c06bc10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe318009870 tx=0x7fe31801c4d0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 -- 172.21.15.84:0/1920157358 shutdown_connections 2024-03-07T07:31:47.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 --2- 172.21.15.84:0/1920157358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c147730 0x7fe32c06bc10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 -- 172.21.15.84:0/1920157358 >> 172.21.15.84:0/1920157358 conn(0x7fe32c06b0f0 msgr2=0x7fe32c06b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:47.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 -- 172.21.15.84:0/1920157358 shutdown_connections 2024-03-07T07:31:47.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 -- 172.21.15.84:0/1920157358 wait complete. 2024-03-07T07:31:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 Processor -- start 2024-03-07T07:31:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.622+0000 7fe333200640 1 -- start start 2024-03-07T07:31:47.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c0aea80 0x7fe32c1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:47.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32c147150 0x7fe32c13dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32c147730 0x7fe32c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c16caf0 con 0x7fe32c0aea80 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c16c970 con 0x7fe32c147150 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c16cc70 con 0x7fe32c147730 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c0aea80 0x7fe32c1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c0aea80 0x7fe32c1587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43216/0 (socket says 172.21.15.84:43216) 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 -- 172.21.15.84:0/4010461171 learned_addr learned my addr 172.21.15.84:0/4010461171 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32b400640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32c147150 0x7fe32c13dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe331200640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32c147730 0x7fe32c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 -- 172.21.15.84:0/4010461171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32c147730 msgr2=0x7fe32c1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32c147730 0x7fe32c1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 -- 172.21.15.84:0/4010461171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32c147150 msgr2=0x7fe32c13dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32c147150 0x7fe32c13dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 -- 172.21.15.84:0/4010461171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c15f960 con 0x7fe32c0aea80 2024-03-07T07:31:47.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe32be00640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c0aea80 0x7fe32c1587a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c440 tx=0x7fe31c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:47.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe323e00640 1 -- 172.21.15.84:0/4010461171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c018070 con 0x7fe32c0aea80 2024-03-07T07:31:47.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe323e00640 1 -- 172.21.15.84:0/4010461171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c0074e0 con 0x7fe32c0aea80 2024-03-07T07:31:47.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe323e00640 1 -- 172.21.15.84:0/4010461171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c004a10 con 0x7fe32c0aea80 2024-03-07T07:31:47.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c15fbd0 con 0x7fe32c0aea80 2024-03-07T07:31:47.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c160190 con 0x7fe32c0aea80 2024-03-07T07:31:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.626+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c062d40 con 0x7fe32c0aea80 2024-03-07T07:31:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.630+0000 7fe323e00640 1 -- 172.21.15.84:0/4010461171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe31c01b070 con 0x7fe32c0aea80 2024-03-07T07:31:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.630+0000 7fe323e00640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe30c066f60 0x7fe30c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.630+0000 7fe323e00640 1 -- 172.21.15.84:0/4010461171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe31c084290 con 0x7fe32c0aea80 2024-03-07T07:31:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.630+0000 7fe32b400640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe30c066f60 0x7fe30c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:47.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.630+0000 7fe32b400640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe30c066f60 0x7fe30c069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ad000 tx=0x7fe318008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:47.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.634+0000 7fe323e00640 1 -- 172.21.15.84:0/4010461171 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe31c054bb0 con 0x7fe32c0aea80 2024-03-07T07:31:47.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.786+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe32c074d80 con 0x7fe32c0aea80 2024-03-07T07:31:47.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.790+0000 7fe323e00640 1 -- 172.21.15.84:0/4010461171 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe31c058c50 con 0x7fe32c0aea80 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe30c066f60 msgr2=0x7fe30c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe30c066f60 0x7fe30c069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ad000 tx=0x7fe318008040 comp rx=0 tx=0).stop 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c0aea80 msgr2=0x7fe32c1587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c0aea80 0x7fe32c1587a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c440 tx=0x7fe31c00c900 comp rx=0 tx=0).stop 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 shutdown_connections 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe30c066f60 0x7fe30c069420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe32c147730 0x7fe32c1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32c147150 0x7fe32c13dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 --2- 172.21.15.84:0/4010461171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c0aea80 0x7fe32c1587a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:47.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 >> 172.21.15.84:0/4010461171 conn(0x7fe32c06b0f0 msgr2=0x7fe32c145970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:47.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 shutdown_connections 2024-03-07T07:31:47.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:47.794+0000 7fe333200640 1 -- 172.21.15.84:0/4010461171 wait complete. 2024-03-07T07:31:47.811 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-07T07:31:47.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-07T07:31:47.894 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-07T07:31:47.945 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-07T07:31:47.945 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:31:47.945 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:47.954 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:31:47.954 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:48.004 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:31:48.004 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:48.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:48.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9ab200640 1 Processor -- start 2024-03-07T07:31:48.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9ab200640 1 -- start start 2024-03-07T07:31:48.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9ab200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9a4145a30 0x7fd9a40729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9ab200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9a40a9540 0x7fd9a4072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9ab200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a406d780 con 0x7fd9a406d230 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9ab200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a406da60 con 0x7fd9a40a9540 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9ab200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a406dd40 con 0x7fd9a4145a30 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd99b400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9a40a9540 0x7fd9a4072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd99b400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9a40a9540 0x7fd9a4072f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43222/0 (socket says 172.21.15.84:43222) 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9a9200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd9a406d230 0x7fd9a40ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41298/0 (socket says 172.21.15.84:41298) 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd99b400640 1 -- 172.21.15.84:0/4281478587 learned_addr learned my addr 172.21.15.84:0/4281478587 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd9a3e00640 1 --2- 172.21.15.84:0/4281478587 >> v2:172.21.15.161:3300/0 conn(0x7fd9a4145a30 0x7fd9a40729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd99b400640 1 -- 172.21.15.84:0/4281478587 >> v2:172.21.15.161:3300/0 conn(0x7fd9a4145a30 msgr2=0x7fd9a40729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd99b400640 1 --2- 172.21.15.84:0/4281478587 >> v2:172.21.15.161:3300/0 conn(0x7fd9a4145a30 0x7fd9a40729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd99b400640 1 -- 172.21.15.84:0/4281478587 >> v1:172.21.15.84:6789/0 conn(0x7fd9a406d230 legacy=0x7fd9a40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.234+0000 7fd99b400640 1 -- 172.21.15.84:0/4281478587 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a406e020 con 0x7fd9a40a9540 2024-03-07T07:31:48.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd99b400640 1 --2- 172.21.15.84:0/4281478587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a40a9540 0x7fd9a4072f10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4069290 tx=0x7fd98c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacb2a581568a5f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9a3400640 1 -- 172.21.15.84:0/4281478587 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0b1070 con 0x7fd9a40a9540 2024-03-07T07:31:48.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9a3400640 1 -- 172.21.15.84:0/4281478587 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c0ac640 con 0x7fd9a40a9540 2024-03-07T07:31:48.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9a3400640 1 -- 172.21.15.84:0/4281478587 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0aca10 con 0x7fd9a40a9540 2024-03-07T07:31:48.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9ab200640 1 -- 172.21.15.84:0/4281478587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a40a9540 msgr2=0x7fd9a4072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9ab200640 1 --2- 172.21.15.84:0/4281478587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a40a9540 0x7fd9a4072f10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4069290 tx=0x7fd98c01c400 comp rx=0 tx=0).stop 2024-03-07T07:31:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9ab200640 1 -- 172.21.15.84:0/4281478587 shutdown_connections 2024-03-07T07:31:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9ab200640 1 --2- 172.21.15.84:0/4281478587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a40a9540 0x7fd9a4072f10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9ab200640 1 --2- 172.21.15.84:0/4281478587 >> v2:172.21.15.161:3300/0 conn(0x7fd9a4145a30 0x7fd9a40729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9ab200640 1 -- 172.21.15.84:0/4281478587 >> 172.21.15.84:0/4281478587 conn(0x7fd9a40704b0 msgr2=0x7fd9a40708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9ab200640 1 -- 172.21.15.84:0/4281478587 shutdown_connections 2024-03-07T07:31:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.238+0000 7fd9ab200640 1 -- 172.21.15.84:0/4281478587 wait complete. 2024-03-07T07:31:48.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 Processor -- start 2024-03-07T07:31:48.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 -- start start 2024-03-07T07:31:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a406d230 0x7fd9a41594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a4145a30 0x7fd9a4136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a415e470 0x7fd9a4136b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4168d60 con 0x7fd9a415e470 2024-03-07T07:31:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4168be0 con 0x7fd9a406d230 2024-03-07T07:31:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4168ee0 con 0x7fd9a4145a30 2024-03-07T07:31:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a415e470 0x7fd9a4136b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a415e470 0x7fd9a4136b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43238/0 (socket says 172.21.15.84:43238) 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 -- 172.21.15.84:0/384075977 learned_addr learned my addr 172.21.15.84:0/384075977 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a3e00640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a406d230 0x7fd9a41594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd99b400640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a4145a30 0x7fd9a4136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 -- 172.21.15.84:0/384075977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a4145a30 msgr2=0x7fd9a4136640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a4145a30 0x7fd9a4136640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 -- 172.21.15.84:0/384075977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a406d230 msgr2=0x7fd9a41594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a406d230 0x7fd9a41594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 -- 172.21.15.84:0/384075977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a40ccaa0 con 0x7fd9a415e470 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a9200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a415e470 0x7fd9a4136b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c3c0 tx=0x7fd99c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a0c00640 1 -- 172.21.15.84:0/384075977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0074e0 con 0x7fd9a415e470 2024-03-07T07:31:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a0c00640 1 -- 172.21.15.84:0/384075977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c007680 con 0x7fd9a415e470 2024-03-07T07:31:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9a0c00640 1 -- 172.21.15.84:0/384075977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c004a10 con 0x7fd9a415e470 2024-03-07T07:31:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a40cda30 con 0x7fd9a415e470 2024-03-07T07:31:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a415ecb0 con 0x7fd9a415e470 2024-03-07T07:31:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.242+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a4062d40 con 0x7fd9a415e470 2024-03-07T07:31:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.246+0000 7fd9a0c00640 1 -- 172.21.15.84:0/384075977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fd99c01a020 con 0x7fd9a415e470 2024-03-07T07:31:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.246+0000 7fd9a0c00640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd980066f60 0x7fd980069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.246+0000 7fd9a0c00640 1 -- 172.21.15.84:0/384075977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd99c084610 con 0x7fd9a415e470 2024-03-07T07:31:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.246+0000 7fd9a3e00640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd980066f60 0x7fd980069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.246+0000 7fd9a3e00640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd980066f60 0x7fd980069420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd9940113e0 tx=0x7fd99400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.250+0000 7fd9a0c00640 1 -- 172.21.15.84:0/384075977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fd99c054fc0 con 0x7fd9a415e470 2024-03-07T07:31:48.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9a415e940 con 0x7fd9a415e470 2024-03-07T07:31:48.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9a0c00640 1 -- 172.21.15.84:0/384075977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7fd99c059060 con 0x7fd9a415e470 2024-03-07T07:31:48.406 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:48.406 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd980066f60 msgr2=0x7fd980069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd980066f60 0x7fd980069420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd9940113e0 tx=0x7fd99400b040 comp rx=0 tx=0).stop 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a415e470 msgr2=0x7fd9a4136b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a415e470 0x7fd9a4136b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c3c0 tx=0x7fd99c00c880 comp rx=0 tx=0).stop 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 shutdown_connections 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd980066f60 0x7fd980069420 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9a415e470 0x7fd9a4136b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9a4145a30 0x7fd9a4136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 --2- 172.21.15.84:0/384075977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9a406d230 0x7fd9a41594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.406+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 >> 172.21.15.84:0/384075977 conn(0x7fd9a40704b0 msgr2=0x7fd9a40b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.410+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 shutdown_connections 2024-03-07T07:31:48.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.410+0000 7fd9ab200640 1 -- 172.21.15.84:0/384075977 wait complete. 2024-03-07T07:31:48.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:48.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd55400640 1 Processor -- start 2024-03-07T07:31:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd55400640 1 -- start start 2024-03-07T07:31:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd55400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd5015c3d0 0x7fbd500cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd55400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbd500cd950 0x7fbd500724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd55400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd500b4a60 con 0x7fbd50145090 2024-03-07T07:31:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd55400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd500cdda0 con 0x7fbd500cd950 2024-03-07T07:31:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd55400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500b4d40 con 0x7fbd5015c3d0 2024-03-07T07:31:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd4e800640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbd50145090 0x7fbd500cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41306/0 (socket says 172.21.15.84:41306) 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd4e800640 1 -- 172.21.15.84:0/714526321 learned_addr learned my addr 172.21.15.84:0/714526321 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd47e00640 1 --2- 172.21.15.84:0/714526321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd5015c3d0 0x7fbd500cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd4f200640 1 --2- 172.21.15.84:0/714526321 >> v2:172.21.15.161:3300/0 conn(0x7fbd500cd950 0x7fbd500724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd4de00640 1 -- 172.21.15.84:0/714526321 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427109528 0 0) 0x7fbd500b4a60 con 0x7fbd50145090 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd4de00640 1 -- 172.21.15.84:0/714526321 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd34003530 con 0x7fbd50145090 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd47e00640 1 -- 172.21.15.84:0/714526321 >> v2:172.21.15.161:3300/0 conn(0x7fbd500cd950 msgr2=0x7fbd500724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd47e00640 1 --2- 172.21.15.84:0/714526321 >> v2:172.21.15.161:3300/0 conn(0x7fbd500cd950 0x7fbd500724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd47e00640 1 -- 172.21.15.84:0/714526321 >> v1:172.21.15.84:6789/0 conn(0x7fbd50145090 legacy=0x7fbd500cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.566+0000 7fbd47e00640 1 -- 172.21.15.84:0/714526321 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500719c0 con 0x7fbd5015c3d0 2024-03-07T07:31:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd47e00640 1 --2- 172.21.15.84:0/714526321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd5015c3d0 0x7fbd500cd410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd380097c0 tx=0x7fbd3801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=726456a6e95a3edb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd4de00640 1 -- 172.21.15.84:0/714526321 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380a7070 con 0x7fbd5015c3d0 2024-03-07T07:31:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd4de00640 1 -- 172.21.15.84:0/714526321 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd380b0070 con 0x7fbd5015c3d0 2024-03-07T07:31:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd4de00640 1 -- 172.21.15.84:0/714526321 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380ab870 con 0x7fbd5015c3d0 2024-03-07T07:31:48.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd55400640 1 -- 172.21.15.84:0/714526321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd5015c3d0 msgr2=0x7fbd500cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd55400640 1 --2- 172.21.15.84:0/714526321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd5015c3d0 0x7fbd500cd410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd380097c0 tx=0x7fbd3801c470 comp rx=0 tx=0).stop 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd55400640 1 -- 172.21.15.84:0/714526321 shutdown_connections 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd55400640 1 --2- 172.21.15.84:0/714526321 >> v2:172.21.15.161:3300/0 conn(0x7fbd500cd950 0x7fbd500724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd55400640 1 --2- 172.21.15.84:0/714526321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd5015c3d0 0x7fbd500cd410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd55400640 1 -- 172.21.15.84:0/714526321 >> 172.21.15.84:0/714526321 conn(0x7fbd500b1c50 msgr2=0x7fbd500b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd55400640 1 -- 172.21.15.84:0/714526321 shutdown_connections 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.570+0000 7fbd55400640 1 -- 172.21.15.84:0/714526321 wait complete. 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 Processor -- start 2024-03-07T07:31:48.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 -- start start 2024-03-07T07:31:48.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd500cd950 0x7fbd5013bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd50145090 0x7fbd50137a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd5015c3d0 0x7fbd5013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50145830 con 0x7fbd50145090 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500b4710 con 0x7fbd5015c3d0 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd501459b0 con 0x7fbd500cd950 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd50145090 0x7fbd50137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd50145090 0x7fbd50137a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43242/0 (socket says 172.21.15.84:43242) 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 -- 172.21.15.84:0/3044191708 learned_addr learned my addr 172.21.15.84:0/3044191708 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd4e800640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd500cd950 0x7fbd5013bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd4f200640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd5015c3d0 0x7fbd5013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 -- 172.21.15.84:0/3044191708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd500cd950 msgr2=0x7fbd5013bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd500cd950 0x7fbd5013bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 -- 172.21.15.84:0/3044191708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd5015c3d0 msgr2=0x7fbd5013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd5015c3d0 0x7fbd5013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 -- 172.21.15.84:0/3044191708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5013b160 con 0x7fbd50145090 2024-03-07T07:31:48.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd47e00640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd50145090 0x7fbd50137a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd3801ab20 tx=0x7fbd38019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd46a00640 1 -- 172.21.15.84:0/3044191708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380abb70 con 0x7fbd50145090 2024-03-07T07:31:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd46a00640 1 -- 172.21.15.84:0/3044191708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd380abd10 con 0x7fbd50145090 2024-03-07T07:31:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd46a00640 1 -- 172.21.15.84:0/3044191708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380bf650 con 0x7fbd50145090 2024-03-07T07:31:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd50136f20 con 0x7fbd50145090 2024-03-07T07:31:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.574+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5013c450 con 0x7fbd50145090 2024-03-07T07:31:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.578+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd50062d40 con 0x7fbd50145090 2024-03-07T07:31:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.578+0000 7fbd46a00640 1 -- 172.21.15.84:0/3044191708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fbd380c93f0 con 0x7fbd50145090 2024-03-07T07:31:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.578+0000 7fbd46a00640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbd2c066f60 0x7fbd2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.578+0000 7fbd46a00640 1 -- 172.21.15.84:0/3044191708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd3811f740 con 0x7fbd50145090 2024-03-07T07:31:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.578+0000 7fbd4e800640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbd2c066f60 0x7fbd2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.578+0000 7fbd4e800640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbd2c066f60 0x7fbd2c069420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd40007fd0 tx=0x7fbd40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.582+0000 7fbd46a00640 1 -- 172.21.15.84:0/3044191708 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fbd38016090 con 0x7fbd50145090 2024-03-07T07:31:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.734+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd50136cd0 con 0x7fbd50145090 2024-03-07T07:31:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.734+0000 7fbd46a00640 1 -- 172.21.15.84:0/3044191708 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd380f0210 con 0x7fbd50145090 2024-03-07T07:31:48.736 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:48.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbd2c066f60 msgr2=0x7fbd2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbd2c066f60 0x7fbd2c069420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd40007fd0 tx=0x7fbd40009040 comp rx=0 tx=0).stop 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd50145090 msgr2=0x7fbd50137a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd50145090 0x7fbd50137a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd3801ab20 tx=0x7fbd38019210 comp rx=0 tx=0).stop 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 shutdown_connections 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbd2c066f60 0x7fbd2c069420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd5015c3d0 0x7fbd5013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd50145090 0x7fbd50137a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 --2- 172.21.15.84:0/3044191708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd500cd950 0x7fbd5013bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 >> 172.21.15.84:0/3044191708 conn(0x7fbd500b1c50 msgr2=0x7fbd500b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 shutdown_connections 2024-03-07T07:31:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.738+0000 7fbd55400640 1 -- 172.21.15.84:0/3044191708 wait complete. 2024-03-07T07:31:48.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:48.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.894+0000 7f39bf400640 1 Processor -- start 2024-03-07T07:31:48.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.894+0000 7f39bf400640 1 -- start start 2024-03-07T07:31:48.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bf400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f39b815df00 0x7f39b806f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bf400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39b80b3df0 0x7f39b8070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bf400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b80704b0 con 0x7f39b815e2e0 2024-03-07T07:31:48.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bf400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b80b45b0 con 0x7f39b80b3df0 2024-03-07T07:31:48.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bf400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b80b4800 con 0x7f39b815df00 2024-03-07T07:31:48.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bd400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39b80b3df0 0x7f39b8070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bca00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f39b815df00 0x7f39b806f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bd400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39b80b3df0 0x7f39b8070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43248/0 (socket says 172.21.15.84:43248) 2024-03-07T07:31:48.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bd400640 1 -- 172.21.15.84:0/781535163 learned_addr learned my addr 172.21.15.84:0/781535163 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:48.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39afe00640 1 --1- 172.21.15.84:0/781535163 >> v1:172.21.15.161:6789/0 conn(0x7f39b815e2e0 0x7f39b80b36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33264/0 (socket says 172.21.15.84:33264) 2024-03-07T07:31:48.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bd400640 1 -- 172.21.15.84:0/781535163 >> v2:172.21.15.161:3300/0 conn(0x7f39b815df00 msgr2=0x7f39b806f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:48.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bd400640 1 --2- 172.21.15.84:0/781535163 >> v2:172.21.15.161:3300/0 conn(0x7f39b815df00 0x7f39b806f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bd400640 1 -- 172.21.15.84:0/781535163 >> v1:172.21.15.161:6789/0 conn(0x7f39b815e2e0 legacy=0x7f39b80b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bd400640 1 -- 172.21.15.84:0/781535163 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b80b4ae0 con 0x7f39b80b3df0 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39bd400640 1 --2- 172.21.15.84:0/781535163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8070990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39b80ce290 tx=0x7f39b001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23af40c2ff07a12 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.898+0000 7f39b7e00640 1 -- 172.21.15.84:0/781535163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00a57a0 con 0x7f39b80b3df0 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39b7e00640 1 -- 172.21.15.84:0/781535163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b00a5940 con 0x7f39b80b3df0 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39b7e00640 1 -- 172.21.15.84:0/781535163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00a5d10 con 0x7f39b80b3df0 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- 172.21.15.84:0/781535163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 msgr2=0x7f39b8070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 --2- 172.21.15.84:0/781535163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8070990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39b80ce290 tx=0x7f39b001c9f0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- 172.21.15.84:0/781535163 shutdown_connections 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 --2- 172.21.15.84:0/781535163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8070990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 --2- 172.21.15.84:0/781535163 >> v2:172.21.15.161:3300/0 conn(0x7f39b815df00 0x7f39b806f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- 172.21.15.84:0/781535163 >> 172.21.15.84:0/781535163 conn(0x7f39b80cd530 msgr2=0x7f39b80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:48.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- 172.21.15.84:0/781535163 shutdown_connections 2024-03-07T07:31:48.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- 172.21.15.84:0/781535163 wait complete. 2024-03-07T07:31:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 Processor -- start 2024-03-07T07:31:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- start start 2024-03-07T07:31:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b815df00 0x7f39b8154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b815e2e0 0x7f39b8155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8071a70 con 0x7f39b80b3df0 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80718f0 con 0x7f39b815e2e0 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bf400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8071bf0 con 0x7f39b815df00 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43256/0 (socket says 172.21.15.84:43256) 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bca00640 1 -- 172.21.15.84:0/2815958766 learned_addr learned my addr 172.21.15.84:0/2815958766 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39afe00640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b815df00 0x7f39b8154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bd400640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b815e2e0 0x7f39b8155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bca00640 1 -- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b815df00 msgr2=0x7f39b8154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bca00640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b815df00 0x7f39b8154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bca00640 1 -- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b815e2e0 msgr2=0x7f39b8155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bca00640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b815e2e0 0x7f39b8155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bca00640 1 -- 172.21.15.84:0/2815958766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b81578d0 con 0x7f39b80b3df0 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.902+0000 7f39bd400640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b815e2e0 0x7f39b8155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39bca00640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8157210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f39a800e930 tx=0x7f39a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39b5600640 1 -- 172.21.15.84:0/2815958766 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8017070 con 0x7f39b80b3df0 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39b5600640 1 -- 172.21.15.84:0/2815958766 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a800ca00 con 0x7f39b80b3df0 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39b5600640 1 -- 172.21.15.84:0/2815958766 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a800cdb0 con 0x7f39b80b3df0 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b8160860 con 0x7f39b80b3df0 2024-03-07T07:31:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b8160e20 con 0x7f39b80b3df0 2024-03-07T07:31:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b8062d40 con 0x7f39b80b3df0 2024-03-07T07:31:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39b5600640 1 -- 172.21.15.84:0/2815958766 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f39a801a070 con 0x7f39b80b3df0 2024-03-07T07:31:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39b5600640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3994066f60 0x7f3994069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:48.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39b5600640 1 -- 172.21.15.84:0/2815958766 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39a8085160 con 0x7f39b80b3df0 2024-03-07T07:31:48.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.906+0000 7f39afe00640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3994066f60 0x7f3994069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:48.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.910+0000 7f39afe00640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3994066f60 0x7f3994069420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39b815f0a0 tx=0x7f39a0007c50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:48.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:48.910+0000 7f39b5600640 1 -- 172.21.15.84:0/2815958766 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f39a8056190 con 0x7f39b80b3df0 2024-03-07T07:31:49.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.066+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39b815fab0 con 0x7f39b80b3df0 2024-03-07T07:31:49.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.066+0000 7f39b5600640 1 -- 172.21.15.84:0/2815958766 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39a8055a90 con 0x7f39b80b3df0 2024-03-07T07:31:49.068 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:49.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3994066f60 msgr2=0x7f3994069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3994066f60 0x7f3994069420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39b815f0a0 tx=0x7f39a0007c50 comp rx=0 tx=0).stop 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 msgr2=0x7f39b8157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8157210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f39a800e930 tx=0x7f39a800edf0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 shutdown_connections 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3994066f60 0x7f3994069420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b815e2e0 0x7f39b8155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b815df00 0x7f39b8154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 --2- 172.21.15.84:0/2815958766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39b80b3df0 0x7f39b8157210 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 >> 172.21.15.84:0/2815958766 conn(0x7f39b80cd530 msgr2=0x7f39b815be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 shutdown_connections 2024-03-07T07:31:49.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.070+0000 7f39bf400640 1 -- 172.21.15.84:0/2815958766 wait complete. 2024-03-07T07:31:49.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:49.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb906e00640 1 Processor -- start 2024-03-07T07:31:49.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb906e00640 1 -- start start 2024-03-07T07:31:49.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb906e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9000d0a60 0x7fb900160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb906e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9000cdc50 con 0x7fb90015bf70 2024-03-07T07:31:49.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb906e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90006ea40 con 0x7fb9000b6260 2024-03-07T07:31:49.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb906e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90015ca60 con 0x7fb9000d0a60 2024-03-07T07:31:49.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb8f7e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9000d0a60 0x7fb900160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb8ffe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb90015bf70 0x7fb90015c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41310/0 (socket says 172.21.15.84:41310) 2024-03-07T07:31:49.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb8ffe00640 1 -- 172.21.15.84:0/3808179847 learned_addr learned my addr 172.21.15.84:0/3808179847 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:49.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb8f7e00640 1 -- 172.21.15.84:0/3808179847 >> v1:172.21.15.161:6789/0 conn(0x7fb9000b6260 legacy=0x7fb9000ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb8f7e00640 1 -- 172.21.15.84:0/3808179847 >> v1:172.21.15.84:6789/0 conn(0x7fb90015bf70 legacy=0x7fb90015c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb8f7e00640 1 -- 172.21.15.84:0/3808179847 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000cdec0 con 0x7fb9000d0a60 2024-03-07T07:31:49.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.226+0000 7fb8ff400640 1 -- 172.21.15.84:0/3808179847 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774225935 0 0) 0x7fb9000cdc50 con 0x7fb90015bf70 2024-03-07T07:31:49.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb8f7e00640 1 --2- 172.21.15.84:0/3808179847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000d0a60 0x7fb900160510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80097c0 tx=0x7fb8e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac03285556cbe6f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:49.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb8ff400640 1 -- 172.21.15.84:0/3808179847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80b0070 con 0x7fb9000d0a60 2024-03-07T07:31:49.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb8ff400640 1 -- 172.21.15.84:0/3808179847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e80ab600 con 0x7fb9000d0a60 2024-03-07T07:31:49.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb8ff400640 1 -- 172.21.15.84:0/3808179847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80ab9d0 con 0x7fb9000d0a60 2024-03-07T07:31:49.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb906e00640 1 -- 172.21.15.84:0/3808179847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000d0a60 msgr2=0x7fb900160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb906e00640 1 --2- 172.21.15.84:0/3808179847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000d0a60 0x7fb900160510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80097c0 tx=0x7fb8e801c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb906e00640 1 -- 172.21.15.84:0/3808179847 shutdown_connections 2024-03-07T07:31:49.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb906e00640 1 --2- 172.21.15.84:0/3808179847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000d0a60 0x7fb900160510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb906e00640 1 -- 172.21.15.84:0/3808179847 >> 172.21.15.84:0/3808179847 conn(0x7fb900071600 msgr2=0x7fb900071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:49.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb906e00640 1 -- 172.21.15.84:0/3808179847 shutdown_connections 2024-03-07T07:31:49.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.230+0000 7fb906e00640 1 -- 172.21.15.84:0/3808179847 wait complete. 2024-03-07T07:31:49.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 Processor -- start 2024-03-07T07:31:49.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 -- start start 2024-03-07T07:31:49.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6260 0x7fb900150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9000d0a60 0x7fb90014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb90015bf70 0x7fb9000b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000ce230 con 0x7fb9000b6260 2024-03-07T07:31:49.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000cf3f0 con 0x7fb9000d0a60 2024-03-07T07:31:49.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90016a660 con 0x7fb90015bf70 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6260 0x7fb900150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6260 0x7fb900150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43268/0 (socket says 172.21.15.84:43268) 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 -- 172.21.15.84:0/481519019 learned_addr learned my addr 172.21.15.84:0/481519019 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8f7e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9000d0a60 0x7fb90014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb904e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb90015bf70 0x7fb9000b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 -- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb90015bf70 msgr2=0x7fb9000b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb90015bf70 0x7fb9000b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 -- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9000d0a60 msgr2=0x7fb90014bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9000d0a60 0x7fb90014bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 -- 172.21.15.84:0/481519019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90014c0f0 con 0x7fb9000b6260 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8f7e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9000d0a60 0x7fb90014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8ffe00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6260 0x7fb900150dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000c4d0 tx=0x7fb8f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8fcc00640 1 -- 172.21.15.84:0/481519019 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0018070 con 0x7fb9000b6260 2024-03-07T07:31:49.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8fcc00640 1 -- 172.21.15.84:0/481519019 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f00074e0 con 0x7fb9000b6260 2024-03-07T07:31:49.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9000b4050 con 0x7fb9000b6260 2024-03-07T07:31:49.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb8fcc00640 1 -- 172.21.15.84:0/481519019 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0004a30 con 0x7fb9000b6260 2024-03-07T07:31:49.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9000b4310 con 0x7fb9000b6260 2024-03-07T07:31:49.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.234+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb900062d40 con 0x7fb9000b6260 2024-03-07T07:31:49.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.238+0000 7fb8fcc00640 1 -- 172.21.15.84:0/481519019 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb8f001b070 con 0x7fb9000b6260 2024-03-07T07:31:49.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.238+0000 7fb8fcc00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8dc066f60 0x7fb8dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.238+0000 7fb8fcc00640 1 -- 172.21.15.84:0/481519019 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8f00843f0 con 0x7fb9000b6260 2024-03-07T07:31:49.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.238+0000 7fb8f7e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8dc066f60 0x7fb8dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.238+0000 7fb8f7e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8dc066f60 0x7fb8dc069420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80ad000 tx=0x7fb8e80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:49.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.242+0000 7fb8fcc00640 1 -- 172.21.15.84:0/481519019 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb8f0055360 con 0x7fb9000b6260 2024-03-07T07:31:49.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.394+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9001602f0 con 0x7fb9000b6260 2024-03-07T07:31:49.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.394+0000 7fb8fcc00640 1 -- 172.21.15.84:0/481519019 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8f0054c60 con 0x7fb9000b6260 2024-03-07T07:31:49.396 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8dc066f60 msgr2=0x7fb8dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8dc066f60 0x7fb8dc069420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80ad000 tx=0x7fb8e80a6000 comp rx=0 tx=0).stop 2024-03-07T07:31:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6260 msgr2=0x7fb900150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6260 0x7fb900150dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000c4d0 tx=0x7fb8f000c990 comp rx=0 tx=0).stop 2024-03-07T07:31:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 shutdown_connections 2024-03-07T07:31:49.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb8dc066f60 0x7fb8dc069420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb90015bf70 0x7fb9000b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9000d0a60 0x7fb90014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 --2- 172.21.15.84:0/481519019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6260 0x7fb900150dd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 >> 172.21.15.84:0/481519019 conn(0x7fb900071600 msgr2=0x7fb90015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:49.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 shutdown_connections 2024-03-07T07:31:49.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.398+0000 7fb906e00640 1 -- 172.21.15.84:0/481519019 wait complete. 2024-03-07T07:31:49.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-07T07:31:49.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.554+0000 7fae8bc00640 1 Processor -- start 2024-03-07T07:31:49.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.554+0000 7fae8bc00640 1 -- start start 2024-03-07T07:31:49.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae8bc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae840730e0 0x7fae840cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae8bc00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae840cc880 con 0x7fae84144360 2024-03-07T07:31:49.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae8bc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae840ccb60 con 0x7fae84143dd0 2024-03-07T07:31:49.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae8bc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae841441b0 con 0x7fae840730e0 2024-03-07T07:31:49.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae7be00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae840730e0 0x7fae840cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae89200640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fae84143dd0 0x7fae840729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33280/0 (socket says 172.21.15.84:33280) 2024-03-07T07:31:49.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae89200640 1 -- 172.21.15.84:0/3869162267 learned_addr learned my addr 172.21.15.84:0/3869162267 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:49.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae89c00640 1 --1- 172.21.15.84:0/3869162267 >> v1:172.21.15.84:6789/0 conn(0x7fae84144360 0x7fae8415b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41318/0 (socket says 172.21.15.84:41318) 2024-03-07T07:31:49.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae7be00640 1 -- 172.21.15.84:0/3869162267 >> v1:172.21.15.161:6789/0 conn(0x7fae84143dd0 legacy=0x7fae840729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae83e00640 1 -- 172.21.15.84:0/3869162267 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400250175 0 0) 0x7fae840ccb60 con 0x7fae84143dd0 2024-03-07T07:31:49.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae7be00640 1 -- 172.21.15.84:0/3869162267 >> v1:172.21.15.84:6789/0 conn(0x7fae84144360 legacy=0x7fae8415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae7be00640 1 -- 172.21.15.84:0/3869162267 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840cce40 con 0x7fae840730e0 2024-03-07T07:31:49.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.558+0000 7fae7be00640 1 --2- 172.21.15.84:0/3869162267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae840730e0 0x7fae840cdc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097f0 tx=0x7fae6c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82c0b4cc683af8a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:49.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae83e00640 1 -- 172.21.15.84:0/3869162267 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0b1070 con 0x7fae840730e0 2024-03-07T07:31:49.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae83e00640 1 -- 172.21.15.84:0/3869162267 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c0ac640 con 0x7fae840730e0 2024-03-07T07:31:49.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae83e00640 1 -- 172.21.15.84:0/3869162267 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0aca10 con 0x7fae840730e0 2024-03-07T07:31:49.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- 172.21.15.84:0/3869162267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae840730e0 msgr2=0x7fae840cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 --2- 172.21.15.84:0/3869162267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae840730e0 0x7fae840cdc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097f0 tx=0x7fae6c01c370 comp rx=0 tx=0).stop 2024-03-07T07:31:49.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- 172.21.15.84:0/3869162267 shutdown_connections 2024-03-07T07:31:49.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 --2- 172.21.15.84:0/3869162267 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae840730e0 0x7fae840cdc00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- 172.21.15.84:0/3869162267 >> 172.21.15.84:0/3869162267 conn(0x7fae840704b0 msgr2=0x7fae840708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:49.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- 172.21.15.84:0/3869162267 shutdown_connections 2024-03-07T07:31:49.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- 172.21.15.84:0/3869162267 wait complete. 2024-03-07T07:31:49.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 Processor -- start 2024-03-07T07:31:49.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- start start 2024-03-07T07:31:49.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae840730e0 0x7fae8413b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae84143dd0 0x7fae8413c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae84144360 0x7fae840b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae840cd400 con 0x7fae840730e0 2024-03-07T07:31:49.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae840cf050 con 0x7fae84144360 2024-03-07T07:31:49.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae8bc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae840cd6e0 con 0x7fae84143dd0 2024-03-07T07:31:49.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae89200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae840730e0 0x7fae8413b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae89200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae840730e0 0x7fae8413b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43278/0 (socket says 172.21.15.84:43278) 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae89200640 1 -- 172.21.15.84:0/2870235600 learned_addr learned my addr 172.21.15.84:0/2870235600 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae7be00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae84143dd0 0x7fae8413c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.562+0000 7fae89c00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae84144360 0x7fae840b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae89200640 1 -- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae84143dd0 msgr2=0x7fae8413c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae89200640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae84143dd0 0x7fae8413c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae89200640 1 -- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae84144360 msgr2=0x7fae840b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae89200640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae84144360 0x7fae840b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae89200640 1 -- 172.21.15.84:0/2870235600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8413dd40 con 0x7fae840730e0 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae89c00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae84144360 0x7fae840b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae89200640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae840730e0 0x7fae8413b1c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c4a0 tx=0x7fae7400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae81600640 1 -- 172.21.15.84:0/2870235600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74018070 con 0x7fae840730e0 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae81600640 1 -- 172.21.15.84:0/2870235600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae740074e0 con 0x7fae840730e0 2024-03-07T07:31:49.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8413cca0 con 0x7fae840730e0 2024-03-07T07:31:49.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae81600640 1 -- 172.21.15.84:0/2870235600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74004a30 con 0x7fae840730e0 2024-03-07T07:31:49.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8413d260 con 0x7fae840730e0 2024-03-07T07:31:49.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae84062d40 con 0x7fae840730e0 2024-03-07T07:31:49.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae81600640 1 -- 172.21.15.84:0/2870235600 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fae7401b070 con 0x7fae840730e0 2024-03-07T07:31:49.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae81600640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fae60066f60 0x7fae60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:49.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae81600640 1 -- 172.21.15.84:0/2870235600 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae74084240 con 0x7fae840730e0 2024-03-07T07:31:49.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.566+0000 7fae7be00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fae60066f60 0x7fae60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:49.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.570+0000 7fae7be00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fae60066f60 0x7fae60069420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0ae000 tx=0x7fae6c0a6070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:49.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.570+0000 7fae81600640 1 -- 172.21.15.84:0/2870235600 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fae74054c00 con 0x7fae840730e0 2024-03-07T07:31:49.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae840af200 con 0x7fae840730e0 2024-03-07T07:31:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae81600640 1 -- 172.21.15.84:0/2870235600 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae74058ca0 con 0x7fae840730e0 2024-03-07T07:31:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-03-07T07:31:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fae60066f60 msgr2=0x7fae60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fae60066f60 0x7fae60069420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0ae000 tx=0x7fae6c0a6070 comp rx=0 tx=0).stop 2024-03-07T07:31:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae840730e0 msgr2=0x7fae8413b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae840730e0 0x7fae8413b1c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c4a0 tx=0x7fae7400c960 comp rx=0 tx=0).stop 2024-03-07T07:31:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 shutdown_connections 2024-03-07T07:31:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fae60066f60 0x7fae60069420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae84144360 0x7fae840b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae84143dd0 0x7fae8413c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 --2- 172.21.15.84:0/2870235600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae840730e0 0x7fae8413b1c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 >> 172.21.15.84:0/2870235600 conn(0x7fae840704b0 msgr2=0x7fae84141b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 shutdown_connections 2024-03-07T07:31:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:49.738+0000 7fae8bc00640 1 -- 172.21.15.84:0/2870235600 wait complete. 2024-03-07T07:31:49.758 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-07T07:31:49.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:49.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-07T07:31:49.803 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:31:49.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:49.803 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-07T07:31:49.865 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:31:49.865 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:49.874 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:31:49.874 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:49.925 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:31:49.925 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:49.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbbb200640 1 Processor -- start 2024-03-07T07:31:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbbb200640 1 -- start start 2024-03-07T07:31:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbbb200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbbb200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40aee40 con 0x7fbbb4070750 2024-03-07T07:31:50.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbbb200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40af120 con 0x7fbbb4070b30 2024-03-07T07:31:50.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbbb200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb415fa90 con 0x7fbbb4159c60 2024-03-07T07:31:50.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb3e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbbb4070750 0x7fbbb4159550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41320/0 (socket says 172.21.15.84:41320) 2024-03-07T07:31:50.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb3e00640 1 -- 172.21.15.84:0/3876688169 learned_addr learned my addr 172.21.15.84:0/3876688169 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:50.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb3400640 1 --2- 172.21.15.84:0/3876688169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb2a00640 1 -- 172.21.15.84:0/3876688169 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684294899 0 0) 0x7fbbb40aee40 con 0x7fbbb4070750 2024-03-07T07:31:50.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb2a00640 1 -- 172.21.15.84:0/3876688169 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb98003530 con 0x7fbbb4070750 2024-03-07T07:31:50.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb2a00640 1 -- 172.21.15.84:0/3876688169 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117089099 0 0) 0x7fbbb40af120 con 0x7fbbb4070b30 2024-03-07T07:31:50.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb2a00640 1 -- 172.21.15.84:0/3876688169 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb40aee40 con 0x7fbbb4070b30 2024-03-07T07:31:50.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb3400640 1 -- 172.21.15.84:0/3876688169 >> v1:172.21.15.161:6789/0 conn(0x7fbbb4070b30 legacy=0x7fbbb40b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb2a00640 1 -- 172.21.15.84:0/3876688169 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3533345478 0 0) 0x7fbb98003530 con 0x7fbbb4070750 2024-03-07T07:31:50.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb3400640 1 -- 172.21.15.84:0/3876688169 >> v1:172.21.15.84:6789/0 conn(0x7fbbb4070750 legacy=0x7fbbb4159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.110+0000 7fbbb3400640 1 -- 172.21.15.84:0/3876688169 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb415fce0 con 0x7fbbb4159c60 2024-03-07T07:31:50.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbb3400640 1 --2- 172.21.15.84:0/3876688169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb415d020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbba00097f0 tx=0x7fbba001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50401c96812a9feb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbb2a00640 1 -- 172.21.15.84:0/3876688169 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00b0070 con 0x7fbbb4159c60 2024-03-07T07:31:50.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbb2a00640 1 -- 172.21.15.84:0/3876688169 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba00ab400 con 0x7fbbb4159c60 2024-03-07T07:31:50.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbb2a00640 1 -- 172.21.15.84:0/3876688169 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4001a00 con 0x7fbbb4159c60 2024-03-07T07:31:50.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbbb200640 1 -- 172.21.15.84:0/3876688169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 msgr2=0x7fbbb415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbbb200640 1 --2- 172.21.15.84:0/3876688169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb415d020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbba00097f0 tx=0x7fbba001c400 comp rx=0 tx=0).stop 2024-03-07T07:31:50.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbbb200640 1 -- 172.21.15.84:0/3876688169 shutdown_connections 2024-03-07T07:31:50.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbbb200640 1 --2- 172.21.15.84:0/3876688169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb415d020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbbb200640 1 -- 172.21.15.84:0/3876688169 >> 172.21.15.84:0/3876688169 conn(0x7fbbb406b0f0 msgr2=0x7fbbb406b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:50.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbbb200640 1 -- 172.21.15.84:0/3876688169 shutdown_connections 2024-03-07T07:31:50.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.114+0000 7fbbbb200640 1 -- 172.21.15.84:0/3876688169 wait complete. 2024-03-07T07:31:50.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 Processor -- start 2024-03-07T07:31:50.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 -- start start 2024-03-07T07:31:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb4070750 0x7fbbb4158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb4070b30 0x7fbbb4155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb4153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4160660 con 0x7fbbb4070750 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb41604e0 con 0x7fbbb4070b30 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb41607e0 con 0x7fbbb4159c60 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb4070750 0x7fbbb4158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb4070750 0x7fbbb4158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43286/0 (socket says 172.21.15.84:43286) 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 -- 172.21.15.84:0/3120908977 learned_addr learned my addr 172.21.15.84:0/3120908977 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3400640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb4070b30 0x7fbbb4155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb9200640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb4153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 -- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 msgr2=0x7fbbb4153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb4153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 -- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb4070b30 msgr2=0x7fbbb4155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb4070b30 0x7fbbb4155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 -- 172.21.15.84:0/3120908977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4158c10 con 0x7fbbb4070750 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb9200640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb4153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbb3e00640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb4070750 0x7fbbb4158350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbba4001f10 tx=0x7fbba400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbabe00640 1 -- 172.21.15.84:0/3120908977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4012400 con 0x7fbbb4070750 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbabe00640 1 -- 172.21.15.84:0/3120908977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba40125c0 con 0x7fbbb4070750 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbabe00640 1 -- 172.21.15.84:0/3120908977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba40129b0 con 0x7fbbb4070750 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb4158ef0 con 0x7fbbb4070750 2024-03-07T07:31:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb4158890 con 0x7fbbb4070750 2024-03-07T07:31:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.118+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb4153270 con 0x7fbbb4070750 2024-03-07T07:31:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.122+0000 7fbbabe00640 1 -- 172.21.15.84:0/3120908977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fbba4012b50 con 0x7fbbb4070750 2024-03-07T07:31:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.122+0000 7fbbabe00640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbb94066f60 0x7fbb94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.122+0000 7fbbabe00640 1 -- 172.21.15.84:0/3120908977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbba4085850 con 0x7fbbb4070750 2024-03-07T07:31:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.122+0000 7fbbb3400640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbb94066f60 0x7fbb94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.122+0000 7fbbb3400640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbb94066f60 0x7fbb94069420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbba00ad000 tx=0x7fbba00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.126+0000 7fbbabe00640 1 -- 172.21.15.84:0/3120908977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fbbb4153270 con 0x7fbbb4070750 2024-03-07T07:31:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.282+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbb41590c0 con 0x7fbbb4070750 2024-03-07T07:31:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.282+0000 7fbbabe00640 1 -- 172.21.15.84:0/3120908977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7fbba4056850 con 0x7fbbb4070750 2024-03-07T07:31:50.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:50.283 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.282+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbb94066f60 msgr2=0x7fbb94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.282+0000 7fbbbb200640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbb94066f60 0x7fbb94069420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbba00ad000 tx=0x7fbba00a6000 comp rx=0 tx=0).stop 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.282+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb4070750 msgr2=0x7fbbb4158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.282+0000 7fbbbb200640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb4070750 0x7fbbb4158350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbba4001f10 tx=0x7fbba400a430 comp rx=0 tx=0).stop 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.286+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 shutdown_connections 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.286+0000 7fbbbb200640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbb94066f60 0x7fbb94069420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.286+0000 7fbbbb200640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb4159c60 0x7fbbb4153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.286+0000 7fbbbb200640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb4070b30 0x7fbbb4155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.286+0000 7fbbbb200640 1 --2- 172.21.15.84:0/3120908977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb4070750 0x7fbbb4158350 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.286+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 >> 172.21.15.84:0/3120908977 conn(0x7fbbb406b0f0 msgr2=0x7fbbb406ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.286+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 shutdown_connections 2024-03-07T07:31:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.286+0000 7fbbbb200640 1 -- 172.21.15.84:0/3120908977 wait complete. 2024-03-07T07:31:50.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:50.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:50.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a3a00640 1 Processor -- start 2024-03-07T07:31:50.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a3a00640 1 -- start start 2024-03-07T07:31:50.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a3a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f509c0ce3d0 0x7f509c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a3a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ced70 0x7f509c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a3a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c06eec0 con 0x7f509c1442a0 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a3a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c06f1a0 con 0x7f509c0ce3d0 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a3a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0cc800 con 0x7f509c0ced70 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a1000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f509c1442a0 0x7f509c0b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41334/0 (socket says 172.21.15.84:41334) 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a1000640 1 -- 172.21.15.84:0/3273128297 learned_addr learned my addr 172.21.15.84:0/3273128297 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f509be00640 1 --2- 172.21.15.84:0/3273128297 >> v2:172.21.15.161:3300/0 conn(0x7f509c0ce3d0 0x7f509c0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f50a1a00640 1 --2- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ced70 0x7f509c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f509b400640 1 -- 172.21.15.84:0/3273128297 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994871988 0 0) 0x7f509c06eec0 con 0x7f509c1442a0 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.442+0000 7f509b400640 1 -- 172.21.15.84:0/3273128297 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5080003530 con 0x7f509c1442a0 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f509be00640 1 -- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ced70 msgr2=0x7f509c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f509be00640 1 --2- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ced70 0x7f509c06dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f509be00640 1 -- 172.21.15.84:0/3273128297 >> v1:172.21.15.84:6789/0 conn(0x7f509c1442a0 legacy=0x7f509c0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f509be00640 1 -- 172.21.15.84:0/3273128297 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0b4460 con 0x7f509c0ce3d0 2024-03-07T07:31:50.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f50a1a00640 1 --2- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ced70 0x7f509c06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f509be00640 1 --2- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ce3d0 0x7f509c0ce830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f50840097c0 tx=0x7f508401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74586ceae14ec4d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f509b400640 1 -- 172.21.15.84:0/3273128297 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50840b0070 con 0x7f509c0ce3d0 2024-03-07T07:31:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f509b400640 1 -- 172.21.15.84:0/3273128297 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50840ab600 con 0x7f509c0ce3d0 2024-03-07T07:31:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f509b400640 1 -- 172.21.15.84:0/3273128297 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50840ab9d0 con 0x7f509c0ce3d0 2024-03-07T07:31:50.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f50a3a00640 1 -- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ce3d0 msgr2=0x7f509c0ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f50a3a00640 1 --2- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ce3d0 0x7f509c0ce830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f50840097c0 tx=0x7f508401c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f50a3a00640 1 -- 172.21.15.84:0/3273128297 shutdown_connections 2024-03-07T07:31:50.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f50a3a00640 1 --2- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ced70 0x7f509c06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f50a3a00640 1 --2- 172.21.15.84:0/3273128297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ce3d0 0x7f509c0ce830 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.446+0000 7f50a3a00640 1 -- 172.21.15.84:0/3273128297 >> 172.21.15.84:0/3273128297 conn(0x7f509c0b1c50 msgr2=0x7f509c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:50.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 -- 172.21.15.84:0/3273128297 shutdown_connections 2024-03-07T07:31:50.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 -- 172.21.15.84:0/3273128297 wait complete. 2024-03-07T07:31:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 Processor -- start 2024-03-07T07:31:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 -- start start 2024-03-07T07:31:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ce3d0 0x7f509c141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ced70 0x7f509c140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f509c1442a0 0x7f509c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c06eb10 con 0x7f509c1442a0 2024-03-07T07:31:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c06e990 con 0x7f509c0ced70 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c072230 con 0x7f509c0ce3d0 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f509c1442a0 0x7f509c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f509c1442a0 0x7f509c1565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43290/0 (socket says 172.21.15.84:43290) 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 -- 172.21.15.84:0/2375730194 learned_addr learned my addr 172.21.15.84:0/2375730194 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1000640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ce3d0 0x7f509c141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f509be00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ced70 0x7f509c140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 -- 172.21.15.84:0/2375730194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ce3d0 msgr2=0x7f509c141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ce3d0 0x7f509c141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 -- 172.21.15.84:0/2375730194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ced70 msgr2=0x7f509c140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ced70 0x7f509c140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 -- 172.21.15.84:0/2375730194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c1f3cf0 con 0x7f509c1442a0 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a1a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f509c1442a0 0x7f509c1565e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f509400efc0 tx=0x7f5094009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f5098c00640 1 -- 172.21.15.84:0/2375730194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094018030 con 0x7f509c1442a0 2024-03-07T07:31:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f5098c00640 1 -- 172.21.15.84:0/2375730194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509400cde0 con 0x7f509c1442a0 2024-03-07T07:31:50.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f5098c00640 1 -- 172.21.15.84:0/2375730194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094003bc0 con 0x7f509c1442a0 2024-03-07T07:31:50.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.450+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c1f3fd0 con 0x7f509c1442a0 2024-03-07T07:31:50.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.454+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c1f4590 con 0x7f509c1442a0 2024-03-07T07:31:50.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.454+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c062d40 con 0x7f509c1442a0 2024-03-07T07:31:50.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.454+0000 7f5098c00640 1 -- 172.21.15.84:0/2375730194 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f509401b070 con 0x7f509c1442a0 2024-03-07T07:31:50.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.454+0000 7f5098c00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5078066f90 0x7f5078069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.454+0000 7f5098c00640 1 -- 172.21.15.84:0/2375730194 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5094085990 con 0x7f509c1442a0 2024-03-07T07:31:50.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.454+0000 7f50a1000640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5078066f90 0x7f5078069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.454+0000 7f50a1000640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5078066f90 0x7f5078069450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f508c007fd0 tx=0x7f508c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.458+0000 7f5098c00640 1 -- 172.21.15.84:0/2375730194 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f5094010040 con 0x7f509c1442a0 2024-03-07T07:31:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.614+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f509c071c80 con 0x7f509c1442a0 2024-03-07T07:31:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.614+0000 7f5098c00640 1 -- 172.21.15.84:0/2375730194 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50940562b0 con 0x7f509c1442a0 2024-03-07T07:31:50.617 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5078066f90 msgr2=0x7f5078069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5078066f90 0x7f5078069450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f508c007fd0 tx=0x7f508c009040 comp rx=0 tx=0).stop 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f509c1442a0 msgr2=0x7f509c1565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f509c1442a0 0x7f509c1565e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f509400efc0 tx=0x7f5094009f90 comp rx=0 tx=0).stop 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 shutdown_connections 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5078066f90 0x7f5078069450 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f509c1442a0 0x7f509c1565e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f509c0ced70 0x7f509c140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 --2- 172.21.15.84:0/2375730194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509c0ce3d0 0x7f509c141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 >> 172.21.15.84:0/2375730194 conn(0x7f509c0b1c50 msgr2=0x7f509c153580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:50.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 shutdown_connections 2024-03-07T07:31:50.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.618+0000 7f50a3a00640 1 -- 172.21.15.84:0/2375730194 wait complete. 2024-03-07T07:31:50.635 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfe2200640 1 Processor -- start 2024-03-07T07:31:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfe2200640 1 -- start start 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfe2200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfe2200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfdc0b3350 0x7fcfdc0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfe2200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc0b51f0 con 0x7fcfdc0b3cf0 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfe2200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfdc06ec50 con 0x7fcfdc0b3350 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfe2200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc06eec0 con 0x7fcfdc1442a0 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfd2a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfdc0b3350 0x7fcfdc0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfdbe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcfdc0b3cf0 0x7fcfdc0ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41340/0 (socket says 172.21.15.84:41340) 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfd2a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfdc0b3350 0x7fcfdc0b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43292/0 (socket says 172.21.15.84:43292) 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfdbe00640 1 -- 172.21.15.84:0/1526897262 learned_addr learned my addr 172.21.15.84:0/1526897262 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfdb400640 1 --2- 172.21.15.84:0/1526897262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfd2a00640 1 -- 172.21.15.84:0/1526897262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 msgr2=0x7fcfdc0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfd2a00640 1 --2- 172.21.15.84:0/1526897262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc0b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfd2a00640 1 -- 172.21.15.84:0/1526897262 >> v1:172.21.15.84:6789/0 conn(0x7fcfdc0b3cf0 legacy=0x7fcfdc0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfd2a00640 1 -- 172.21.15.84:0/1526897262 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc06f1a0 con 0x7fcfdc0b3350 2024-03-07T07:31:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.774+0000 7fcfdaa00640 1 -- 172.21.15.84:0/1526897262 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684697099 0 0) 0x7fcfdc0b51f0 con 0x7fcfdc0b3cf0 2024-03-07T07:31:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfd2a00640 1 --2- 172.21.15.84:0/1526897262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b37b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40097c0 tx=0x7fcfc401ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5a4eff088a10b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfdaa00640 1 -- 172.21.15.84:0/1526897262 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40aa5f0 con 0x7fcfdc0b3350 2024-03-07T07:31:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfdaa00640 1 -- 172.21.15.84:0/1526897262 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc40af070 con 0x7fcfdc0b3350 2024-03-07T07:31:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfdaa00640 1 -- 172.21.15.84:0/1526897262 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40aa9b0 con 0x7fcfdc0b3350 2024-03-07T07:31:50.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfe2200640 1 -- 172.21.15.84:0/1526897262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 msgr2=0x7fcfdc0b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfe2200640 1 --2- 172.21.15.84:0/1526897262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b37b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40097c0 tx=0x7fcfc401ced0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfe2200640 1 -- 172.21.15.84:0/1526897262 shutdown_connections 2024-03-07T07:31:50.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfe2200640 1 --2- 172.21.15.84:0/1526897262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b37b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfe2200640 1 --2- 172.21.15.84:0/1526897262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfe2200640 1 -- 172.21.15.84:0/1526897262 >> 172.21.15.84:0/1526897262 conn(0x7fcfdc0b1c50 msgr2=0x7fcfdc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:50.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfe2200640 1 -- 172.21.15.84:0/1526897262 shutdown_connections 2024-03-07T07:31:50.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.778+0000 7fcfe2200640 1 -- 172.21.15.84:0/1526897262 wait complete. 2024-03-07T07:31:50.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 Processor -- start 2024-03-07T07:31:50.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 -- start start 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0b3cf0 0x7fcfdc1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0ccd20 con 0x7fcfdc0b3350 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc06f480 con 0x7fcfdc0b3cf0 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc1558c0 con 0x7fcfdc1442a0 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43306/0 (socket says 172.21.15.84:43306) 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 -- 172.21.15.84:0/168775327 learned_addr learned my addr 172.21.15.84:0/168775327 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfd2a00640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0b3cf0 0x7fcfdc1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdbe00640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 -- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 msgr2=0x7fcfdc154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 -- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0b3cf0 msgr2=0x7fcfdc1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0b3cf0 0x7fcfdc1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 -- 172.21.15.84:0/168775327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0af8b0 con 0x7fcfdc0b3350 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdbe00640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfdb400640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b13a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00e870 tx=0x7fcfcc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfd3e00640 1 -- 172.21.15.84:0/168775327 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc017070 con 0x7fcfdc0b3350 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfd3e00640 1 -- 172.21.15.84:0/168775327 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc00c940 con 0x7fcfdc0b3350 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc0afb90 con 0x7fcfdc0b3350 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfd3e00640 1 -- 172.21.15.84:0/168775327 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc00ccf0 con 0x7fcfdc0b3350 2024-03-07T07:31:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc155550 con 0x7fcfdc0b3350 2024-03-07T07:31:50.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.782+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc062d40 con 0x7fcfdc0b3350 2024-03-07T07:31:50.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.786+0000 7fcfd3e00640 1 -- 172.21.15.84:0/168775327 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fcfcc01a070 con 0x7fcfdc0b3350 2024-03-07T07:31:50.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.786+0000 7fcfd3e00640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcfb8066f60 0x7fcfb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:50.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.786+0000 7fcfd3e00640 1 -- 172.21.15.84:0/168775327 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfcc085230 con 0x7fcfdc0b3350 2024-03-07T07:31:50.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.786+0000 7fcfd2a00640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcfb8066f60 0x7fcfb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:50.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.786+0000 7fcfd2a00640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcfb8066f60 0x7fcfb8069420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40ae000 tx=0x7fcfc4004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:50.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.790+0000 7fcfd3e00640 1 -- 172.21.15.84:0/168775327 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fcfcc055bf0 con 0x7fcfdc0b3350 2024-03-07T07:31:50.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.942+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfdc071c80 con 0x7fcfdc0b3350 2024-03-07T07:31:50.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.942+0000 7fcfd3e00640 1 -- 172.21.15.84:0/168775327 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfcc059c90 con 0x7fcfdc0b3350 2024-03-07T07:31:50.944 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcfb8066f60 msgr2=0x7fcfb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcfb8066f60 0x7fcfb8069420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40ae000 tx=0x7fcfc4004740 comp rx=0 tx=0).stop 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 msgr2=0x7fcfdc0b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b13a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00e870 tx=0x7fcfcc00ec70 comp rx=0 tx=0).stop 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 shutdown_connections 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcfb8066f60 0x7fcfb8069420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfdc1442a0 0x7fcfdc154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfdc0b3cf0 0x7fcfdc1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 --2- 172.21.15.84:0/168775327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfdc0b3350 0x7fcfdc0b13a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 >> 172.21.15.84:0/168775327 conn(0x7fcfdc0b1c50 msgr2=0x7fcfdc06db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 shutdown_connections 2024-03-07T07:31:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:50.946+0000 7fcfe2200640 1 -- 172.21.15.84:0/168775327 wait complete. 2024-03-07T07:31:50.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd6a6800640 1 Processor -- start 2024-03-07T07:31:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd6a6800640 1 -- start start 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd6a6800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd6a01442a0 0x7fd6a00b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd6a6800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a00b3350 0x7fd6a00b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd6a6800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a00b51f0 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd6a6800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a006ec50 con 0x7fd6a01442a0 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd6a6800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a006eec0 con 0x7fd6a00b3350 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd69f400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd6a01442a0 0x7fd6a00b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd69fe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd6a00b3cf0 0x7fd6a00ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41352/0 (socket says 172.21.15.84:41352) 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd69fe00640 1 -- 172.21.15.84:0/2198901909 learned_addr learned my addr 172.21.15.84:0/2198901909 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd696a00640 1 --2- 172.21.15.84:0/2198901909 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a00b3350 0x7fd6a00b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd69f400640 1 -- 172.21.15.84:0/2198901909 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a00b3350 msgr2=0x7fd6a00b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd69f400640 1 --2- 172.21.15.84:0/2198901909 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a00b3350 0x7fd6a00b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd69f400640 1 -- 172.21.15.84:0/2198901909 >> v1:172.21.15.84:6789/0 conn(0x7fd6a00b3cf0 legacy=0x7fd6a00ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd69f400640 1 -- 172.21.15.84:0/2198901909 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a006f1a0 con 0x7fd6a01442a0 2024-03-07T07:31:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.102+0000 7fd69ea00640 1 -- 172.21.15.84:0/2198901909 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691646185 0 0) 0x7fd6a00b51f0 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd69f400640 1 --2- 172.21.15.84:0/2198901909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a01442a0 0x7fd6a00b4cb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd6900097c0 tx=0x7fd69001ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4386e8d58e5d7fd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd69ea00640 1 -- 172.21.15.84:0/2198901909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900aa5f0 con 0x7fd6a01442a0 2024-03-07T07:31:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd69ea00640 1 -- 172.21.15.84:0/2198901909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6900af070 con 0x7fd6a01442a0 2024-03-07T07:31:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd69ea00640 1 -- 172.21.15.84:0/2198901909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900aa9b0 con 0x7fd6a01442a0 2024-03-07T07:31:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd6a6800640 1 -- 172.21.15.84:0/2198901909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a01442a0 msgr2=0x7fd6a00b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2198901909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a01442a0 0x7fd6a00b4cb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd6900097c0 tx=0x7fd69001ced0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd6a6800640 1 -- 172.21.15.84:0/2198901909 shutdown_connections 2024-03-07T07:31:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2198901909 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a00b3350 0x7fd6a00b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2198901909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a01442a0 0x7fd6a00b4cb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd6a6800640 1 -- 172.21.15.84:0/2198901909 >> 172.21.15.84:0/2198901909 conn(0x7fd6a00b1c50 msgr2=0x7fd6a00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd6a6800640 1 -- 172.21.15.84:0/2198901909 shutdown_connections 2024-03-07T07:31:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.106+0000 7fd6a6800640 1 -- 172.21.15.84:0/2198901909 wait complete. 2024-03-07T07:31:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 Processor -- start 2024-03-07T07:31:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 -- start start 2024-03-07T07:31:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a00b3350 0x7fd6a0158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00b3cf0 0x7fd6a015aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a01442a0 0x7fd6a0137eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00ccd20 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a006f480 con 0x7fd6a00b3350 2024-03-07T07:31:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a015afc0 con 0x7fd6a01442a0 2024-03-07T07:31:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00b3cf0 0x7fd6a015aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00b3cf0 0x7fd6a015aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43332/0 (socket says 172.21.15.84:43332) 2024-03-07T07:31:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 -- 172.21.15.84:0/2439501441 learned_addr learned my addr 172.21.15.84:0/2439501441 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd69fe00640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a01442a0 0x7fd6a0137eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd69f400640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a00b3350 0x7fd6a0158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 -- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a01442a0 msgr2=0x7fd6a0137eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a01442a0 0x7fd6a0137eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 -- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a00b3350 msgr2=0x7fd6a0158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a00b3350 0x7fd6a0158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 -- 172.21.15.84:0/2439501441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a0158e40 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd69fe00640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a01442a0 0x7fd6a0137eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd696a00640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00b3cf0 0x7fd6a015aa80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd68800e8a0 tx=0x7fd68800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd697e00640 1 -- 172.21.15.84:0/2439501441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688017070 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd697e00640 1 -- 172.21.15.84:0/2439501441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68800c940 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a0159120 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd697e00640 1 -- 172.21.15.84:0/2439501441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68800ccf0 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a01514a0 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.110+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a01512c0 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.114+0000 7fd697e00640 1 -- 172.21.15.84:0/2439501441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fd68801a070 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.114+0000 7fd697e00640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd67c066f60 0x7fd67c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.114+0000 7fd697e00640 1 -- 172.21.15.84:0/2439501441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd688085280 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.114+0000 7fd69f400640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd67c066f60 0x7fd67c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.114+0000 7fd69f400640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd67c066f60 0x7fd67c069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6900ae000 tx=0x7fd690004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.118+0000 7fd697e00640 1 -- 172.21.15.84:0/2439501441 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fd6a01512c0 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.270+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6a0062d40 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd697e00640 1 -- 172.21.15.84:0/2439501441 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd688055ba0 con 0x7fd6a00b3cf0 2024-03-07T07:31:51.273 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd67c066f60 msgr2=0x7fd67c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd67c066f60 0x7fd67c069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6900ae000 tx=0x7fd690004740 comp rx=0 tx=0).stop 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00b3cf0 msgr2=0x7fd6a015aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00b3cf0 0x7fd6a015aa80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd68800e8a0 tx=0x7fd68800eca0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 shutdown_connections 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd67c066f60 0x7fd67c069420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd6a01442a0 0x7fd6a0137eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00b3cf0 0x7fd6a015aa80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 --2- 172.21.15.84:0/2439501441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a00b3350 0x7fd6a0158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 >> 172.21.15.84:0/2439501441 conn(0x7fd6a00b1c50 msgr2=0x7fd6a00ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:51.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 shutdown_connections 2024-03-07T07:31:51.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.274+0000 7fd6a6800640 1 -- 172.21.15.84:0/2439501441 wait complete. 2024-03-07T07:31:51.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-07T07:31:51.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e60600640 1 Processor -- start 2024-03-07T07:31:51.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e60600640 1 -- start start 2024-03-07T07:31:51.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e60600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6e581408e0 0x7f6e580cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e60600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e58143a00 0x7f6e580ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e60600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5806d230 con 0x7f6e580cd320 2024-03-07T07:31:51.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e60600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580ce680 con 0x7f6e58143a00 2024-03-07T07:31:51.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e60600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5806d4f0 con 0x7f6e581408e0 2024-03-07T07:31:51.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e5d200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e58143a00 0x7f6e580ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e5d200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e58143a00 0x7f6e580ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43346/0 (socket says 172.21.15.84:43346) 2024-03-07T07:31:51.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e5d200640 1 -- 172.21.15.84:0/159725060 learned_addr learned my addr 172.21.15.84:0/159725060 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:51.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e5dc00640 1 --2- 172.21.15.84:0/159725060 >> v2:172.21.15.161:3300/0 conn(0x7f6e581408e0 0x7f6e580cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e57e00640 1 -- 172.21.15.84:0/159725060 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145782811 0 0) 0x7f6e5806d230 con 0x7f6e580cd320 2024-03-07T07:31:51.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e5d200640 1 -- 172.21.15.84:0/159725060 >> v2:172.21.15.161:3300/0 conn(0x7f6e581408e0 msgr2=0x7f6e580cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:51.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e5d200640 1 --2- 172.21.15.84:0/159725060 >> v2:172.21.15.161:3300/0 conn(0x7f6e581408e0 0x7f6e580cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e5d200640 1 -- 172.21.15.84:0/159725060 >> v1:172.21.15.161:6789/0 conn(0x7f6e580cd320 legacy=0x7f6e5815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.430+0000 7f6e5d200640 1 -- 172.21.15.84:0/159725060 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5806d7d0 con 0x7f6e58143a00 2024-03-07T07:31:51.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e5d200640 1 --2- 172.21.15.84:0/159725060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e58143a00 0x7f6e580ccde0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e58069290 tx=0x7f6e4401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddd8f55226a85e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e57e00640 1 -- 172.21.15.84:0/159725060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440ab430 con 0x7f6e58143a00 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e57e00640 1 -- 172.21.15.84:0/159725060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e440b0070 con 0x7f6e58143a00 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e57e00640 1 -- 172.21.15.84:0/159725060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440ab7f0 con 0x7f6e58143a00 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e60600640 1 -- 172.21.15.84:0/159725060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e58143a00 msgr2=0x7f6e580ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e60600640 1 --2- 172.21.15.84:0/159725060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e58143a00 0x7f6e580ccde0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e58069290 tx=0x7f6e4401c520 comp rx=0 tx=0).stop 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e60600640 1 -- 172.21.15.84:0/159725060 shutdown_connections 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e60600640 1 --2- 172.21.15.84:0/159725060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e58143a00 0x7f6e580ccde0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e60600640 1 --2- 172.21.15.84:0/159725060 >> v2:172.21.15.161:3300/0 conn(0x7f6e581408e0 0x7f6e580cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e60600640 1 -- 172.21.15.84:0/159725060 >> 172.21.15.84:0/159725060 conn(0x7f6e580704b0 msgr2=0x7f6e580708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e60600640 1 -- 172.21.15.84:0/159725060 shutdown_connections 2024-03-07T07:31:51.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.434+0000 7f6e60600640 1 -- 172.21.15.84:0/159725060 wait complete. 2024-03-07T07:31:51.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 Processor -- start 2024-03-07T07:31:51.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 -- start start 2024-03-07T07:31:51.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e580cd320 0x7f6e5813a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e581408e0 0x7f6e581fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e58143a00 0x7f6e581fab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5815e950 con 0x7f6e581408e0 2024-03-07T07:31:51.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5815e7d0 con 0x7f6e580cd320 2024-03-07T07:31:51.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5815ead0 con 0x7f6e58143a00 2024-03-07T07:31:51.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e581408e0 0x7f6e581fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e581408e0 0x7f6e581fa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43356/0 (socket says 172.21.15.84:43356) 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5dc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e580cd320 0x7f6e5813a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 -- 172.21.15.84:0/1815582547 learned_addr learned my addr 172.21.15.84:0/1815582547 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5e600640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e58143a00 0x7f6e581fab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 -- 172.21.15.84:0/1815582547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e58143a00 msgr2=0x7f6e581fab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e58143a00 0x7f6e581fab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 -- 172.21.15.84:0/1815582547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e580cd320 msgr2=0x7f6e5813a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e580cd320 0x7f6e5813a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 -- 172.21.15.84:0/1815582547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5815cb20 con 0x7f6e581408e0 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e5d200640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e581408e0 0x7f6e581fa5f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6e440ad040 tx=0x7f6e4401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e55600640 1 -- 172.21.15.84:0/1815582547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440be5f0 con 0x7f6e581408e0 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e55600640 1 -- 172.21.15.84:0/1815582547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e440be7b0 con 0x7f6e581408e0 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e55600640 1 -- 172.21.15.84:0/1815582547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440beba0 con 0x7f6e581408e0 2024-03-07T07:31:51.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5815ce00 con 0x7f6e581408e0 2024-03-07T07:31:51.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5815d3c0 con 0x7f6e581408e0 2024-03-07T07:31:51.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.438+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5813fdc0 con 0x7f6e581408e0 2024-03-07T07:31:51.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.442+0000 7f6e55600640 1 -- 172.21.15.84:0/1815582547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f6e440b43f0 con 0x7f6e581408e0 2024-03-07T07:31:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.442+0000 7f6e55600640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e38066f60 0x7f6e38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.442+0000 7f6e55600640 1 -- 172.21.15.84:0/1815582547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e440a8070 con 0x7f6e581408e0 2024-03-07T07:31:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.442+0000 7f6e5dc00640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e38066f60 0x7f6e38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.442+0000 7f6e5dc00640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e38066f60 0x7f6e38069420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0113e0 tx=0x7f6e4c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:51.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.446+0000 7f6e55600640 1 -- 172.21.15.84:0/1815582547 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6e44016110 con 0x7f6e581408e0 2024-03-07T07:31:51.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.614+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6e5806d230 con 0x7f6e581408e0 2024-03-07T07:31:51.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.614+0000 7f6e55600640 1 -- 172.21.15.84:0/1815582547 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6e440f0200 con 0x7f6e581408e0 2024-03-07T07:31:51.616 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e38066f60 msgr2=0x7f6e38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e38066f60 0x7f6e38069420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0113e0 tx=0x7f6e4c00b040 comp rx=0 tx=0).stop 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e581408e0 msgr2=0x7f6e581fa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e581408e0 0x7f6e581fa5f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6e440ad040 tx=0x7f6e4401ad60 comp rx=0 tx=0).stop 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 shutdown_connections 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e38066f60 0x7f6e38069420 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e58143a00 0x7f6e581fab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e581408e0 0x7f6e581fa5f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 --2- 172.21.15.84:0/1815582547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e580cd320 0x7f6e5813a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:51.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 >> 172.21.15.84:0/1815582547 conn(0x7f6e580704b0 msgr2=0x7f6e58157450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:51.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 shutdown_connections 2024-03-07T07:31:51.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:51.618+0000 7f6e60600640 1 -- 172.21.15.84:0/1815582547 wait complete. 2024-03-07T07:31:51.637 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-07T07:31:51.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:51.637 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-07T07:31:51.672 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:31:51.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:51.672 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-07T07:31:51.729 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:31:51.729 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:51.738 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:31:51.738 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:51.788 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:31:51.788 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:51.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:52.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa60200640 1 Processor -- start 2024-03-07T07:31:52.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa60200640 1 -- start start 2024-03-07T07:31:52.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa60200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa580a9540 0x7faa5815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa60200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5806d780 con 0x7faa580730e0 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa60200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5806da60 con 0x7faa58145a30 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa60200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5806dd40 con 0x7faa580a9540 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa5ce00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa580a9540 0x7faa5815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa5e200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faa580730e0 0x7faa5815cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40768/0 (socket says 172.21.15.84:40768) 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa5e200640 1 -- 172.21.15.84:0/3926513167 learned_addr learned my addr 172.21.15.84:0/3926513167 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa5ce00640 1 --2- 172.21.15.84:0/3926513167 >> v2:172.21.15.84:3300/0 conn(0x7faa580a9540 0x7faa5815c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40332/0 (socket says 172.21.15.84:40332) 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa5ce00640 1 -- 172.21.15.84:0/3926513167 >> v1:172.21.15.161:6789/0 conn(0x7faa58145a30 legacy=0x7faa580729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa5ce00640 1 -- 172.21.15.84:0/3926513167 >> v1:172.21.15.84:6789/0 conn(0x7faa580730e0 legacy=0x7faa5815cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa5ce00640 1 -- 172.21.15.84:0/3926513167 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5806e020 con 0x7faa580a9540 2024-03-07T07:31:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.014+0000 7faa57e00640 1 -- 172.21.15.84:0/3926513167 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910487976 0 0) 0x7faa5806da60 con 0x7faa58145a30 2024-03-07T07:31:52.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa5ce00640 1 --2- 172.21.15.84:0/3926513167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa580a9540 0x7faa5815c7e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faa440097c0 tx=0x7faa4401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47b1ab9aa456c70 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa57e00640 1 -- 172.21.15.84:0/3926513167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440a8630 con 0x7faa580a9540 2024-03-07T07:31:52.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa57e00640 1 -- 172.21.15.84:0/3926513167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440a87d0 con 0x7faa580a9540 2024-03-07T07:31:52.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa57e00640 1 -- 172.21.15.84:0/3926513167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440a8ba0 con 0x7faa580a9540 2024-03-07T07:31:52.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa60200640 1 -- 172.21.15.84:0/3926513167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa580a9540 msgr2=0x7faa5815c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa60200640 1 --2- 172.21.15.84:0/3926513167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa580a9540 0x7faa5815c7e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faa440097c0 tx=0x7faa4401bf80 comp rx=0 tx=0).stop 2024-03-07T07:31:52.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa60200640 1 -- 172.21.15.84:0/3926513167 shutdown_connections 2024-03-07T07:31:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa60200640 1 --2- 172.21.15.84:0/3926513167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa580a9540 0x7faa5815c7e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa60200640 1 -- 172.21.15.84:0/3926513167 >> 172.21.15.84:0/3926513167 conn(0x7faa580704b0 msgr2=0x7faa580708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa60200640 1 -- 172.21.15.84:0/3926513167 shutdown_connections 2024-03-07T07:31:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.018+0000 7faa60200640 1 -- 172.21.15.84:0/3926513167 wait complete. 2024-03-07T07:31:52.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 Processor -- start 2024-03-07T07:31:52.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 -- start start 2024-03-07T07:31:52.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa580730e0 0x7faa580ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa58145a30 0x7faa5815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5815b740 0x7faa581640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5816acb0 con 0x7faa5815b740 2024-03-07T07:31:52.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5816ab30 con 0x7faa58145a30 2024-03-07T07:31:52.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5816ae30 con 0x7faa580730e0 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5815b740 0x7faa581640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5815b740 0x7faa581640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40342/0 (socket says 172.21.15.84:40342) 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 -- 172.21.15.84:0/3407651631 learned_addr learned my addr 172.21.15.84:0/3407651631 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5ce00640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa58145a30 0x7faa5815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5d800640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa580730e0 0x7faa580ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 -- 172.21.15.84:0/3407651631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa580730e0 msgr2=0x7faa580ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa580730e0 0x7faa580ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 -- 172.21.15.84:0/3407651631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa58145a30 msgr2=0x7faa5815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa58145a30 0x7faa5815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 -- 172.21.15.84:0/3407651631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58140c00 con 0x7faa5815b740 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa5e200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5815b740 0x7faa581640d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c7b0 tx=0x7faa5000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa55600640 1 -- 172.21.15.84:0/3407651631 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50018070 con 0x7faa5815b740 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa55600640 1 -- 172.21.15.84:0/3407651631 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa500072d0 con 0x7faa5815b740 2024-03-07T07:31:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa580ac600 con 0x7faa5815b740 2024-03-07T07:31:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa55600640 1 -- 172.21.15.84:0/3407651631 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa500047f0 con 0x7faa5815b740 2024-03-07T07:31:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa580acbc0 con 0x7faa5815b740 2024-03-07T07:31:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.022+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa58062d40 con 0x7faa5815b740 2024-03-07T07:31:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.026+0000 7faa55600640 1 -- 172.21.15.84:0/3407651631 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7faa5001b070 con 0x7faa5815b740 2024-03-07T07:31:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.026+0000 7faa55600640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faa38066f60 0x7faa38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.026+0000 7faa55600640 1 -- 172.21.15.84:0/3407651631 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa50084430 con 0x7faa5815b740 2024-03-07T07:31:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.026+0000 7faa5d800640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faa38066f60 0x7faa38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.026+0000 7faa5d800640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faa38066f60 0x7faa38069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0012f0 tx=0x7faa4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.030+0000 7faa55600640 1 -- 172.21.15.84:0/3407651631 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7faa50054df0 con 0x7faa5815b740 2024-03-07T07:31:52.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa58163eb0 con 0x7faa5815b740 2024-03-07T07:31:52.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa55600640 1 -- 172.21.15.84:0/3407651631 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16573 (secure 0 0 0) 0x7faa50058e90 con 0x7faa5815b740 2024-03-07T07:31:52.186 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:52.186 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:14.994377+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faa38066f60 msgr2=0x7faa38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faa38066f60 0x7faa38069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0012f0 tx=0x7faa4c009040 comp rx=0 tx=0).stop 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5815b740 msgr2=0x7faa581640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5815b740 0x7faa581640d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c7b0 tx=0x7faa5000cc70 comp rx=0 tx=0).stop 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 shutdown_connections 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faa38066f60 0x7faa38069420 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5815b740 0x7faa581640d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa58145a30 0x7faa5815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 --2- 172.21.15.84:0/3407651631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa580730e0 0x7faa580ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 >> 172.21.15.84:0/3407651631 conn(0x7faa580704b0 msgr2=0x7faa58143570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:52.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 shutdown_connections 2024-03-07T07:31:52.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.186+0000 7faa60200640 1 -- 172.21.15.84:0/3407651631 wait complete. 2024-03-07T07:31:52.206 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:52.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:52.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.342+0000 7f7418600640 1 Processor -- start 2024-03-07T07:31:52.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7418600640 1 -- start start 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7418600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f74100ce3d0 0x7f74100ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7418600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ced70 0x7f741006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7418600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741006eec0 con 0x7f74101442a0 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7418600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741006f1a0 con 0x7f74100ce3d0 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7418600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74100cc800 con 0x7f74100ced70 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7415c00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f74101442a0 0x7f74100b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40780/0 (socket says 172.21.15.84:40780) 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7415c00640 1 -- 172.21.15.84:0/925045528 learned_addr learned my addr 172.21.15.84:0/925045528 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7416600640 1 --2- 172.21.15.84:0/925045528 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ced70 0x7f741006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7415200640 1 --2- 172.21.15.84:0/925045528 >> v2:172.21.15.161:3300/0 conn(0x7f74100ce3d0 0x7f74100ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f740fe00640 1 -- 172.21.15.84:0/925045528 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928839896 0 0) 0x7f741006eec0 con 0x7f74101442a0 2024-03-07T07:31:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f740fe00640 1 -- 172.21.15.84:0/925045528 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f8003530 con 0x7f74101442a0 2024-03-07T07:31:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7416600640 1 -- 172.21.15.84:0/925045528 >> v2:172.21.15.161:3300/0 conn(0x7f74100ce3d0 msgr2=0x7f74100ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7416600640 1 --2- 172.21.15.84:0/925045528 >> v2:172.21.15.161:3300/0 conn(0x7f74100ce3d0 0x7f74100ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f740fe00640 1 -- 172.21.15.84:0/925045528 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1378190281 0 0) 0x7f73f8003530 con 0x7f74101442a0 2024-03-07T07:31:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7416600640 1 -- 172.21.15.84:0/925045528 >> v1:172.21.15.84:6789/0 conn(0x7f74101442a0 legacy=0x7f74100b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.346+0000 7f7416600640 1 -- 172.21.15.84:0/925045528 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100b4460 con 0x7f74100ced70 2024-03-07T07:31:52.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7416600640 1 --2- 172.21.15.84:0/925045528 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ced70 0x7f741006dc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7408009d90 tx=0x7f740801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d46e07de35d88c35 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f740fe00640 1 -- 172.21.15.84:0/925045528 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080b2070 con 0x7f74100ced70 2024-03-07T07:31:52.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f740fe00640 1 -- 172.21.15.84:0/925045528 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74080a5630 con 0x7f74100ced70 2024-03-07T07:31:52.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f740fe00640 1 -- 172.21.15.84:0/925045528 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404001680 con 0x7f74100ced70 2024-03-07T07:31:52.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 -- 172.21.15.84:0/925045528 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ced70 msgr2=0x7f741006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 --2- 172.21.15.84:0/925045528 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ced70 0x7f741006dc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7408009d90 tx=0x7f740801c890 comp rx=0 tx=0).stop 2024-03-07T07:31:52.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 -- 172.21.15.84:0/925045528 shutdown_connections 2024-03-07T07:31:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 --2- 172.21.15.84:0/925045528 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ced70 0x7f741006dc40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 --2- 172.21.15.84:0/925045528 >> v2:172.21.15.161:3300/0 conn(0x7f74100ce3d0 0x7f74100ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 -- 172.21.15.84:0/925045528 >> 172.21.15.84:0/925045528 conn(0x7f74100b1c50 msgr2=0x7f74100b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 -- 172.21.15.84:0/925045528 shutdown_connections 2024-03-07T07:31:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 -- 172.21.15.84:0/925045528 wait complete. 2024-03-07T07:31:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 Processor -- start 2024-03-07T07:31:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.350+0000 7f7418600640 1 -- start start 2024-03-07T07:31:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ce3d0 0x7f741013f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100ced70 0x7f741013bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74101442a0 0x7f7410154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741006eb10 con 0x7f74100ced70 2024-03-07T07:31:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741006e990 con 0x7f74101442a0 2024-03-07T07:31:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74101679d0 con 0x7f74100ce3d0 2024-03-07T07:31:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100ced70 0x7f741013bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100ced70 0x7f741013bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40344/0 (socket says 172.21.15.84:40344) 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 -- 172.21.15.84:0/3545581662 learned_addr learned my addr 172.21.15.84:0/3545581662 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415c00640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ce3d0 0x7f741013f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7416600640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74101442a0 0x7f7410154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 -- 172.21.15.84:0/3545581662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ce3d0 msgr2=0x7f741013f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ce3d0 0x7f741013f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 -- 172.21.15.84:0/3545581662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74101442a0 msgr2=0x7f7410154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74101442a0 0x7f7410154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 -- 172.21.15.84:0/3545581662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410154e50 con 0x7f74100ced70 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7415200640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100ced70 0x7f741013bfb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00e870 tx=0x7f73fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f740d600640 1 -- 172.21.15.84:0/3545581662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc017070 con 0x7f74100ced70 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f740d600640 1 -- 172.21.15.84:0/3545581662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc00c940 con 0x7f74100ced70 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74101f6cc0 con 0x7f74100ced70 2024-03-07T07:31:52.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f740d600640 1 -- 172.21.15.84:0/3545581662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00ccf0 con 0x7f74100ced70 2024-03-07T07:31:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741013fd40 con 0x7f74100ced70 2024-03-07T07:31:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.354+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7410062d40 con 0x7f74100ced70 2024-03-07T07:31:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.358+0000 7f740d600640 1 -- 172.21.15.84:0/3545581662 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f73fc01a070 con 0x7f74100ced70 2024-03-07T07:31:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.358+0000 7f740d600640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73f0066f60 0x7f73f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.358+0000 7f740d600640 1 -- 172.21.15.84:0/3545581662 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73fc084e30 con 0x7f74100ced70 2024-03-07T07:31:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.358+0000 7f7415c00640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73f0066f60 0x7f73f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.358+0000 7f7415c00640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73f0066f60 0x7f73f0069420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f74040013d0 tx=0x7f7404001360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.362+0000 7f740d600640 1 -- 172.21.15.84:0/3545581662 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f73fc0557e0 con 0x7f74100ced70 2024-03-07T07:31:52.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7410071c80 con 0x7f74100ced70 2024-03-07T07:31:52.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f740d600640 1 -- 172.21.15.84:0/3545581662 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73fc059880 con 0x7f74100ced70 2024-03-07T07:31:52.518 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73f0066f60 msgr2=0x7f73f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73f0066f60 0x7f73f0069420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f74040013d0 tx=0x7f7404001360 comp rx=0 tx=0).stop 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100ced70 msgr2=0x7f741013bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100ced70 0x7f741013bfb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00e870 tx=0x7f73fc00ec70 comp rx=0 tx=0).stop 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 shutdown_connections 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f73f0066f60 0x7f73f0069420 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74101442a0 0x7f7410154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74100ced70 0x7f741013bfb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 --2- 172.21.15.84:0/3545581662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74100ce3d0 0x7f741013f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 >> 172.21.15.84:0/3545581662 conn(0x7f74100b1c50 msgr2=0x7f74101428b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 shutdown_connections 2024-03-07T07:31:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.518+0000 7f7418600640 1 -- 172.21.15.84:0/3545581662 wait complete. 2024-03-07T07:31:52.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ceec00640 1 Processor -- start 2024-03-07T07:31:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ceec00640 1 -- start start 2024-03-07T07:31:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ceec00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce8147940 0x7f6ce80719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ceec00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ce8071f00 0x7f6ce80b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ceec00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80ae270 con 0x7f6ce81472d0 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ceec00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce80ae510 con 0x7f6ce8071f00 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ceec00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80ae7f0 con 0x7f6ce8147940 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ce7e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6ce81472d0 0x7f6ce81625f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40792/0 (socket says 172.21.15.84:40792) 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.674+0000 7f6ce7e00640 1 -- 172.21.15.84:0/3710306390 learned_addr learned my addr 172.21.15.84:0/3710306390 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6cdf400640 1 --2- 172.21.15.84:0/3710306390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce8147940 0x7f6ce80719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6cecc00640 1 --2- 172.21.15.84:0/3710306390 >> v2:172.21.15.161:3300/0 conn(0x7f6ce8071f00 0x7f6ce80b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6ce7400640 1 -- 172.21.15.84:0/3710306390 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31939378 0 0) 0x7f6ce80ae270 con 0x7f6ce81472d0 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6ce7400640 1 -- 172.21.15.84:0/3710306390 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ccc003530 con 0x7f6ce81472d0 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6cdf400640 1 -- 172.21.15.84:0/3710306390 >> v2:172.21.15.161:3300/0 conn(0x7f6ce8071f00 msgr2=0x7f6ce80b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6cdf400640 1 --2- 172.21.15.84:0/3710306390 >> v2:172.21.15.161:3300/0 conn(0x7f6ce8071f00 0x7f6ce80b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6cdf400640 1 -- 172.21.15.84:0/3710306390 >> v1:172.21.15.84:6789/0 conn(0x7f6ce81472d0 legacy=0x7f6ce81625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6cdf400640 1 -- 172.21.15.84:0/3710306390 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80b4190 con 0x7f6ce8147940 2024-03-07T07:31:52.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6cdf400640 1 --2- 172.21.15.84:0/3710306390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce8147940 0x7f6ce80719c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00097c0 tx=0x7f6cd001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e271c51fae0e96 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6ce7400640 1 -- 172.21.15.84:0/3710306390 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00b0070 con 0x7f6ce8147940 2024-03-07T07:31:52.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6ce7400640 1 -- 172.21.15.84:0/3710306390 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd0004230 con 0x7f6ce8147940 2024-03-07T07:31:52.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.678+0000 7f6ce7400640 1 -- 172.21.15.84:0/3710306390 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0003620 con 0x7f6ce8147940 2024-03-07T07:31:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- 172.21.15.84:0/3710306390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce8147940 msgr2=0x7f6ce80719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 --2- 172.21.15.84:0/3710306390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce8147940 0x7f6ce80719c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00097c0 tx=0x7f6cd001c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- 172.21.15.84:0/3710306390 shutdown_connections 2024-03-07T07:31:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 --2- 172.21.15.84:0/3710306390 >> v2:172.21.15.161:3300/0 conn(0x7f6ce8071f00 0x7f6ce80b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 --2- 172.21.15.84:0/3710306390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce8147940 0x7f6ce80719c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- 172.21.15.84:0/3710306390 >> 172.21.15.84:0/3710306390 conn(0x7f6ce80b1c50 msgr2=0x7f6ce80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- 172.21.15.84:0/3710306390 shutdown_connections 2024-03-07T07:31:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- 172.21.15.84:0/3710306390 wait complete. 2024-03-07T07:31:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 Processor -- start 2024-03-07T07:31:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- start start 2024-03-07T07:31:52.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce8071f00 0x7f6ce8142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce81472d0 0x7f6ce813d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce813d680 0x7f6ce8156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce816b100 con 0x7f6ce8071f00 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce816af80 con 0x7f6ce813d680 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ceec00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce816b280 con 0x7f6ce81472d0 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce8071f00 0x7f6ce8142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce8071f00 0x7f6ce8142600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40354/0 (socket says 172.21.15.84:40354) 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 -- 172.21.15.84:0/458268784 learned_addr learned my addr 172.21.15.84:0/458268784 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6cecc00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce813d680 0x7f6ce8156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6cdf400640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce81472d0 0x7f6ce813d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 -- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce81472d0 msgr2=0x7f6ce813d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce81472d0 0x7f6ce813d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 -- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce813d680 msgr2=0x7f6ce8156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce813d680 0x7f6ce8156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 -- 172.21.15.84:0/458268784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80b2030 con 0x7f6ce8071f00 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6cdf400640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce81472d0 0x7f6ce813d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6cecc00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce813d680 0x7f6ce8156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.682+0000 7f6ce7e00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce8071f00 0x7f6ce8142600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800cb40 tx=0x7f6cd800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ce4c00640 1 -- 172.21.15.84:0/458268784 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8017070 con 0x7f6ce8071f00 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ce4c00640 1 -- 172.21.15.84:0/458268784 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd800aca0 con 0x7f6ce8071f00 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ce4c00640 1 -- 172.21.15.84:0/458268784 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8012620 con 0x7f6ce8071f00 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce8156160 con 0x7f6ce8071f00 2024-03-07T07:31:52.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce8155680 con 0x7f6ce8071f00 2024-03-07T07:31:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce8062d40 con 0x7f6ce8071f00 2024-03-07T07:31:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ce4c00640 1 -- 172.21.15.84:0/458268784 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f6cd801a070 con 0x7f6ce8071f00 2024-03-07T07:31:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ce4c00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6cc4066f60 0x7f6cc4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:52.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6ce4c00640 1 -- 172.21.15.84:0/458268784 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cd8084ee0 con 0x7f6ce8071f00 2024-03-07T07:31:52.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6cdf400640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6cc4066f60 0x7f6cc4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:52.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.686+0000 7f6cdf400640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6cc4066f60 0x7f6cc4069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00ad000 tx=0x7f6cd00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:52.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.690+0000 7f6ce4c00640 1 -- 172.21.15.84:0/458268784 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6cd8055e50 con 0x7f6ce8071f00 2024-03-07T07:31:52.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.846+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ce80682a0 con 0x7f6ce8071f00 2024-03-07T07:31:52.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.846+0000 7f6ce4c00640 1 -- 172.21.15.84:0/458268784 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6cd8055750 con 0x7f6ce8071f00 2024-03-07T07:31:52.847 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:52.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6cc4066f60 msgr2=0x7f6cc4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6cc4066f60 0x7f6cc4069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00ad000 tx=0x7f6cd00a6000 comp rx=0 tx=0).stop 2024-03-07T07:31:52.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce8071f00 msgr2=0x7f6ce8142600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:52.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce8071f00 0x7f6ce8142600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800cb40 tx=0x7f6cd800a060 comp rx=0 tx=0).stop 2024-03-07T07:31:52.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 shutdown_connections 2024-03-07T07:31:52.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6cc4066f60 0x7f6cc4069420 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ce813d680 0x7f6ce8156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ce81472d0 0x7f6ce813d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 --2- 172.21.15.84:0/458268784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce8071f00 0x7f6ce8142600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:52.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 >> 172.21.15.84:0/458268784 conn(0x7f6ce80b1c50 msgr2=0x7f6ce806dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:52.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 shutdown_connections 2024-03-07T07:31:52.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:52.850+0000 7f6ceec00640 1 -- 172.21.15.84:0/458268784 wait complete. 2024-03-07T07:31:52.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:53.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.006+0000 7fa2b4e00640 1 Processor -- start 2024-03-07T07:31:53.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.006+0000 7fa2b4e00640 1 -- start start 2024-03-07T07:31:53.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2b4e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa2b01618e0 0x7fa2b009a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2b4e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00b46c0 0x7fa2b009af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2b4e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2b00d1ae0 0x7fa2b00cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2b4e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b00b17b0 con 0x7fa2b00d1ae0 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2b4e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b0072390 con 0x7fa2b01618e0 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2b4e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00b1310 con 0x7fa2b00b46c0 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ae800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2b00d1ae0 0x7fa2b00cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa2b01618e0 0x7fa2b009a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa2b01618e0 0x7fa2b009a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:60846/0 (socket says 172.21.15.84:60846) 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 -- 172.21.15.84:0/3566339846 learned_addr learned my addr 172.21.15.84:0/3566339846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ae800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2b00d1ae0 0x7fa2b00cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40366/0 (socket says 172.21.15.84:40366) 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ad400640 1 --2- 172.21.15.84:0/3566339846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00b46c0 0x7fa2b009af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 -- 172.21.15.84:0/3566339846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00b46c0 msgr2=0x7fa2b009af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 --2- 172.21.15.84:0/3566339846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00b46c0 0x7fa2b009af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 -- 172.21.15.84:0/3566339846 >> v2:172.21.15.84:3300/0 conn(0x7fa2b00d1ae0 msgr2=0x7fa2b00cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 --2- 172.21.15.84:0/3566339846 >> v2:172.21.15.84:3300/0 conn(0x7fa2b00d1ae0 0x7fa2b00cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 -- 172.21.15.84:0/3566339846 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b0071a60 con 0x7fa2b01618e0 2024-03-07T07:31:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.010+0000 7fa2ade00640 1 --2- 172.21.15.84:0/3566339846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 0x7fa2b009a9e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa2b006e720 tx=0x7fa2a001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdd0c235b1bc9581 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2aca00640 1 -- 172.21.15.84:0/3566339846 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00aa610 con 0x7fa2b01618e0 2024-03-07T07:31:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2aca00640 1 -- 172.21.15.84:0/3566339846 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a00af070 con 0x7fa2b01618e0 2024-03-07T07:31:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2aca00640 1 -- 172.21.15.84:0/3566339846 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00aa9d0 con 0x7fa2b01618e0 2024-03-07T07:31:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- 172.21.15.84:0/3566339846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 msgr2=0x7fa2b009a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/3566339846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 0x7fa2b009a9e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa2b006e720 tx=0x7fa2a001c4f0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- 172.21.15.84:0/3566339846 shutdown_connections 2024-03-07T07:31:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/3566339846 >> v2:172.21.15.84:3300/0 conn(0x7fa2b00d1ae0 0x7fa2b00cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/3566339846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00b46c0 0x7fa2b009af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/3566339846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 0x7fa2b009a9e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- 172.21.15.84:0/3566339846 >> 172.21.15.84:0/3566339846 conn(0x7fa2b00b3ba0 msgr2=0x7fa2b00b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- 172.21.15.84:0/3566339846 shutdown_connections 2024-03-07T07:31:53.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- 172.21.15.84:0/3566339846 wait complete. 2024-03-07T07:31:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 Processor -- start 2024-03-07T07:31:53.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- start start 2024-03-07T07:31:53.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b46c0 0x7fa2b0157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00d1ae0 0x7fa2b00c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 0x7fa2b00c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0161e40 con 0x7fa2b00b46c0 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0161cc0 con 0x7fa2b01618e0 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.014+0000 7fa2b4e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b006b6e0 con 0x7fa2b00d1ae0 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b46c0 0x7fa2b0157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b46c0 0x7fa2b0157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40376/0 (socket says 172.21.15.84:40376) 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 -- 172.21.15.84:0/797562316 learned_addr learned my addr 172.21.15.84:0/797562316 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ad400640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00d1ae0 0x7fa2b00c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ae800640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 0x7fa2b00c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 -- 172.21.15.84:0/797562316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00d1ae0 msgr2=0x7fa2b00c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00d1ae0 0x7fa2b00c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 -- 172.21.15.84:0/797562316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 msgr2=0x7fa2b00c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 0x7fa2b00c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 -- 172.21.15.84:0/797562316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00cb530 con 0x7fa2b00b46c0 2024-03-07T07:31:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2ade00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b46c0 0x7fa2b0157190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa2a00ac040 tx=0x7fa2a001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2a6000640 1 -- 172.21.15.84:0/797562316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00bd3f0 con 0x7fa2b00b46c0 2024-03-07T07:31:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2a6000640 1 -- 172.21.15.84:0/797562316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a00bd590 con 0x7fa2b00b46c0 2024-03-07T07:31:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2a6000640 1 -- 172.21.15.84:0/797562316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00bd980 con 0x7fa2b00b46c0 2024-03-07T07:31:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b00cb810 con 0x7fa2b00b46c0 2024-03-07T07:31:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b00cbdd0 con 0x7fa2b00b46c0 2024-03-07T07:31:53.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b0062d40 con 0x7fa2b00b46c0 2024-03-07T07:31:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2a6000640 1 -- 172.21.15.84:0/797562316 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa2a00b33f0 con 0x7fa2b00b46c0 2024-03-07T07:31:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.018+0000 7fa2a6000640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa290066f60 0x7fa290069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.022+0000 7fa2a6000640 1 -- 172.21.15.84:0/797562316 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2a011f430 con 0x7fa2b00b46c0 2024-03-07T07:31:53.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.022+0000 7fa2ad400640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa290066f60 0x7fa290069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.022+0000 7fa2ad400640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa290066f60 0x7fa290069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0072560 tx=0x7fa29c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.026+0000 7fa2a6000640 1 -- 172.21.15.84:0/797562316 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa2a00c3060 con 0x7fa2b00b46c0 2024-03-07T07:31:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.178+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2b015bf60 con 0x7fa2b00b46c0 2024-03-07T07:31:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.178+0000 7fa2a6000640 1 -- 172.21.15.84:0/797562316 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2a00a7070 con 0x7fa2b00b46c0 2024-03-07T07:31:53.178 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.178+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa290066f60 msgr2=0x7fa290069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa290066f60 0x7fa290069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0072560 tx=0x7fa29c009190 comp rx=0 tx=0).stop 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b46c0 msgr2=0x7fa2b0157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b46c0 0x7fa2b0157190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa2a00ac040 tx=0x7fa2a001ad30 comp rx=0 tx=0).stop 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 shutdown_connections 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa290066f60 0x7fa290069420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2b01618e0 0x7fa2b00c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2b00d1ae0 0x7fa2b00c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 --2- 172.21.15.84:0/797562316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b00b46c0 0x7fa2b0157190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 >> 172.21.15.84:0/797562316 conn(0x7fa2b00b3ba0 msgr2=0x7fa2b00728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 shutdown_connections 2024-03-07T07:31:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.182+0000 7fa2b4e00640 1 -- 172.21.15.84:0/797562316 wait complete. 2024-03-07T07:31:53.200 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-07T07:31:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.334+0000 7f1b68800640 1 Processor -- start 2024-03-07T07:31:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.334+0000 7f1b68800640 1 -- start start 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.334+0000 7f1b68800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600a9540 0x7f1b6015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.334+0000 7f1b68800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1b600730e0 0x7f1b6015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.334+0000 7f1b68800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6006d780 con 0x7f1b60145a30 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.334+0000 7f1b68800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6006da60 con 0x7f1b600730e0 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.334+0000 7f1b68800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6006dd40 con 0x7f1b600a9540 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b66800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1b600730e0 0x7f1b6015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b65e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1b60145a30 0x7f1b600729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:54036/0 (socket says 172.21.15.84:54036) 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b65e00640 1 -- 172.21.15.84:0/655494760 learned_addr learned my addr 172.21.15.84:0/655494760 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b65400640 1 --2- 172.21.15.84:0/655494760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600a9540 0x7f1b6015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b66800640 1 -- 172.21.15.84:0/655494760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600a9540 msgr2=0x7f1b6015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b66800640 1 --2- 172.21.15.84:0/655494760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600a9540 0x7f1b6015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b66800640 1 -- 172.21.15.84:0/655494760 >> v1:172.21.15.161:6789/0 conn(0x7f1b60145a30 legacy=0x7f1b600729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b66800640 1 -- 172.21.15.84:0/655494760 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6006e020 con 0x7f1b600730e0 2024-03-07T07:31:53.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b64a00640 1 -- 172.21.15.84:0/655494760 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378250539 0 0) 0x7f1b6006d780 con 0x7f1b60145a30 2024-03-07T07:31:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b66800640 1 --2- 172.21.15.84:0/655494760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 0x7f1b6015cd20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009d90 tx=0x7f1b5c01c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e5c53350582ddb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b64a00640 1 -- 172.21.15.84:0/655494760 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0b2070 con 0x7f1b600730e0 2024-03-07T07:31:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b64a00640 1 -- 172.21.15.84:0/655494760 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c0a5820 con 0x7f1b600730e0 2024-03-07T07:31:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.338+0000 7f1b64a00640 1 -- 172.21.15.84:0/655494760 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0a5bf0 con 0x7f1b600730e0 2024-03-07T07:31:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- 172.21.15.84:0/655494760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 msgr2=0x7f1b6015cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 --2- 172.21.15.84:0/655494760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 0x7f1b6015cd20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009d90 tx=0x7f1b5c01c850 comp rx=0 tx=0).stop 2024-03-07T07:31:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- 172.21.15.84:0/655494760 shutdown_connections 2024-03-07T07:31:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 --2- 172.21.15.84:0/655494760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 0x7f1b6015cd20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 --2- 172.21.15.84:0/655494760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600a9540 0x7f1b6015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- 172.21.15.84:0/655494760 >> 172.21.15.84:0/655494760 conn(0x7f1b600704b0 msgr2=0x7f1b600708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- 172.21.15.84:0/655494760 shutdown_connections 2024-03-07T07:31:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- 172.21.15.84:0/655494760 wait complete. 2024-03-07T07:31:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 Processor -- start 2024-03-07T07:31:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- start start 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 0x7f1b600ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b60145a30 0x7f1b600b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600adb00 0x7f1b600b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60168d60 con 0x7f1b60145a30 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60168be0 con 0x7f1b600730e0 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b68800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60168ee0 con 0x7f1b600adb00 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b60145a30 0x7f1b600b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b60145a30 0x7f1b600b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40380/0 (socket says 172.21.15.84:40380) 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 -- 172.21.15.84:0/3899283419 learned_addr learned my addr 172.21.15.84:0/3899283419 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 0x7f1b600ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b66800640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600adb00 0x7f1b600b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 -- 172.21.15.84:0/3899283419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600adb00 msgr2=0x7f1b600b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600adb00 0x7f1b600b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 -- 172.21.15.84:0/3899283419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 msgr2=0x7f1b600ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 0x7f1b600ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 -- 172.21.15.84:0/3899283419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b601f7680 con 0x7f1b60145a30 2024-03-07T07:31:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65e00640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 0x7f1b600ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.342+0000 7f1b65400640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b60145a30 0x7f1b600b0c30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000e930 tx=0x7f1b5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b5a000640 1 -- 172.21.15.84:0/3899283419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50017070 con 0x7f1b60145a30 2024-03-07T07:31:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b5a000640 1 -- 172.21.15.84:0/3899283419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5000ca00 con 0x7f1b60145a30 2024-03-07T07:31:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b600ad020 con 0x7f1b60145a30 2024-03-07T07:31:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b5a000640 1 -- 172.21.15.84:0/3899283419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000cdb0 con 0x7f1b60145a30 2024-03-07T07:31:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600ad5e0 con 0x7f1b60145a30 2024-03-07T07:31:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60062d40 con 0x7f1b60145a30 2024-03-07T07:31:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b5a000640 1 -- 172.21.15.84:0/3899283419 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f1b5001a070 con 0x7f1b60145a30 2024-03-07T07:31:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b5a000640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1b44066f60 0x7f1b44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b5a000640 1 -- 172.21.15.84:0/3899283419 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b500853d0 con 0x7f1b60145a30 2024-03-07T07:31:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b65e00640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1b44066f60 0x7f1b44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.346+0000 7f1b65e00640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1b44066f60 0x7f1b44069420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b54000f70 tx=0x7f1b54007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.350+0000 7f1b5a000640 1 -- 172.21.15.84:0/3899283419 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f1b50055db0 con 0x7f1b60145a30 2024-03-07T07:31:53.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1b600682a0 con 0x7f1b60145a30 2024-03-07T07:31:53.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b5a000640 1 -- 172.21.15.84:0/3899283419 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1b50059e50 con 0x7f1b60145a30 2024-03-07T07:31:53.522 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1b44066f60 msgr2=0x7f1b44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1b44066f60 0x7f1b44069420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b54000f70 tx=0x7f1b54007df0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b60145a30 msgr2=0x7f1b600b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b60145a30 0x7f1b600b0c30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000e930 tx=0x7f1b5000edf0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 shutdown_connections 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1b44066f60 0x7f1b44069420 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b600adb00 0x7f1b600b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b60145a30 0x7f1b600b0c30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 --2- 172.21.15.84:0/3899283419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b600730e0 0x7f1b600ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 >> 172.21.15.84:0/3899283419 conn(0x7f1b600704b0 msgr2=0x7f1b6015e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 shutdown_connections 2024-03-07T07:31:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.522+0000 7f1b68800640 1 -- 172.21.15.84:0/3899283419 wait complete. 2024-03-07T07:31:53.542 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-07T07:31:53.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:53.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-07T07:31:53.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:31:53.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:53.565 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-07T07:31:53.617 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:31:53.617 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:53.626 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:31:53.626 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:53.678 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:31:53.678 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:31:53.725 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:53.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f3004a00640 1 Processor -- start 2024-03-07T07:31:53.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f3004a00640 1 -- start start 2024-03-07T07:31:53.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f3004a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000147d10 0x7f30000b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f3004a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3000071600 0x7f30000b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f3004a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30000b3a00 0x7f30000aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f3004a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30001480f0 con 0x7f3000071600 2024-03-07T07:31:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f3004a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30000724f0 con 0x7f30000b3a00 2024-03-07T07:31:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f3004a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30000b0f80 con 0x7f3000147d10 2024-03-07T07:31:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffd400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3000071600 0x7f30000b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffd400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3000071600 0x7f30000b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40384/0 (socket says 172.21.15.84:40384) 2024-03-07T07:31:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffd400640 1 -- 172.21.15.84:0/3078234577 learned_addr learned my addr 172.21.15.84:0/3078234577 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffde00640 1 --2- 172.21.15.84:0/3078234577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000147d10 0x7f30000b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffe800640 1 --2- 172.21.15.84:0/3078234577 >> v2:172.21.15.161:3300/0 conn(0x7f30000b3a00 0x7f30000aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffd400640 1 -- 172.21.15.84:0/3078234577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000147d10 msgr2=0x7f30000b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffd400640 1 --2- 172.21.15.84:0/3078234577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000147d10 0x7f30000b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffd400640 1 -- 172.21.15.84:0/3078234577 >> v2:172.21.15.161:3300/0 conn(0x7f30000b3a00 msgr2=0x7f30000aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffd400640 1 --2- 172.21.15.84:0/3078234577 >> v2:172.21.15.161:3300/0 conn(0x7f30000b3a00 0x7f30000aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffd400640 1 -- 172.21.15.84:0/3078234577 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000732f0 con 0x7f3000071600 2024-03-07T07:31:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.862+0000 7f2ffe800640 1 --2- 172.21.15.84:0/3078234577 >> v2:172.21.15.161:3300/0 conn(0x7f30000b3a00 0x7f30000aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:53.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f2ffd400640 1 --2- 172.21.15.84:0/3078234577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000071600 0x7f30000b0700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f300006fd40 tx=0x7f2fec01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3aafe522f94e34f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f2ffca00640 1 -- 172.21.15.84:0/3078234577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0b5070 con 0x7f3000071600 2024-03-07T07:31:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f2ffca00640 1 -- 172.21.15.84:0/3078234577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec0a89d0 con 0x7f3000071600 2024-03-07T07:31:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f2ffca00640 1 -- 172.21.15.84:0/3078234577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0a8da0 con 0x7f3000071600 2024-03-07T07:31:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 -- 172.21.15.84:0/3078234577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000071600 msgr2=0x7f30000b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 --2- 172.21.15.84:0/3078234577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000071600 0x7f30000b0700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f300006fd40 tx=0x7f2fec01ed10 comp rx=0 tx=0).stop 2024-03-07T07:31:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 -- 172.21.15.84:0/3078234577 shutdown_connections 2024-03-07T07:31:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 --2- 172.21.15.84:0/3078234577 >> v2:172.21.15.161:3300/0 conn(0x7f30000b3a00 0x7f30000aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 --2- 172.21.15.84:0/3078234577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000071600 0x7f30000b0700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 --2- 172.21.15.84:0/3078234577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000147d10 0x7f30000b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 -- 172.21.15.84:0/3078234577 >> 172.21.15.84:0/3078234577 conn(0x7f30000b1ed0 msgr2=0x7f30000b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 -- 172.21.15.84:0/3078234577 shutdown_connections 2024-03-07T07:31:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 -- 172.21.15.84:0/3078234577 wait complete. 2024-03-07T07:31:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.866+0000 7f3004a00640 1 Processor -- start 2024-03-07T07:31:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 -- start start 2024-03-07T07:31:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000071600 0x7f3000139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30000b3a00 0x7f3000143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000147d10 0x7f300009df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000072d30 con 0x7f3000147d10 2024-03-07T07:31:53.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000072a50 con 0x7f30000b3a00 2024-03-07T07:31:53.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3000073010 con 0x7f3000071600 2024-03-07T07:31:53.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000147d10 0x7f300009df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000147d10 0x7f300009df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40396/0 (socket says 172.21.15.84:40396) 2024-03-07T07:31:53.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffde00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000071600 0x7f3000139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 -- 172.21.15.84:0/2073474134 learned_addr learned my addr 172.21.15.84:0/2073474134 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:53.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffd400640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30000b3a00 0x7f3000143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 -- 172.21.15.84:0/2073474134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000071600 msgr2=0x7f3000139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000071600 0x7f3000139f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 -- 172.21.15.84:0/2073474134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30000b3a00 msgr2=0x7f3000143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30000b3a00 0x7f3000143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 -- 172.21.15.84:0/2073474134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300013a4b0 con 0x7f3000147d10 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ffe800640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000147d10 0x7f300009df10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8007e10 tx=0x7f2ff800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ff6000640 1 -- 172.21.15.84:0/2073474134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff801a070 con 0x7f3000147d10 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ff6000640 1 -- 172.21.15.84:0/2073474134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8003ba0 con 0x7f3000147d10 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f2ff6000640 1 -- 172.21.15.84:0/2073474134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff800de20 con 0x7f3000147d10 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30001378b0 con 0x7f3000147d10 2024-03-07T07:31:53.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3000137e70 con 0x7f3000147d10 2024-03-07T07:31:53.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.870+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3000062d40 con 0x7f3000147d10 2024-03-07T07:31:53.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.874+0000 7f2ff6000640 1 -- 172.21.15.84:0/2073474134 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f2ff801d070 con 0x7f3000147d10 2024-03-07T07:31:53.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.874+0000 7f2ff6000640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2fe0066f60 0x7f2fe0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:53.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.874+0000 7f2ff6000640 1 -- 172.21.15.84:0/2073474134 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2ff8085270 con 0x7f3000147d10 2024-03-07T07:31:53.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.874+0000 7f2ffde00640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2fe0066f60 0x7f2fe0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:53.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.874+0000 7f2ffde00640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2fe0066f60 0x7f2fe0069420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009ac0 tx=0x7f2ff0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:53.878+0000 7f2ff6000640 1 -- 172.21.15.84:0/2073474134 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f300013a4b0 con 0x7f3000147d10 2024-03-07T07:31:54.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.038+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30000cebd0 con 0x7f3000147d10 2024-03-07T07:31:54.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.038+0000 7f2ff6000640 1 -- 172.21.15.84:0/2073474134 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16622 (secure 0 0 0) 0x7f2ff8010070 con 0x7f3000147d10 2024-03-07T07:31:54.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:54.040 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:53.472525+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:54.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2fe0066f60 msgr2=0x7f2fe0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2fe0066f60 0x7f2fe0069420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009ac0 tx=0x7f2ff0009190 comp rx=0 tx=0).stop 2024-03-07T07:31:54.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000147d10 msgr2=0x7f300009df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000147d10 0x7f300009df10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8007e10 tx=0x7f2ff800d4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 shutdown_connections 2024-03-07T07:31:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2fe0066f60 0x7f2fe0069420 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3000147d10 0x7f300009df10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30000b3a00 0x7f3000143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 --2- 172.21.15.84:0/2073474134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3000071600 0x7f3000139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 >> 172.21.15.84:0/2073474134 conn(0x7f30000b1ed0 msgr2=0x7f30000d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 shutdown_connections 2024-03-07T07:31:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.042+0000 7f3004a00640 1 -- 172.21.15.84:0/2073474134 wait complete. 2024-03-07T07:31:54.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:54.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.202+0000 7f8a60400640 1 Processor -- start 2024-03-07T07:31:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.202+0000 7f8a60400640 1 -- start start 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.202+0000 7f8a60400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8a581618e0 0x7f8a5809a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.202+0000 7f8a60400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a580b46c0 0x7f8a5809af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.202+0000 7f8a60400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a58071a60 con 0x7f8a580d1ae0 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.202+0000 7f8a60400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a580b17b0 con 0x7f8a581618e0 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.202+0000 7f8a60400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58072390 con 0x7f8a580b46c0 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5e400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8a580d1ae0 0x7f8a580cff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40806/0 (socket says 172.21.15.84:40806) 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5e400640 1 -- 172.21.15.84:0/2858002530 learned_addr learned my addr 172.21.15.84:0/2858002530 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5da00640 1 --2- 172.21.15.84:0/2858002530 >> v2:172.21.15.161:3300/0 conn(0x7f8a581618e0 0x7f8a5809a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5d000640 1 --2- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a580b46c0 0x7f8a5809af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a57e00640 1 -- 172.21.15.84:0/2858002530 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199682462 0 0) 0x7f8a58071a60 con 0x7f8a580d1ae0 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a57e00640 1 -- 172.21.15.84:0/2858002530 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a40003530 con 0x7f8a580d1ae0 2024-03-07T07:31:54.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5da00640 1 -- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a580b46c0 msgr2=0x7f8a5809af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5da00640 1 --2- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a580b46c0 0x7f8a5809af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5da00640 1 -- 172.21.15.84:0/2858002530 >> v1:172.21.15.84:6789/0 conn(0x7f8a580d1ae0 legacy=0x7f8a580cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5da00640 1 -- 172.21.15.84:0/2858002530 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58071d40 con 0x7f8a581618e0 2024-03-07T07:31:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5d000640 1 --2- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a580b46c0 0x7f8a5809af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a5da00640 1 --2- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a581618e0 0x7f8a5809a9e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0097c0 tx=0x7f8a4c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51da4f275f9d727a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a57e00640 1 -- 172.21.15.84:0/2858002530 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0b1070 con 0x7f8a581618e0 2024-03-07T07:31:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a57e00640 1 -- 172.21.15.84:0/2858002530 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c0ac410 con 0x7f8a581618e0 2024-03-07T07:31:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.206+0000 7f8a57e00640 1 -- 172.21.15.84:0/2858002530 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0ac7e0 con 0x7f8a581618e0 2024-03-07T07:31:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a581618e0 msgr2=0x7f8a5809a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 --2- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a581618e0 0x7f8a5809a9e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0097c0 tx=0x7f8a4c01c4a0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- 172.21.15.84:0/2858002530 shutdown_connections 2024-03-07T07:31:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 --2- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a580b46c0 0x7f8a5809af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 --2- 172.21.15.84:0/2858002530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a581618e0 0x7f8a5809a9e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- 172.21.15.84:0/2858002530 >> 172.21.15.84:0/2858002530 conn(0x7f8a580b3ba0 msgr2=0x7f8a580b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- 172.21.15.84:0/2858002530 shutdown_connections 2024-03-07T07:31:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- 172.21.15.84:0/2858002530 wait complete. 2024-03-07T07:31:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 Processor -- start 2024-03-07T07:31:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- start start 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a580b46c0 0x7f8a58157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a580d1ae0 0x7f8a580b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a581618e0 0x7f8a5815a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5816b130 con 0x7f8a580d1ae0 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58161ed0 con 0x7f8a580b46c0 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a60400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5816b2b0 con 0x7f8a581618e0 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a5d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a580d1ae0 0x7f8a580b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a5d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a580d1ae0 0x7f8a580b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40402/0 (socket says 172.21.15.84:40402) 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a5d000640 1 -- 172.21.15.84:0/436393530 learned_addr learned my addr 172.21.15.84:0/436393530 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a5da00640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a580b46c0 0x7f8a58157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.210+0000 7f8a5e400640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a581618e0 0x7f8a5815a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a5da00640 1 -- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a581618e0 msgr2=0x7f8a5815a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a5da00640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a581618e0 0x7f8a5815a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a5da00640 1 -- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a580d1ae0 msgr2=0x7f8a580b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a5da00640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a580d1ae0 0x7f8a580b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a5da00640 1 -- 172.21.15.84:0/436393530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a580ca270 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a5d000640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a580d1ae0 0x7f8a580b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a5da00640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a580b46c0 0x7f8a58157590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0ac000 tx=0x7f8a4c019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a55600640 1 -- 172.21.15.84:0/436393530 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0b1040 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a55600640 1 -- 172.21.15.84:0/436393530 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c0bc070 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a580b7590 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a55600640 1 -- 172.21.15.84:0/436393530 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0b5410 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a580b7b50 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a58062d40 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a55600640 1 -- 172.21.15.84:0/436393530 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f8a4c0b55b0 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a55600640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8a38066f60 0x7f8a38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a55600640 1 -- 172.21.15.84:0/436393530 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8a4c11ea50 con 0x7f8a580b46c0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.214+0000 7f8a5d000640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8a38066f60 0x7f8a38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.218+0000 7f8a5d000640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8a38066f60 0x7f8a38069420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8a58073740 tx=0x7f8a44009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.218+0000 7f8a55600640 1 -- 172.21.15.84:0/436393530 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f8a4c016090 con 0x7f8a580b46c0 2024-03-07T07:31:54.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a58158c00 con 0x7f8a580b46c0 2024-03-07T07:31:54.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a55600640 1 -- 172.21.15.84:0/436393530 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a4c0ef470 con 0x7f8a580b46c0 2024-03-07T07:31:54.373 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:54.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8a38066f60 msgr2=0x7f8a38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8a38066f60 0x7f8a38069420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8a58073740 tx=0x7f8a44009190 comp rx=0 tx=0).stop 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a580b46c0 msgr2=0x7f8a58157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a580b46c0 0x7f8a58157590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0ac000 tx=0x7f8a4c019240 comp rx=0 tx=0).stop 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 shutdown_connections 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8a38066f60 0x7f8a38069420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a581618e0 0x7f8a5815a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a580d1ae0 0x7f8a580b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 --2- 172.21.15.84:0/436393530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a580b46c0 0x7f8a58157590 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 >> 172.21.15.84:0/436393530 conn(0x7f8a580b3ba0 msgr2=0x7f8a5815bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 shutdown_connections 2024-03-07T07:31:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.374+0000 7f8a60400640 1 -- 172.21.15.84:0/436393530 wait complete. 2024-03-07T07:31:54.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1c0a00640 1 Processor -- start 2024-03-07T07:31:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1c0a00640 1 -- start start 2024-03-07T07:31:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1c0a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb1bc1442a0 0x7fb1bc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1c0a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1bc0b3ec0 0x7fb1bc06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1c0a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc0b51f0 con 0x7fb1bc0b3350 2024-03-07T07:31:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1c0a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc06eec0 con 0x7fb1bc0b3ec0 2024-03-07T07:31:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1c0a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc06f1a0 con 0x7fb1bc1442a0 2024-03-07T07:31:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1ba800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1bc0b3ec0 0x7fb1bc06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1b9400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb1bc0b3350 0x7fb1bc0b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40810/0 (socket says 172.21.15.84:40810) 2024-03-07T07:31:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1ba800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1bc0b3ec0 0x7fb1bc06dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40404/0 (socket says 172.21.15.84:40404) 2024-03-07T07:31:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1b9e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb1bc1442a0 0x7fb1bc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.534+0000 7fb1b9400640 1 -- 172.21.15.84:0/108185495 learned_addr learned my addr 172.21.15.84:0/108185495 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1ba800640 1 -- 172.21.15.84:0/108185495 >> v2:172.21.15.161:3300/0 conn(0x7fb1bc1442a0 msgr2=0x7fb1bc0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1ba800640 1 --2- 172.21.15.84:0/108185495 >> v2:172.21.15.161:3300/0 conn(0x7fb1bc1442a0 0x7fb1bc0b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1ba800640 1 -- 172.21.15.84:0/108185495 >> v1:172.21.15.84:6789/0 conn(0x7fb1bc0b3350 legacy=0x7fb1bc0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1ba800640 1 -- 172.21.15.84:0/108185495 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0cc800 con 0x7fb1bc0b3ec0 2024-03-07T07:31:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1ba800640 1 --2- 172.21.15.84:0/108185495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc0b3ec0 0x7fb1bc06dc40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc073590 tx=0x7fb1b401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f25674b04b445f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1b8a00640 1 -- 172.21.15.84:0/108185495 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40b1070 con 0x7fb1bc0b3ec0 2024-03-07T07:31:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1b8a00640 1 -- 172.21.15.84:0/108185495 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40ac640 con 0x7fb1bc0b3ec0 2024-03-07T07:31:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1b8a00640 1 -- 172.21.15.84:0/108185495 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40aca10 con 0x7fb1bc0b3ec0 2024-03-07T07:31:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1c0a00640 1 -- 172.21.15.84:0/108185495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc0b3ec0 msgr2=0x7fb1bc06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/108185495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc0b3ec0 0x7fb1bc06dc40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc073590 tx=0x7fb1b401c3f0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1c0a00640 1 -- 172.21.15.84:0/108185495 shutdown_connections 2024-03-07T07:31:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/108185495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc0b3ec0 0x7fb1bc06dc40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/108185495 >> v2:172.21.15.161:3300/0 conn(0x7fb1bc1442a0 0x7fb1bc0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1c0a00640 1 -- 172.21.15.84:0/108185495 >> 172.21.15.84:0/108185495 conn(0x7fb1bc0b1c50 msgr2=0x7fb1bc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1c0a00640 1 -- 172.21.15.84:0/108185495 shutdown_connections 2024-03-07T07:31:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.538+0000 7fb1c0a00640 1 -- 172.21.15.84:0/108185495 wait complete. 2024-03-07T07:31:54.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 Processor -- start 2024-03-07T07:31:54.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 -- start start 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1bc0b3350 0x7fb1bc13aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1bc0b3ec0 0x7fb1bc1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc1442a0 0x7fb1bc155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc06eb10 con 0x7fb1bc1442a0 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc06e990 con 0x7fb1bc0b3ec0 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc1679d0 con 0x7fb1bc0b3350 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc1442a0 0x7fb1bc155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc1442a0 0x7fb1bc155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40414/0 (socket says 172.21.15.84:40414) 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 -- 172.21.15.84:0/501831663 learned_addr learned my addr 172.21.15.84:0/501831663 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1b9e00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1bc0b3350 0x7fb1bc13aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1b9400640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1bc0b3ec0 0x7fb1bc1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 -- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1bc0b3350 msgr2=0x7fb1bc13aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1bc0b3350 0x7fb1bc13aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 -- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1bc0b3ec0 msgr2=0x7fb1bc1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1bc0b3ec0 0x7fb1bc1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 -- 172.21.15.84:0/501831663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc156390 con 0x7fb1bc1442a0 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1b9400640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1bc0b3ec0 0x7fb1bc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1ba800640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc1442a0 0x7fb1bc155720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40af040 tx=0x7fb1b4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1b2000640 1 -- 172.21.15.84:0/501831663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40b1040 con 0x7fb1bc1442a0 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1b2000640 1 -- 172.21.15.84:0/501831663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40ba070 con 0x7fb1bc1442a0 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1bc156670 con 0x7fb1bc1442a0 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1b2000640 1 -- 172.21.15.84:0/501831663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40b5650 con 0x7fb1bc1442a0 2024-03-07T07:31:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.542+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc156c30 con 0x7fb1bc1442a0 2024-03-07T07:31:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.546+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc062d40 con 0x7fb1bc1442a0 2024-03-07T07:31:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.546+0000 7fb1b2000640 1 -- 172.21.15.84:0/501831663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb1b40b57f0 con 0x7fb1bc1442a0 2024-03-07T07:31:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.546+0000 7fb1b2000640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb19c066f90 0x7fb19c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.546+0000 7fb1b2000640 1 -- 172.21.15.84:0/501831663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb1b411ef00 con 0x7fb1bc1442a0 2024-03-07T07:31:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.546+0000 7fb1b9e00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb19c066f90 0x7fb19c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.546+0000 7fb1b9e00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb19c066f90 0x7fb19c069450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0113e0 tx=0x7fb1ac00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.550+0000 7fb1b2000640 1 -- 172.21.15.84:0/501831663 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb1b4016070 con 0x7fb1bc1442a0 2024-03-07T07:31:54.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1bc071c80 con 0x7fb1bc1442a0 2024-03-07T07:31:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1b2000640 1 -- 172.21.15.84:0/501831663 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1b40efe50 con 0x7fb1bc1442a0 2024-03-07T07:31:54.705 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb19c066f90 msgr2=0x7fb19c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb19c066f90 0x7fb19c069450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0113e0 tx=0x7fb1ac00b040 comp rx=0 tx=0).stop 2024-03-07T07:31:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc1442a0 msgr2=0x7fb1bc155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc1442a0 0x7fb1bc155720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40af040 tx=0x7fb1b4019190 comp rx=0 tx=0).stop 2024-03-07T07:31:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 shutdown_connections 2024-03-07T07:31:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb19c066f90 0x7fb19c069450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1bc1442a0 0x7fb1bc155720 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1bc0b3ec0 0x7fb1bc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 --2- 172.21.15.84:0/501831663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1bc0b3350 0x7fb1bc13aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 >> 172.21.15.84:0/501831663 conn(0x7fb1bc0b1c50 msgr2=0x7fb1bc143150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 shutdown_connections 2024-03-07T07:31:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.706+0000 7fb1c0a00640 1 -- 172.21.15.84:0/501831663 wait complete. 2024-03-07T07:31:54.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:54.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f3601400640 1 Processor -- start 2024-03-07T07:31:54.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f3601400640 1 -- start start 2024-03-07T07:31:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f3601400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35fc0ce3d0 0x7f35fc0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f3601400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc06eec0 con 0x7f35fc0ced70 2024-03-07T07:31:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f3601400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc06f1a0 con 0x7f35fc1442a0 2024-03-07T07:31:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f3601400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0cc800 con 0x7f35fc0ce3d0 2024-03-07T07:31:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f35f1e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35fc0ce3d0 0x7f35fc0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f35f1e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35fc0ce3d0 0x7f35fc0ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40422/0 (socket says 172.21.15.84:40422) 2024-03-07T07:31:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f35fb200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f35fc0ced70 0x7f35fc06dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40822/0 (socket says 172.21.15.84:40822) 2024-03-07T07:31:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f35f1e00640 1 -- 172.21.15.84:0/249309732 learned_addr learned my addr 172.21.15.84:0/249309732 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f35f1e00640 1 -- 172.21.15.84:0/249309732 >> v1:172.21.15.161:6789/0 conn(0x7f35fc1442a0 legacy=0x7f35fc0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f35f1e00640 1 -- 172.21.15.84:0/249309732 >> v1:172.21.15.84:6789/0 conn(0x7f35fc0ced70 legacy=0x7f35fc06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f35f1e00640 1 -- 172.21.15.84:0/249309732 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0b4460 con 0x7f35fc0ce3d0 2024-03-07T07:31:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.866+0000 7f35f9e00640 1 -- 172.21.15.84:0/249309732 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482270078 0 0) 0x7f35fc06eec0 con 0x7f35fc0ced70 2024-03-07T07:31:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f35f1e00640 1 --2- 172.21.15.84:0/249309732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce3d0 0x7f35fc0ce830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009870 tx=0x7f35e401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353f0ade26c97816 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f35f9e00640 1 -- 172.21.15.84:0/249309732 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40ab600 con 0x7f35fc0ce3d0 2024-03-07T07:31:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f35f9e00640 1 -- 172.21.15.84:0/249309732 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e40b0070 con 0x7f35fc0ce3d0 2024-03-07T07:31:54.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f35f9e00640 1 -- 172.21.15.84:0/249309732 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40ab9c0 con 0x7f35fc0ce3d0 2024-03-07T07:31:54.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 -- 172.21.15.84:0/249309732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce3d0 msgr2=0x7f35fc0ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 --2- 172.21.15.84:0/249309732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce3d0 0x7f35fc0ce830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009870 tx=0x7f35e401c560 comp rx=0 tx=0).stop 2024-03-07T07:31:54.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 -- 172.21.15.84:0/249309732 shutdown_connections 2024-03-07T07:31:54.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 --2- 172.21.15.84:0/249309732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce3d0 0x7f35fc0ce830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 -- 172.21.15.84:0/249309732 >> 172.21.15.84:0/249309732 conn(0x7f35fc0b1c50 msgr2=0x7f35fc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:54.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 -- 172.21.15.84:0/249309732 shutdown_connections 2024-03-07T07:31:54.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 -- 172.21.15.84:0/249309732 wait complete. 2024-03-07T07:31:54.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 Processor -- start 2024-03-07T07:31:54.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.870+0000 7f3601400640 1 -- start start 2024-03-07T07:31:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35fc0ce3d0 0x7f35fc15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ced70 0x7f35fc1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35fc1442a0 0x7f35fc154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc168b60 con 0x7f35fc0ced70 2024-03-07T07:31:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1689e0 con 0x7f35fc1442a0 2024-03-07T07:31:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc168ce0 con 0x7f35fc0ce3d0 2024-03-07T07:31:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35f1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ced70 0x7f35fc1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35fb200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35fc1442a0 0x7f35fc154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35fa800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35fc0ce3d0 0x7f35fc15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35f1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ced70 0x7f35fc1540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40436/0 (socket says 172.21.15.84:40436) 2024-03-07T07:31:54.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35f1e00640 1 -- 172.21.15.84:0/1232160590 learned_addr learned my addr 172.21.15.84:0/1232160590 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35fb200640 1 -- 172.21.15.84:0/1232160590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35fc0ce3d0 msgr2=0x7f35fc15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35fb200640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35fc0ce3d0 0x7f35fc15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35fb200640 1 -- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ced70 msgr2=0x7f35fc1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35fb200640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ced70 0x7f35fc1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35fb200640 1 -- 172.21.15.84:0/1232160590 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc152ee0 con 0x7f35fc1442a0 2024-03-07T07:31:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35f1e00640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ced70 0x7f35fc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35fb200640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35fc1442a0 0x7f35fc154630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c6e0 tx=0x7f35f400cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35f3400640 1 -- 172.21.15.84:0/1232160590 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4018070 con 0x7f35fc1442a0 2024-03-07T07:31:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35f3400640 1 -- 172.21.15.84:0/1232160590 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4004d90 con 0x7f35fc1442a0 2024-03-07T07:31:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc151e40 con 0x7f35fc1442a0 2024-03-07T07:31:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f35f3400640 1 -- 172.21.15.84:0/1232160590 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f400a880 con 0x7f35fc1442a0 2024-03-07T07:31:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc152400 con 0x7f35fc1442a0 2024-03-07T07:31:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.874+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc062d40 con 0x7f35fc1442a0 2024-03-07T07:31:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.878+0000 7f35f3400640 1 -- 172.21.15.84:0/1232160590 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f35f401b070 con 0x7f35fc1442a0 2024-03-07T07:31:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.878+0000 7f35f3400640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35d8066f60 0x7f35d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.878+0000 7f35f3400640 1 -- 172.21.15.84:0/1232160590 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f35f40844b0 con 0x7f35fc1442a0 2024-03-07T07:31:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.878+0000 7f35fa800640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35d8066f60 0x7f35d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.878+0000 7f35fa800640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35d8066f60 0x7f35d8069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35ec007fd0 tx=0x7f35ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:54.878+0000 7f35f3400640 1 -- 172.21.15.84:0/1232160590 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f35f4054ec0 con 0x7f35fc1442a0 2024-03-07T07:31:55.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.034+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35fc157f10 con 0x7f35fc1442a0 2024-03-07T07:31:55.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.034+0000 7f35f3400640 1 -- 172.21.15.84:0/1232160590 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35f4058f60 con 0x7f35fc1442a0 2024-03-07T07:31:55.036 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:55.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35d8066f60 msgr2=0x7f35d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35d8066f60 0x7f35d8069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35ec007fd0 tx=0x7f35ec009040 comp rx=0 tx=0).stop 2024-03-07T07:31:55.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35fc1442a0 msgr2=0x7f35fc154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35fc1442a0 0x7f35fc154630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c6e0 tx=0x7f35f400cba0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 shutdown_connections 2024-03-07T07:31:55.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f35d8066f60 0x7f35d8069420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35fc1442a0 0x7f35fc154630 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ced70 0x7f35fc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 --2- 172.21.15.84:0/1232160590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35fc0ce3d0 0x7f35fc15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 >> 172.21.15.84:0/1232160590 conn(0x7f35fc0b1c50 msgr2=0x7f35fc142a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:55.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 shutdown_connections 2024-03-07T07:31:55.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.038+0000 7f3601400640 1 -- 172.21.15.84:0/1232160590 wait complete. 2024-03-07T07:31:55.057 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-07T07:31:55.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.190+0000 7f7342200640 1 Processor -- start 2024-03-07T07:31:55.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.190+0000 7f7342200640 1 -- start start 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7342200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f733c0730e0 0x7f733c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7342200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f733c144360 0x7f733c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7342200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733c0cc880 con 0x7f733c143dd0 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7342200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c1441b0 con 0x7f733c0730e0 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7342200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c0cf050 con 0x7f733c144360 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7332a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f733c0730e0 0x7f733c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f733b400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f733c143dd0 0x7f733c0729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40834/0 (socket says 172.21.15.84:40834) 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f733b400640 1 -- 172.21.15.84:0/314902851 learned_addr learned my addr 172.21.15.84:0/314902851 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f733be00640 1 --2- 172.21.15.84:0/314902851 >> v2:172.21.15.161:3300/0 conn(0x7f733c144360 0x7f733c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7332a00640 1 -- 172.21.15.84:0/314902851 >> v2:172.21.15.161:3300/0 conn(0x7f733c144360 msgr2=0x7f733c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7332a00640 1 --2- 172.21.15.84:0/314902851 >> v2:172.21.15.161:3300/0 conn(0x7f733c144360 0x7f733c15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7332a00640 1 -- 172.21.15.84:0/314902851 >> v1:172.21.15.84:6789/0 conn(0x7f733c143dd0 legacy=0x7f733c0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f7332a00640 1 -- 172.21.15.84:0/314902851 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0ccb60 con 0x7f733c0730e0 2024-03-07T07:31:55.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.194+0000 7f733aa00640 1 -- 172.21.15.84:0/314902851 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27886859 0 0) 0x7f733c0cc880 con 0x7f733c143dd0 2024-03-07T07:31:55.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7332a00640 1 --2- 172.21.15.84:0/314902851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c0730e0 0x7f733c0cdc00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f733c0afa60 tx=0x7f732401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8695ac2bfe609e50 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f733aa00640 1 -- 172.21.15.84:0/314902851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73240ab680 con 0x7f733c0730e0 2024-03-07T07:31:55.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f733aa00640 1 -- 172.21.15.84:0/314902851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73240b0070 con 0x7f733c0730e0 2024-03-07T07:31:55.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f733aa00640 1 -- 172.21.15.84:0/314902851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73240aba40 con 0x7f733c0730e0 2024-03-07T07:31:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 -- 172.21.15.84:0/314902851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c0730e0 msgr2=0x7f733c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 --2- 172.21.15.84:0/314902851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c0730e0 0x7f733c0cdc00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f733c0afa60 tx=0x7f732401c460 comp rx=0 tx=0).stop 2024-03-07T07:31:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 -- 172.21.15.84:0/314902851 shutdown_connections 2024-03-07T07:31:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 --2- 172.21.15.84:0/314902851 >> v2:172.21.15.161:3300/0 conn(0x7f733c144360 0x7f733c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 --2- 172.21.15.84:0/314902851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c0730e0 0x7f733c0cdc00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 -- 172.21.15.84:0/314902851 >> 172.21.15.84:0/314902851 conn(0x7f733c0704b0 msgr2=0x7f733c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 -- 172.21.15.84:0/314902851 shutdown_connections 2024-03-07T07:31:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 -- 172.21.15.84:0/314902851 wait complete. 2024-03-07T07:31:55.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 Processor -- start 2024-03-07T07:31:55.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.198+0000 7f7342200640 1 -- start start 2024-03-07T07:31:55.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f733c0730e0 0x7f733c133070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c143dd0 0x7f733c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f733c144360 0x7f733c141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c167960 con 0x7f733c143dd0 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0cd6e0 con 0x7f733c144360 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c167ae0 con 0x7f733c0730e0 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c143dd0 0x7f733c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c143dd0 0x7f733c15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40450/0 (socket says 172.21.15.84:40450) 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 -- 172.21.15.84:0/3508851537 learned_addr learned my addr 172.21.15.84:0/3508851537 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f733b400640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f733c0730e0 0x7f733c133070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f733be00640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f733c144360 0x7f733c141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 -- 172.21.15.84:0/3508851537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f733c0730e0 msgr2=0x7f733c133070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f733c0730e0 0x7f733c133070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 -- 172.21.15.84:0/3508851537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f733c144360 msgr2=0x7f733c141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f733c144360 0x7f733c141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 -- 172.21.15.84:0/3508851537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c1408d0 con 0x7f733c143dd0 2024-03-07T07:31:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7332a00640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c143dd0 0x7f733c15a930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f73240ad040 tx=0x7f732401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7333e00640 1 -- 172.21.15.84:0/3508851537 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324004230 con 0x7f733c143dd0 2024-03-07T07:31:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7333e00640 1 -- 172.21.15.84:0/3508851537 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73240a7070 con 0x7f733c143dd0 2024-03-07T07:31:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7333e00640 1 -- 172.21.15.84:0/3508851537 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324003620 con 0x7f733c143dd0 2024-03-07T07:31:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c140bb0 con 0x7f733c143dd0 2024-03-07T07:31:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c141170 con 0x7f733c143dd0 2024-03-07T07:31:55.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c062d40 con 0x7f733c143dd0 2024-03-07T07:31:55.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7333e00640 1 -- 172.21.15.84:0/3508851537 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f73240037c0 con 0x7f733c143dd0 2024-03-07T07:31:55.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.202+0000 7f7333e00640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7318066f60 0x7f7318069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.206+0000 7f7333e00640 1 -- 172.21.15.84:0/3508851537 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f732411f930 con 0x7f733c143dd0 2024-03-07T07:31:55.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.206+0000 7f733b400640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7318066f60 0x7f7318069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.206+0000 7f733b400640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7318066f60 0x7f7318069420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f732c007fd0 tx=0x7f732c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.206+0000 7f7333e00640 1 -- 172.21.15.84:0/3508851537 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f7324016050 con 0x7f733c143dd0 2024-03-07T07:31:55.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f733c15b1f0 con 0x7f733c143dd0 2024-03-07T07:31:55.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7333e00640 1 -- 172.21.15.84:0/3508851537 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73240f03e0 con 0x7f733c143dd0 2024-03-07T07:31:55.373 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-03-07T07:31:55.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7318066f60 msgr2=0x7f7318069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7318066f60 0x7f7318069420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f732c007fd0 tx=0x7f732c009040 comp rx=0 tx=0).stop 2024-03-07T07:31:55.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c143dd0 msgr2=0x7f733c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c143dd0 0x7f733c15a930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f73240ad040 tx=0x7f732401aca0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 shutdown_connections 2024-03-07T07:31:55.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7318066f60 0x7f7318069420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f733c144360 0x7f733c141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f733c143dd0 0x7f733c15a930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 --2- 172.21.15.84:0/3508851537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f733c0730e0 0x7f733c133070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 >> 172.21.15.84:0/3508851537 conn(0x7f733c0704b0 msgr2=0x7f733c0ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:55.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 shutdown_connections 2024-03-07T07:31:55.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.374+0000 7f7342200640 1 -- 172.21.15.84:0/3508851537 wait complete. 2024-03-07T07:31:55.393 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-07T07:31:55.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:55.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-07T07:31:55.418 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:31:55.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:31:55.419 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-07T07:31:55.470 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-07T07:31:55.470 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:55.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbdf1200640 1 Processor -- start 2024-03-07T07:31:55.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbdf1200640 1 -- start start 2024-03-07T07:31:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbdf1200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbdec145a30 0x7fbdec0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbdf1200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbdec0a9540 0x7fbdec072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbdf1200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec06d780 con 0x7fbdec06d230 2024-03-07T07:31:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbdf1200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec06da60 con 0x7fbdec0a9540 2024-03-07T07:31:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbdf1200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec06dd40 con 0x7fbdec145a30 2024-03-07T07:31:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbde1400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbdec0a9540 0x7fbdec072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbde1400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbdec0a9540 0x7fbdec072f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40462/0 (socket says 172.21.15.84:40462) 2024-03-07T07:31:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbde1400640 1 -- 172.21.15.84:0/3170928013 learned_addr learned my addr 172.21.15.84:0/3170928013 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbde9e00640 1 --2- 172.21.15.84:0/3170928013 >> v2:172.21.15.161:3300/0 conn(0x7fbdec145a30 0x7fbdec0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbde1400640 1 -- 172.21.15.84:0/3170928013 >> v2:172.21.15.161:3300/0 conn(0x7fbdec145a30 msgr2=0x7fbdec0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbde1400640 1 --2- 172.21.15.84:0/3170928013 >> v2:172.21.15.161:3300/0 conn(0x7fbdec145a30 0x7fbdec0729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbde1400640 1 -- 172.21.15.84:0/3170928013 >> v1:172.21.15.161:6789/0 conn(0x7fbdec06d230 legacy=0x7fbdec0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.606+0000 7fbde1400640 1 -- 172.21.15.84:0/3170928013 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec06e020 con 0x7fbdec0a9540 2024-03-07T07:31:55.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbde1400640 1 --2- 172.21.15.84:0/3170928013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec0a9540 0x7fbdec072f10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbdec069290 tx=0x7fbdd401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24b7dda2b3cb9af server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbde9400640 1 -- 172.21.15.84:0/3170928013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40b1070 con 0x7fbdec0a9540 2024-03-07T07:31:55.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbde9400640 1 -- 172.21.15.84:0/3170928013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd40ac640 con 0x7fbdec0a9540 2024-03-07T07:31:55.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbde9400640 1 -- 172.21.15.84:0/3170928013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40aca10 con 0x7fbdec0a9540 2024-03-07T07:31:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbdf1200640 1 -- 172.21.15.84:0/3170928013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec0a9540 msgr2=0x7fbdec072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbdf1200640 1 --2- 172.21.15.84:0/3170928013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec0a9540 0x7fbdec072f10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbdec069290 tx=0x7fbdd401c400 comp rx=0 tx=0).stop 2024-03-07T07:31:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbdf1200640 1 -- 172.21.15.84:0/3170928013 shutdown_connections 2024-03-07T07:31:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbdf1200640 1 --2- 172.21.15.84:0/3170928013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec0a9540 0x7fbdec072f10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbdf1200640 1 --2- 172.21.15.84:0/3170928013 >> v2:172.21.15.161:3300/0 conn(0x7fbdec145a30 0x7fbdec0729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbdf1200640 1 -- 172.21.15.84:0/3170928013 >> 172.21.15.84:0/3170928013 conn(0x7fbdec0704b0 msgr2=0x7fbdec0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbdf1200640 1 -- 172.21.15.84:0/3170928013 shutdown_connections 2024-03-07T07:31:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.610+0000 7fbdf1200640 1 -- 172.21.15.84:0/3170928013 wait complete. 2024-03-07T07:31:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 Processor -- start 2024-03-07T07:31:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 -- start start 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec06d230 0x7fbdec15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdec145a30 0x7fbdec1330c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdec134bb0 0x7fbdec139010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec168d60 con 0x7fbdec06d230 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec168be0 con 0x7fbdec134bb0 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec168ee0 con 0x7fbdec145a30 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec06d230 0x7fbdec15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec06d230 0x7fbdec15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40466/0 (socket says 172.21.15.84:40466) 2024-03-07T07:31:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 -- 172.21.15.84:0/2276606874 learned_addr learned my addr 172.21.15.84:0/2276606874 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdea800640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdec134bb0 0x7fbdec139010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde1400640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdec145a30 0x7fbdec1330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 -- 172.21.15.84:0/2276606874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdec145a30 msgr2=0x7fbdec1330c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdec145a30 0x7fbdec1330c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 -- 172.21.15.84:0/2276606874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdec134bb0 msgr2=0x7fbdec139010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdec134bb0 0x7fbdec139010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 -- 172.21.15.84:0/2276606874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec133b10 con 0x7fbdec06d230 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde9e00640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec06d230 0x7fbdec15c020 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00efc0 tx=0x7fbddc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde2a00640 1 -- 172.21.15.84:0/2276606874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc018020 con 0x7fbdec06d230 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde2a00640 1 -- 172.21.15.84:0/2276606874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc014480 con 0x7fbdec06d230 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec133df0 con 0x7fbdec06d230 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbde2a00640 1 -- 172.21.15.84:0/2276606874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc014850 con 0x7fbdec06d230 2024-03-07T07:31:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.614+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec1343b0 con 0x7fbdec06d230 2024-03-07T07:31:55.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.618+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec062d40 con 0x7fbdec06d230 2024-03-07T07:31:55.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.618+0000 7fbde2a00640 1 -- 172.21.15.84:0/2276606874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fbddc01b020 con 0x7fbdec06d230 2024-03-07T07:31:55.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.618+0000 7fbde2a00640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbdc8066f60 0x7fbdc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.618+0000 7fbde2a00640 1 -- 172.21.15.84:0/2276606874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbddc085d90 con 0x7fbdec06d230 2024-03-07T07:31:55.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.618+0000 7fbde1400640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbdc8066f60 0x7fbdc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.618+0000 7fbde1400640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbdc8066f60 0x7fbdc8069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40ae000 tx=0x7fbdd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.622+0000 7fbde2a00640 1 -- 172.21.15.84:0/2276606874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fbddc022030 con 0x7fbdec06d230 2024-03-07T07:31:55.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.806+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdec13c400 con 0x7fbdec06d230 2024-03-07T07:31:55.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.806+0000 7fbde2a00640 1 -- 172.21.15.84:0/2276606874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4974 (secure 0 0 0) 0x7fbddc010040 con 0x7fbdec06d230 2024-03-07T07:31:55.808 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:55.808 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:31:13.375093+0000","modified":"2024-03-07T07:31:16.379882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4315,"qdb_cluster":[4315]},"id":1}]} 2024-03-07T07:31:55.809 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbdc8066f60 msgr2=0x7fbdc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbdc8066f60 0x7fbdc8069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40ae000 tx=0x7fbdd4008040 comp rx=0 tx=0).stop 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec06d230 msgr2=0x7fbdec15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec06d230 0x7fbdec15c020 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00efc0 tx=0x7fbddc00c490 comp rx=0 tx=0).stop 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 shutdown_connections 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbdc8066f60 0x7fbdc8069420 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdec134bb0 0x7fbdec139010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdec145a30 0x7fbdec1330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 --2- 172.21.15.84:0/2276606874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdec06d230 0x7fbdec15c020 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 >> 172.21.15.84:0/2276606874 conn(0x7fbdec0704b0 msgr2=0x7fbdec0b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:55.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 shutdown_connections 2024-03-07T07:31:55.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.810+0000 7fbdf1200640 1 -- 172.21.15.84:0/2276606874 wait complete. 2024-03-07T07:31:55.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:55.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c8a00640 1 Processor -- start 2024-03-07T07:31:55.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c8a00640 1 -- start start 2024-03-07T07:31:55.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c8a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49c40b4400 0x7f49c40b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c8a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49c40b3140 0x7f49c415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c8a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40cda20 con 0x7f49c41553a0 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c8a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c40b3590 con 0x7f49c40b4400 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c8a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c40cdd00 con 0x7f49c40b3140 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c1400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49c40b4400 0x7f49c40b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c1400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49c40b4400 0x7f49c40b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40468/0 (socket says 172.21.15.84:40468) 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c1400640 1 -- 172.21.15.84:0/2964825737 learned_addr learned my addr 172.21.15.84:0/2964825737 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c2800640 1 --2- 172.21.15.84:0/2964825737 >> v2:172.21.15.161:3300/0 conn(0x7f49c40b3140 0x7f49c415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c1400640 1 -- 172.21.15.84:0/2964825737 >> v2:172.21.15.161:3300/0 conn(0x7f49c40b3140 msgr2=0x7f49c415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c1400640 1 --2- 172.21.15.84:0/2964825737 >> v2:172.21.15.161:3300/0 conn(0x7f49c40b3140 0x7f49c415eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c1400640 1 -- 172.21.15.84:0/2964825737 >> v1:172.21.15.161:6789/0 conn(0x7f49c41553a0 legacy=0x7f49c415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c1400640 1 -- 172.21.15.84:0/2964825737 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40cdfe0 con 0x7f49c40b4400 2024-03-07T07:31:55.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.966+0000 7f49c2800640 1 --2- 172.21.15.84:0/2964825737 >> v2:172.21.15.161:3300/0 conn(0x7f49c40b3140 0x7f49c415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:55.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c1400640 1 --2- 172.21.15.84:0/2964825737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b4400 0x7f49c40b2c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f49c4158fb0 tx=0x7f49b001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cc7c6878c6c201 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c0a00640 1 -- 172.21.15.84:0/2964825737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b00b2070 con 0x7f49c40b4400 2024-03-07T07:31:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c0a00640 1 -- 172.21.15.84:0/2964825737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b00ad480 con 0x7f49c40b4400 2024-03-07T07:31:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c0a00640 1 -- 172.21.15.84:0/2964825737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b00ad850 con 0x7f49c40b4400 2024-03-07T07:31:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 -- 172.21.15.84:0/2964825737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b4400 msgr2=0x7f49c40b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 --2- 172.21.15.84:0/2964825737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b4400 0x7f49c40b2c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f49c4158fb0 tx=0x7f49b001c490 comp rx=0 tx=0).stop 2024-03-07T07:31:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 -- 172.21.15.84:0/2964825737 shutdown_connections 2024-03-07T07:31:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 --2- 172.21.15.84:0/2964825737 >> v2:172.21.15.161:3300/0 conn(0x7f49c40b3140 0x7f49c415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 --2- 172.21.15.84:0/2964825737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b4400 0x7f49c40b2c00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 -- 172.21.15.84:0/2964825737 >> 172.21.15.84:0/2964825737 conn(0x7f49c4072ae0 msgr2=0x7f49c4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 -- 172.21.15.84:0/2964825737 shutdown_connections 2024-03-07T07:31:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 -- 172.21.15.84:0/2964825737 wait complete. 2024-03-07T07:31:55.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 Processor -- start 2024-03-07T07:31:55.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.970+0000 7f49c8a00640 1 -- start start 2024-03-07T07:31:55.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b3140 0x7f49c4153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49c40b4400 0x7f49c414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49c41553a0 0x7f49c40cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b0a00 con 0x7f49c40b3140 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b0880 con 0x7f49c41553a0 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4167d50 con 0x7f49c40b4400 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b3140 0x7f49c4153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b3140 0x7f49c4153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40478/0 (socket says 172.21.15.84:40478) 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 -- 172.21.15.84:0/4276060604 learned_addr learned my addr 172.21.15.84:0/4276060604 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1400640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49c40b4400 0x7f49c414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c2800640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49c41553a0 0x7f49c40cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 -- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49c40b4400 msgr2=0x7f49c414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49c40b4400 0x7f49c414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 -- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49c41553a0 msgr2=0x7f49c40cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49c41553a0 0x7f49c40cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 -- 172.21.15.84:0/4276060604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40cff60 con 0x7f49c40b3140 2024-03-07T07:31:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c2800640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49c41553a0 0x7f49c40cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c1e00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b3140 0x7f49c4153e30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49b400c420 tx=0x7f49b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49ba000640 1 -- 172.21.15.84:0/4276060604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40052d0 con 0x7f49c40b3140 2024-03-07T07:31:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49ba000640 1 -- 172.21.15.84:0/4276060604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4005470 con 0x7f49c40b3140 2024-03-07T07:31:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49ba000640 1 -- 172.21.15.84:0/4276060604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4007260 con 0x7f49c40b3140 2024-03-07T07:31:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c4152d90 con 0x7f49c40b3140 2024-03-07T07:31:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c4153350 con 0x7f49c40b3140 2024-03-07T07:31:55.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.974+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4062d40 con 0x7f49c40b3140 2024-03-07T07:31:55.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.978+0000 7f49ba000640 1 -- 172.21.15.84:0/4276060604 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f49b4007400 con 0x7f49c40b3140 2024-03-07T07:31:55.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.978+0000 7f49ba000640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f49a4066f60 0x7f49a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:55.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.978+0000 7f49ba000640 1 -- 172.21.15.84:0/4276060604 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f49b4084540 con 0x7f49c40b3140 2024-03-07T07:31:55.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.978+0000 7f49c1400640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f49a4066f60 0x7f49a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:55.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.978+0000 7f49c1400640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f49a4066f60 0x7f49a4069420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f49b00af000 tx=0x7f49b00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:55.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:55.982+0000 7f49ba000640 1 -- 172.21.15.84:0/4276060604 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f49b4054e40 con 0x7f49c40b3140 2024-03-07T07:31:56.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c40b58d0 con 0x7f49c40b3140 2024-03-07T07:31:56.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49ba000640 1 -- 172.21.15.84:0/4276060604 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16622 (secure 0 0 0) 0x7f49b4058ee0 con 0x7f49c40b3140 2024-03-07T07:31:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:56.138 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:54.477764+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:56.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f49a4066f60 msgr2=0x7f49a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f49a4066f60 0x7f49a4069420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f49b00af000 tx=0x7f49b00a7000 comp rx=0 tx=0).stop 2024-03-07T07:31:56.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b3140 msgr2=0x7f49c4153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b3140 0x7f49c4153e30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49b400c420 tx=0x7f49b400c8e0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 shutdown_connections 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f49a4066f60 0x7f49a4069420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49c41553a0 0x7f49c40cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49c40b4400 0x7f49c414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 --2- 172.21.15.84:0/4276060604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b3140 0x7f49c4153e30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.138+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 >> 172.21.15.84:0/4276060604 conn(0x7f49c4072ae0 msgr2=0x7f49c4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.142+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 shutdown_connections 2024-03-07T07:31:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.142+0000 7f49c8a00640 1 -- 172.21.15.84:0/4276060604 wait complete. 2024-03-07T07:31:56.160 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:31:11.035500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:31:12.364058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:31:56.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:31:56.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe888200640 1 Processor -- start 2024-03-07T07:31:56.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe888200640 1 -- start start 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe888200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe8801442a0 0x7fe8800b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe888200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 0x7fe88006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe888200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800b51f0 con 0x7fe8800b3350 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe888200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88006eec0 con 0x7fe8801442a0 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe888200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88006f1a0 con 0x7fe8800b3ec0 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe884e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8800b3350 0x7fe8800b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40846/0 (socket says 172.21.15.84:40846) 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe884e00640 1 -- 172.21.15.84:0/1557917641 learned_addr learned my addr 172.21.15.84:0/1557917641 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe885800640 1 --2- 172.21.15.84:0/1557917641 >> v2:172.21.15.161:3300/0 conn(0x7fe8801442a0 0x7fe8800b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe886200640 1 --2- 172.21.15.84:0/1557917641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 0x7fe88006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe87fe00640 1 -- 172.21.15.84:0/1557917641 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912513035 0 0) 0x7fe8800b51f0 con 0x7fe8800b3350 2024-03-07T07:31:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe87fe00640 1 -- 172.21.15.84:0/1557917641 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe868003530 con 0x7fe8800b3350 2024-03-07T07:31:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe885800640 1 -- 172.21.15.84:0/1557917641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 msgr2=0x7fe88006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe885800640 1 --2- 172.21.15.84:0/1557917641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 0x7fe88006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe885800640 1 -- 172.21.15.84:0/1557917641 >> v1:172.21.15.84:6789/0 conn(0x7fe8800b3350 legacy=0x7fe8800b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.298+0000 7fe885800640 1 -- 172.21.15.84:0/1557917641 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800cc800 con 0x7fe8801442a0 2024-03-07T07:31:56.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe885800640 1 --2- 172.21.15.84:0/1557917641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 0x7fe8800b4cb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe874009d90 tx=0x7fe87401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59be41764c7ff268 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe87fe00640 1 -- 172.21.15.84:0/1557917641 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740b2070 con 0x7fe8801442a0 2024-03-07T07:31:56.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe87fe00640 1 -- 172.21.15.84:0/1557917641 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8740a5950 con 0x7fe8801442a0 2024-03-07T07:31:56.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe87fe00640 1 -- 172.21.15.84:0/1557917641 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740a5d20 con 0x7fe8801442a0 2024-03-07T07:31:56.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe888200640 1 -- 172.21.15.84:0/1557917641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 msgr2=0x7fe8800b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe888200640 1 --2- 172.21.15.84:0/1557917641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 0x7fe8800b4cb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe874009d90 tx=0x7fe87401c970 comp rx=0 tx=0).stop 2024-03-07T07:31:56.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe888200640 1 -- 172.21.15.84:0/1557917641 shutdown_connections 2024-03-07T07:31:56.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe888200640 1 --2- 172.21.15.84:0/1557917641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 0x7fe88006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe888200640 1 --2- 172.21.15.84:0/1557917641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 0x7fe8800b4cb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe888200640 1 -- 172.21.15.84:0/1557917641 >> 172.21.15.84:0/1557917641 conn(0x7fe8800b1c50 msgr2=0x7fe8800b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:56.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe888200640 1 -- 172.21.15.84:0/1557917641 shutdown_connections 2024-03-07T07:31:56.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.302+0000 7fe888200640 1 -- 172.21.15.84:0/1557917641 wait complete. 2024-03-07T07:31:56.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 Processor -- start 2024-03-07T07:31:56.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 -- start start 2024-03-07T07:31:56.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8800b3350 0x7fe8800acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 0x7fe88013b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 0x7fe8800aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88006eb10 con 0x7fe8800b3350 2024-03-07T07:31:56.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88006e990 con 0x7fe8801442a0 2024-03-07T07:31:56.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8801679d0 con 0x7fe8800b3ec0 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8800b3350 0x7fe8800acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8800b3350 0x7fe8800acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40494/0 (socket says 172.21.15.84:40494) 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 -- 172.21.15.84:0/1700579107 learned_addr learned my addr 172.21.15.84:0/1700579107 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe884e00640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 0x7fe88013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe886200640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 0x7fe8800aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 -- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 msgr2=0x7fe88013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 0x7fe88013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 -- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 msgr2=0x7fe8800aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 0x7fe8800aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 -- 172.21.15.84:0/1700579107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88013bba0 con 0x7fe8800b3350 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe886200640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 0x7fe8800aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe885800640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8800b3350 0x7fe8800acaa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe87401a5a0 tx=0x7fe874019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe87d600640 1 -- 172.21.15.84:0/1700579107 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740b2040 con 0x7fe8800b3350 2024-03-07T07:31:56.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe87d600640 1 -- 172.21.15.84:0/1700579107 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8740bf070 con 0x7fe8800b3350 2024-03-07T07:31:56.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe87d600640 1 -- 172.21.15.84:0/1700579107 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740b8870 con 0x7fe8800b3350 2024-03-07T07:31:56.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8800aba00 con 0x7fe8800b3350 2024-03-07T07:31:56.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.306+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8800abfc0 con 0x7fe8800b3350 2024-03-07T07:31:56.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.310+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe880062d40 con 0x7fe8800b3350 2024-03-07T07:31:56.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.310+0000 7fe87d600640 1 -- 172.21.15.84:0/1700579107 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe8740a57d0 con 0x7fe8800b3350 2024-03-07T07:31:56.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.310+0000 7fe87d600640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe860066f90 0x7fe860069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.310+0000 7fe87d600640 1 -- 172.21.15.84:0/1700579107 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe87411fcc0 con 0x7fe8800b3350 2024-03-07T07:31:56.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.310+0000 7fe884e00640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe860066f90 0x7fe860069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.310+0000 7fe884e00640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe860066f90 0x7fe860069450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe86c007fd0 tx=0x7fe86c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.314+0000 7fe87d600640 1 -- 172.21.15.84:0/1700579107 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe874126080 con 0x7fe8800b3350 2024-03-07T07:31:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.470+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe880071c80 con 0x7fe8800b3350 2024-03-07T07:31:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.470+0000 7fe87d600640 1 -- 172.21.15.84:0/1700579107 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8740c8020 con 0x7fe8800b3350 2024-03-07T07:31:56.471 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:31:56.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.470+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe860066f90 msgr2=0x7fe860069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.470+0000 7fe888200640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe860066f90 0x7fe860069450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe86c007fd0 tx=0x7fe86c009040 comp rx=0 tx=0).stop 2024-03-07T07:31:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8800b3350 msgr2=0x7fe8800acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8800b3350 0x7fe8800acaa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe87401a5a0 tx=0x7fe874019710 comp rx=0 tx=0).stop 2024-03-07T07:31:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 shutdown_connections 2024-03-07T07:31:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe860066f90 0x7fe860069450 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8801442a0 0x7fe8800aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8800b3ec0 0x7fe88013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 --2- 172.21.15.84:0/1700579107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8800b3350 0x7fe8800acaa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 >> 172.21.15.84:0/1700579107 conn(0x7fe8800b1c50 msgr2=0x7fe8800cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 shutdown_connections 2024-03-07T07:31:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.474+0000 7fe888200640 1 -- 172.21.15.84:0/1700579107 wait complete. 2024-03-07T07:31:56.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:31:56.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc23fc00640 1 Processor -- start 2024-03-07T07:31:56.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc23fc00640 1 -- start start 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc23fc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce780 0x7fc23806d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc23fc00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23815cda0 con 0x7fc23815be20 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc23fc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2380ceef0 con 0x7fc23815c200 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc23fc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23815d2e0 con 0x7fc2380ce780 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc23d200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc23815be20 0x7fc2380d27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40860/0 (socket says 172.21.15.84:40860) 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc23d200640 1 -- 172.21.15.84:0/1397308540 learned_addr learned my addr 172.21.15.84:0/1397308540 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc237e00640 1 --2- 172.21.15.84:0/1397308540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce780 0x7fc23806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc237400640 1 -- 172.21.15.84:0/1397308540 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494244633 0 0) 0x7fc23815cda0 con 0x7fc23815be20 2024-03-07T07:31:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc237400640 1 -- 172.21.15.84:0/1397308540 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc21c003530 con 0x7fc23815be20 2024-03-07T07:31:56.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc237e00640 1 -- 172.21.15.84:0/1397308540 >> v1:172.21.15.161:6789/0 conn(0x7fc23815c200 legacy=0x7fc23815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:56.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc237e00640 1 -- 172.21.15.84:0/1397308540 >> v1:172.21.15.84:6789/0 conn(0x7fc23815be20 legacy=0x7fc2380d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.630+0000 7fc237e00640 1 -- 172.21.15.84:0/1397308540 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380cec10 con 0x7fc2380ce780 2024-03-07T07:31:56.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc237e00640 1 --2- 172.21.15.84:0/1397308540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce780 0x7fc23806d670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097f0 tx=0x7fc22001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff39ce045b28c69 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc237400640 1 -- 172.21.15.84:0/1397308540 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200a7070 con 0x7fc2380ce780 2024-03-07T07:31:56.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc237400640 1 -- 172.21.15.84:0/1397308540 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2200b0070 con 0x7fc2380ce780 2024-03-07T07:31:56.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc237400640 1 -- 172.21.15.84:0/1397308540 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200ab890 con 0x7fc2380ce780 2024-03-07T07:31:56.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc23fc00640 1 -- 172.21.15.84:0/1397308540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce780 msgr2=0x7fc23806d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc23fc00640 1 --2- 172.21.15.84:0/1397308540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce780 0x7fc23806d670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097f0 tx=0x7fc22001c470 comp rx=0 tx=0).stop 2024-03-07T07:31:56.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc23fc00640 1 -- 172.21.15.84:0/1397308540 shutdown_connections 2024-03-07T07:31:56.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc23fc00640 1 --2- 172.21.15.84:0/1397308540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce780 0x7fc23806d670 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc23fc00640 1 -- 172.21.15.84:0/1397308540 >> 172.21.15.84:0/1397308540 conn(0x7fc2380b3aa0 msgr2=0x7fc2380b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:56.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc23fc00640 1 -- 172.21.15.84:0/1397308540 shutdown_connections 2024-03-07T07:31:56.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.634+0000 7fc23fc00640 1 -- 172.21.15.84:0/1397308540 wait complete. 2024-03-07T07:31:56.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 Processor -- start 2024-03-07T07:31:56.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 -- start start 2024-03-07T07:31:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23815be20 0x7fc23814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c200 0x7fc238148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc238148940 0x7fc23814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380d0b80 con 0x7fc238148940 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23806dbb0 con 0x7fc23815c200 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380d0d00 con 0x7fc23815be20 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc238148940 0x7fc23814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23815be20 0x7fc23814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc237e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c200 0x7fc238148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23815be20 0x7fc23814a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:43682/0 (socket says 172.21.15.84:43682) 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23d200640 1 -- 172.21.15.84:0/2659640548 learned_addr learned my addr 172.21.15.84:0/2659640548 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:56.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23dc00640 1 -- 172.21.15.84:0/2659640548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23815be20 msgr2=0x7fc23814a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23dc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23815be20 0x7fc23814a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23dc00640 1 -- 172.21.15.84:0/2659640548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c200 msgr2=0x7fc238148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23dc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c200 0x7fc238148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23dc00640 1 -- 172.21.15.84:0/2659640548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc238149710 con 0x7fc238148940 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23dc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc238148940 0x7fc23814a920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc23000b3e0 tx=0x7fc23000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc234c00640 1 -- 172.21.15.84:0/2659640548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230015020 con 0x7fc238148940 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc234c00640 1 -- 172.21.15.84:0/2659640548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230011830 con 0x7fc238148940 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc234c00640 1 -- 172.21.15.84:0/2659640548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230011c60 con 0x7fc238148940 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23814b170 con 0x7fc238148940 2024-03-07T07:31:56.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.638+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc238149c90 con 0x7fc238148940 2024-03-07T07:31:56.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.642+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc238062d40 con 0x7fc238148940 2024-03-07T07:31:56.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.642+0000 7fc234c00640 1 -- 172.21.15.84:0/2659640548 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc230018020 con 0x7fc238148940 2024-03-07T07:31:56.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.642+0000 7fc234c00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc214066f60 0x7fc214069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.642+0000 7fc234c00640 1 -- 172.21.15.84:0/2659640548 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc230084a30 con 0x7fc238148940 2024-03-07T07:31:56.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.642+0000 7fc23d200640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc214066f60 0x7fc214069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.642+0000 7fc23d200640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc214066f60 0x7fc214069420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc228005c10 tx=0x7fc228009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.646+0000 7fc234c00640 1 -- 172.21.15.84:0/2659640548 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc23001f030 con 0x7fc238148940 2024-03-07T07:31:56.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2380b2fa0 con 0x7fc238148940 2024-03-07T07:31:56.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc234c00640 1 -- 172.21.15.84:0/2659640548 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc230055330 con 0x7fc238148940 2024-03-07T07:31:56.802 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc214066f60 msgr2=0x7fc214069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc214066f60 0x7fc214069420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc228005c10 tx=0x7fc228009040 comp rx=0 tx=0).stop 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc238148940 msgr2=0x7fc23814a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc238148940 0x7fc23814a920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc23000b3e0 tx=0x7fc23000b8a0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 shutdown_connections 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc214066f60 0x7fc214069420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc238148940 0x7fc23814a920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c200 0x7fc238148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 --2- 172.21.15.84:0/2659640548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23815be20 0x7fc23814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 >> 172.21.15.84:0/2659640548 conn(0x7fc2380b3aa0 msgr2=0x7fc238074340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 shutdown_connections 2024-03-07T07:31:56.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.802+0000 7fc23fc00640 1 -- 172.21.15.84:0/2659640548 wait complete. 2024-03-07T07:31:56.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:31:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc7800640 1 Processor -- start 2024-03-07T07:31:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc7800640 1 -- start start 2024-03-07T07:31:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc7800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcbc0145090 0x7fcbc00cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc7800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00b4a60 con 0x7fcbc015c3d0 2024-03-07T07:31:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc7800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00b4d40 con 0x7fcbc00cdb20 2024-03-07T07:31:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc7800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00719c0 con 0x7fcbc0145090 2024-03-07T07:31:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbbfe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcbc015c3d0 0x7fcbc00cd410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40864/0 (socket says 172.21.15.84:40864) 2024-03-07T07:31:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbbfe00640 1 -- 172.21.15.84:0/925456477 learned_addr learned my addr 172.21.15.84:0/925456477 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:56.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc4e00640 1 --2- 172.21.15.84:0/925456477 >> v2:172.21.15.161:3300/0 conn(0x7fcbc0145090 0x7fcbc00cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbbf400640 1 -- 172.21.15.84:0/925456477 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818946769 0 0) 0x7fcbc00b4a60 con 0x7fcbc015c3d0 2024-03-07T07:31:56.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbbf400640 1 -- 172.21.15.84:0/925456477 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba4003530 con 0x7fcbc015c3d0 2024-03-07T07:31:56.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbbf400640 1 -- 172.21.15.84:0/925456477 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253715714 0 0) 0x7fcbc00b4d40 con 0x7fcbc00cdb20 2024-03-07T07:31:56.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbbf400640 1 -- 172.21.15.84:0/925456477 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc00b4a60 con 0x7fcbc00cdb20 2024-03-07T07:31:56.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc4e00640 1 -- 172.21.15.84:0/925456477 >> v1:172.21.15.161:6789/0 conn(0x7fcbc00cdb20 legacy=0x7fcbc00724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc4e00640 1 -- 172.21.15.84:0/925456477 >> v1:172.21.15.84:6789/0 conn(0x7fcbc015c3d0 legacy=0x7fcbc00cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbbf400640 1 -- 172.21.15.84:0/925456477 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4014366196 0 0) 0x7fcba4003530 con 0x7fcbc015c3d0 2024-03-07T07:31:56.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.962+0000 7fcbc4e00640 1 -- 172.21.15.84:0/925456477 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0071ca0 con 0x7fcbc0145090 2024-03-07T07:31:56.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbc4e00640 1 --2- 172.21.15.84:0/925456477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc0145090 0x7fcbc00cf540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009d90 tx=0x7fcbb001c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c206d06992a2578 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbbf400640 1 -- 172.21.15.84:0/925456477 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00b2070 con 0x7fcbc0145090 2024-03-07T07:31:56.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbbf400640 1 -- 172.21.15.84:0/925456477 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb00a55f0 con 0x7fcbc0145090 2024-03-07T07:31:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbbf400640 1 -- 172.21.15.84:0/925456477 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac001680 con 0x7fcbc0145090 2024-03-07T07:31:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbc7800640 1 -- 172.21.15.84:0/925456477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc0145090 msgr2=0x7fcbc00cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbc7800640 1 --2- 172.21.15.84:0/925456477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc0145090 0x7fcbc00cf540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009d90 tx=0x7fcbb001c7d0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbc7800640 1 -- 172.21.15.84:0/925456477 shutdown_connections 2024-03-07T07:31:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbc7800640 1 --2- 172.21.15.84:0/925456477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc0145090 0x7fcbc00cf540 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbc7800640 1 -- 172.21.15.84:0/925456477 >> 172.21.15.84:0/925456477 conn(0x7fcbc00b1c50 msgr2=0x7fcbc00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbc7800640 1 -- 172.21.15.84:0/925456477 shutdown_connections 2024-03-07T07:31:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.966+0000 7fcbc7800640 1 -- 172.21.15.84:0/925456477 wait complete. 2024-03-07T07:31:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 Processor -- start 2024-03-07T07:31:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 -- start start 2024-03-07T07:31:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc00cdb20 0x7fcbc01438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0145090 0x7fcbc013f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbc015c3d0 0x7fcbc0142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0145830 con 0x7fcbc0145090 2024-03-07T07:31:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00b4710 con 0x7fcbc00cdb20 2024-03-07T07:31:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc01459b0 con 0x7fcbc015c3d0 2024-03-07T07:31:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0145090 0x7fcbc013f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc4e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc00cdb20 0x7fcbc01438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0145090 0x7fcbc013f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40512/0 (socket says 172.21.15.84:40512) 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 -- 172.21.15.84:0/363798366 learned_addr learned my addr 172.21.15.84:0/363798366 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc5800640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbc015c3d0 0x7fcbc0142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 -- 172.21.15.84:0/363798366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbc015c3d0 msgr2=0x7fcbc0142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbc015c3d0 0x7fcbc0142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 -- 172.21.15.84:0/363798366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc00cdb20 msgr2=0x7fcbc01438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc00cdb20 0x7fcbc01438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 -- 172.21.15.84:0/363798366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc013f990 con 0x7fcbc0145090 2024-03-07T07:31:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbfe00640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0145090 0x7fcbc013f450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00c780 tx=0x7fcbac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbcc00640 1 -- 172.21.15.84:0/363798366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac017070 con 0x7fcbc0145090 2024-03-07T07:31:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbcc00640 1 -- 172.21.15.84:0/363798366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac005cf0 con 0x7fcbc0145090 2024-03-07T07:31:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc0161640 con 0x7fcbc0145090 2024-03-07T07:31:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbbcc00640 1 -- 172.21.15.84:0/363798366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0072b0 con 0x7fcbc0145090 2024-03-07T07:31:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc0142a10 con 0x7fcbc0145090 2024-03-07T07:31:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.970+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc0062d40 con 0x7fcbc0145090 2024-03-07T07:31:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.974+0000 7fcbbcc00640 1 -- 172.21.15.84:0/363798366 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fcbac01a070 con 0x7fcbc0145090 2024-03-07T07:31:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.974+0000 7fcbbcc00640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcba0066f60 0x7fcba0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.974+0000 7fcbbcc00640 1 -- 172.21.15.84:0/363798366 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcbac084560 con 0x7fcbc0145090 2024-03-07T07:31:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.974+0000 7fcbc4e00640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcba0066f60 0x7fcba0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.974+0000 7fcbc4e00640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcba0066f60 0x7fcba0069420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00af000 tx=0x7fcbb00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:56.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:56.978+0000 7fcbbcc00640 1 -- 172.21.15.84:0/363798366 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fcbc013f990 con 0x7fcbc0145090 2024-03-07T07:31:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.130+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbc0072820 con 0x7fcbc0145090 2024-03-07T07:31:57.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.130+0000 7fcbbcc00640 1 -- 172.21.15.84:0/363798366 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbac059e20 con 0x7fcbc0145090 2024-03-07T07:31:57.132 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcba0066f60 msgr2=0x7fcba0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcba0066f60 0x7fcba0069420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00af000 tx=0x7fcbb00a7070 comp rx=0 tx=0).stop 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0145090 msgr2=0x7fcbc013f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0145090 0x7fcbc013f450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00c780 tx=0x7fcbac00cc40 comp rx=0 tx=0).stop 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 shutdown_connections 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcba0066f60 0x7fcba0069420 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbc015c3d0 0x7fcbc0142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0145090 0x7fcbc013f450 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 --2- 172.21.15.84:0/363798366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbc00cdb20 0x7fcbc01438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 >> 172.21.15.84:0/363798366 conn(0x7fcbc00b1c50 msgr2=0x7fcbc00ae4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 shutdown_connections 2024-03-07T07:31:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.134+0000 7fcbc7800640 1 -- 172.21.15.84:0/363798366 wait complete. 2024-03-07T07:31:57.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.286+0000 7fa663400640 1 Processor -- start 2024-03-07T07:31:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.286+0000 7fa663400640 1 -- start start 2024-03-07T07:31:57.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa663400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa663400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c06d780 con 0x7fa65c0a9540 2024-03-07T07:31:57.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa663400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c06da60 con 0x7fa65c145a30 2024-03-07T07:31:57.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa663400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c06dd40 con 0x7fa65c0730e0 2024-03-07T07:31:57.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa653e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa65c0a9540 0x7fa65c15c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40870/0 (socket says 172.21.15.84:40870) 2024-03-07T07:31:57.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa653e00640 1 -- 172.21.15.84:0/1380605503 learned_addr learned my addr 172.21.15.84:0/1380605503 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:57.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa660a00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa65c145a30 0x7fa65c0729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:54106/0 (socket says 172.21.15.84:54106) 2024-03-07T07:31:57.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa661400640 1 --2- 172.21.15.84:0/1380605503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa65be00640 1 -- 172.21.15.84:0/1380605503 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975431408 0 0) 0x7fa65c06da60 con 0x7fa65c145a30 2024-03-07T07:31:57.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa65be00640 1 -- 172.21.15.84:0/1380605503 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa640003530 con 0x7fa65c145a30 2024-03-07T07:31:57.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa65be00640 1 -- 172.21.15.84:0/1380605503 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291623388 0 0) 0x7fa65c06d780 con 0x7fa65c0a9540 2024-03-07T07:31:57.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa65be00640 1 -- 172.21.15.84:0/1380605503 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65c06da60 con 0x7fa65c0a9540 2024-03-07T07:31:57.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa661400640 1 -- 172.21.15.84:0/1380605503 >> v1:172.21.15.161:6789/0 conn(0x7fa65c145a30 legacy=0x7fa65c0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa661400640 1 -- 172.21.15.84:0/1380605503 >> v1:172.21.15.84:6789/0 conn(0x7fa65c0a9540 legacy=0x7fa65c15c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.290+0000 7fa661400640 1 -- 172.21.15.84:0/1380605503 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c06e020 con 0x7fa65c0730e0 2024-03-07T07:31:57.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa661400640 1 --2- 172.21.15.84:0/1380605503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c15cef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa654009dc0 tx=0x7fa65c15dc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55693aad89735e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa65be00640 1 -- 172.21.15.84:0/1380605503 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540b2070 con 0x7fa65c0730e0 2024-03-07T07:31:57.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa65be00640 1 -- 172.21.15.84:0/1380605503 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6540a5840 con 0x7fa65c0730e0 2024-03-07T07:31:57.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa65be00640 1 -- 172.21.15.84:0/1380605503 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540a5c10 con 0x7fa65c0730e0 2024-03-07T07:31:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- 172.21.15.84:0/1380605503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 msgr2=0x7fa65c15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 --2- 172.21.15.84:0/1380605503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c15cef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa654009dc0 tx=0x7fa65c15dc40 comp rx=0 tx=0).stop 2024-03-07T07:31:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- 172.21.15.84:0/1380605503 shutdown_connections 2024-03-07T07:31:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 --2- 172.21.15.84:0/1380605503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c15cef0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- 172.21.15.84:0/1380605503 >> 172.21.15.84:0/1380605503 conn(0x7fa65c0704b0 msgr2=0x7fa65c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- 172.21.15.84:0/1380605503 shutdown_connections 2024-03-07T07:31:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- 172.21.15.84:0/1380605503 wait complete. 2024-03-07T07:31:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 Processor -- start 2024-03-07T07:31:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- start start 2024-03-07T07:31:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c13f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65c145a30 0x7fa65c0acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa65c0ad120 0x7fa65c0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c169d70 con 0x7fa65c145a30 2024-03-07T07:31:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c169bf0 con 0x7fa65c0ad120 2024-03-07T07:31:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.294+0000 7fa663400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c169ef0 con 0x7fa65c0730e0 2024-03-07T07:31:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65c145a30 0x7fa65c0acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65c145a30 0x7fa65c0acbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40522/0 (socket says 172.21.15.84:40522) 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 -- 172.21.15.84:0/3758042441 learned_addr learned my addr 172.21.15.84:0/3758042441 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa660a00640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c13f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa661400640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa65c0ad120 0x7fa65c0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 -- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 msgr2=0x7fa65c13f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c13f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 -- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa65c0ad120 msgr2=0x7fa65c0c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa65c0ad120 0x7fa65c0c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 -- 172.21.15.84:0/3758042441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0ad8f0 con 0x7fa65c145a30 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa661400640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa65c0ad120 0x7fa65c0c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa653e00640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65c145a30 0x7fa65c0acbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c450 tx=0x7fa64400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa659600640 1 -- 172.21.15.84:0/3758042441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644017070 con 0x7fa65c145a30 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa659600640 1 -- 172.21.15.84:0/3758042441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa644005cf0 con 0x7fa65c145a30 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa659600640 1 -- 172.21.15.84:0/3758042441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440072f0 con 0x7fa65c145a30 2024-03-07T07:31:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c0adbd0 con 0x7fa65c145a30 2024-03-07T07:31:57.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c0ae190 con 0x7fa65c145a30 2024-03-07T07:31:57.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c062d40 con 0x7fa65c145a30 2024-03-07T07:31:57.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.298+0000 7fa659600640 1 -- 172.21.15.84:0/3758042441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa64401a070 con 0x7fa65c145a30 2024-03-07T07:31:57.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.302+0000 7fa659600640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa638066f90 0x7fa638069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.302+0000 7fa659600640 1 -- 172.21.15.84:0/3758042441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa6440843e0 con 0x7fa65c145a30 2024-03-07T07:31:57.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.302+0000 7fa660a00640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa638066f90 0x7fa638069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.302+0000 7fa660a00640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa638066f90 0x7fa638069450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa64c007fd0 tx=0x7fa64c007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.306+0000 7fa659600640 1 -- 172.21.15.84:0/3758042441 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa644054ce0 con 0x7fa65c145a30 2024-03-07T07:31:57.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.490+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa65c144f10 con 0x7fa65c145a30 2024-03-07T07:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa659600640 1 -- 172.21.15.84:0/3758042441 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4974 (secure 0 0 0) 0x7fa644058d80 con 0x7fa65c145a30 2024-03-07T07:31:57.493 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:57.493 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:31:13.375093+0000","modified":"2024-03-07T07:31:16.379882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4315,"qdb_cluster":[4315]},"id":1}]} 2024-03-07T07:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-03-07T07:31:57.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa638066f90 msgr2=0x7fa638069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa638066f90 0x7fa638069450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa64c007fd0 tx=0x7fa64c007d60 comp rx=0 tx=0).stop 2024-03-07T07:31:57.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65c145a30 msgr2=0x7fa65c0acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65c145a30 0x7fa65c0acbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c450 tx=0x7fa64400c910 comp rx=0 tx=0).stop 2024-03-07T07:31:57.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 shutdown_connections 2024-03-07T07:31:57.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa638066f90 0x7fa638069450 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa65c0ad120 0x7fa65c0c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65c145a30 0x7fa65c0acbe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 --2- 172.21.15.84:0/3758042441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa65c0730e0 0x7fa65c13f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 >> 172.21.15.84:0/3758042441 conn(0x7fa65c0704b0 msgr2=0x7fa65c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:57.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 shutdown_connections 2024-03-07T07:31:57.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.494+0000 7fa663400640 1 -- 172.21.15.84:0/3758042441 wait complete. 2024-03-07T07:31:57.514 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:57.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bfe00640 1 Processor -- start 2024-03-07T07:31:57.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bfe00640 1 -- start start 2024-03-07T07:31:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bfe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80cf100 0x7ff7b80b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bfe00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b80b0290 con 0x7ff7b815c1f0 2024-03-07T07:31:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bfe00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b80b0570 con 0x7ff7b80b3a00 2024-03-07T07:31:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bfe00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b80b1d40 con 0x7ff7b80cf100 2024-03-07T07:31:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bd400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff7b815c1f0 0x7ff7b80d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40872/0 (socket says 172.21.15.84:40872) 2024-03-07T07:31:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bd400640 1 -- 172.21.15.84:0/5024420 learned_addr learned my addr 172.21.15.84:0/5024420 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:57.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bca00640 1 --2- 172.21.15.84:0/5024420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80cf100 0x7ff7b80b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7b7e00640 1 -- 172.21.15.84:0/5024420 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149605425 0 0) 0x7ff7b80b0570 con 0x7ff7b80b3a00 2024-03-07T07:31:57.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7b7e00640 1 -- 172.21.15.84:0/5024420 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a0003530 con 0x7ff7b80b3a00 2024-03-07T07:31:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7b7e00640 1 -- 172.21.15.84:0/5024420 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413987556 0 0) 0x7ff7b80b0290 con 0x7ff7b815c1f0 2024-03-07T07:31:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7b7e00640 1 -- 172.21.15.84:0/5024420 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b80b0570 con 0x7ff7b815c1f0 2024-03-07T07:31:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bca00640 1 -- 172.21.15.84:0/5024420 >> v1:172.21.15.161:6789/0 conn(0x7ff7b80b3a00 legacy=0x7ff7b80aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bca00640 1 -- 172.21.15.84:0/5024420 >> v1:172.21.15.84:6789/0 conn(0x7ff7b815c1f0 legacy=0x7ff7b80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.650+0000 7ff7bca00640 1 -- 172.21.15.84:0/5024420 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b80b0850 con 0x7ff7b80cf100 2024-03-07T07:31:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7bca00640 1 --2- 172.21.15.84:0/5024420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80cf100 0x7ff7b80b1330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40097f0 tx=0x7ff7a401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d530bfe992564db server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7b7e00640 1 -- 172.21.15.84:0/5024420 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40b2070 con 0x7ff7b80cf100 2024-03-07T07:31:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7b7e00640 1 -- 172.21.15.84:0/5024420 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a40a9070 con 0x7ff7b80cf100 2024-03-07T07:31:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7b7e00640 1 -- 172.21.15.84:0/5024420 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40ad880 con 0x7ff7b80cf100 2024-03-07T07:31:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7bfe00640 1 -- 172.21.15.84:0/5024420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80cf100 msgr2=0x7ff7b80b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7bfe00640 1 --2- 172.21.15.84:0/5024420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80cf100 0x7ff7b80b1330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40097f0 tx=0x7ff7a401c450 comp rx=0 tx=0).stop 2024-03-07T07:31:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7bfe00640 1 -- 172.21.15.84:0/5024420 shutdown_connections 2024-03-07T07:31:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7bfe00640 1 --2- 172.21.15.84:0/5024420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80cf100 0x7ff7b80b1330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7bfe00640 1 -- 172.21.15.84:0/5024420 >> 172.21.15.84:0/5024420 conn(0x7ff7b80b1ed0 msgr2=0x7ff7b80b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7bfe00640 1 -- 172.21.15.84:0/5024420 shutdown_connections 2024-03-07T07:31:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.654+0000 7ff7bfe00640 1 -- 172.21.15.84:0/5024420 wait complete. 2024-03-07T07:31:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 Processor -- start 2024-03-07T07:31:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 -- start start 2024-03-07T07:31:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80b3a00 0x7ff7b8141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7b80cf100 0x7ff7b8155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b815c1f0 0x7ff7b813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b816a080 con 0x7ff7b815c1f0 2024-03-07T07:31:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b8169f00 con 0x7ff7b80cf100 2024-03-07T07:31:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b816a200 con 0x7ff7b80b3a00 2024-03-07T07:31:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b815c1f0 0x7ff7b813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bd400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80b3a00 0x7ff7b8141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bca00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7b80cf100 0x7ff7b8155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b815c1f0 0x7ff7b813eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40538/0 (socket says 172.21.15.84:40538) 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 -- 172.21.15.84:0/2688597476 learned_addr learned my addr 172.21.15.84:0/2688597476 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 -- 172.21.15.84:0/2688597476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80b3a00 msgr2=0x7ff7b8141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80b3a00 0x7ff7b8141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 -- 172.21.15.84:0/2688597476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7b80cf100 msgr2=0x7ff7b8155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7b80cf100 0x7ff7b8155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 -- 172.21.15.84:0/2688597476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b813f450 con 0x7ff7b815c1f0 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bde00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b815c1f0 0x7ff7b813eb60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000c870 tx=0x7ff7b000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7b5600640 1 -- 172.21.15.84:0/2688597476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0003b80 con 0x7ff7b815c1f0 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7b5600640 1 -- 172.21.15.84:0/2688597476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b0003d20 con 0x7ff7b815c1f0 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b80b45f0 con 0x7ff7b815c1f0 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7b5600640 1 -- 172.21.15.84:0/2688597476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000aa30 con 0x7ff7b815c1f0 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b80b4bb0 con 0x7ff7b815c1f0 2024-03-07T07:31:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.658+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b813f620 con 0x7ff7b815c1f0 2024-03-07T07:31:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.662+0000 7ff7b5600640 1 -- 172.21.15.84:0/2688597476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7ff7b000abd0 con 0x7ff7b815c1f0 2024-03-07T07:31:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.662+0000 7ff7b5600640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff798066f60 0x7ff798069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.662+0000 7ff7b5600640 1 -- 172.21.15.84:0/2688597476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff7b0084f00 con 0x7ff7b815c1f0 2024-03-07T07:31:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.662+0000 7ff7bd400640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff798066f60 0x7ff798069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.662+0000 7ff7bd400640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff798066f60 0x7ff798069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac007fd0 tx=0x7ff7ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.666+0000 7ff7b5600640 1 -- 172.21.15.84:0/2688597476 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7ff7b0055800 con 0x7ff7b815c1f0 2024-03-07T07:31:57.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.822+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7b8062d40 con 0x7ff7b815c1f0 2024-03-07T07:31:57.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.822+0000 7ff7b5600640 1 -- 172.21.15.84:0/2688597476 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16622 (secure 0 0 0) 0x7ff7b00598a0 con 0x7ff7b815c1f0 2024-03-07T07:31:57.822 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:54.477764+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.822+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff798066f60 msgr2=0x7ff798069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.822+0000 7ff7bfe00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff798066f60 0x7ff798069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac007fd0 tx=0x7ff7ac009040 comp rx=0 tx=0).stop 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.822+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b815c1f0 msgr2=0x7ff7b813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.822+0000 7ff7bfe00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b815c1f0 0x7ff7b813eb60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000c870 tx=0x7ff7b000cd30 comp rx=0 tx=0).stop 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.826+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 shutdown_connections 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.826+0000 7ff7bfe00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff798066f60 0x7ff798069420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.826+0000 7ff7bfe00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b815c1f0 0x7ff7b813eb60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.826+0000 7ff7bfe00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7b80cf100 0x7ff7b8155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.826+0000 7ff7bfe00640 1 --2- 172.21.15.84:0/2688597476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7b80b3a00 0x7ff7b8141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.826+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 >> 172.21.15.84:0/2688597476 conn(0x7ff7b80b1ed0 msgr2=0x7ff7b8073020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.826+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 shutdown_connections 2024-03-07T07:31:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.826+0000 7ff7bfe00640 1 -- 172.21.15.84:0/2688597476 wait complete. 2024-03-07T07:31:57.845 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-07T07:31:57.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:57.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.978+0000 7f6a9dc00640 1 Processor -- start 2024-03-07T07:31:57.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.978+0000 7f6a9dc00640 1 -- start start 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a9dc00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a98145a30 0x7f6a980729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a9dc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a9806d230 0x7f6a98072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a9dc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9806d780 con 0x7f6a980a9540 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a9dc00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9806da60 con 0x7f6a98145a30 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a9dc00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9806dd40 con 0x7f6a9806d230 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a96a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a98145a30 0x7f6a980729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a96a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a98145a30 0x7f6a980729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40546/0 (socket says 172.21.15.84:40546) 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a96a00640 1 -- 172.21.15.84:0/1649121028 learned_addr learned my addr 172.21.15.84:0/1649121028 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a97400640 1 --2- 172.21.15.84:0/1649121028 >> v2:172.21.15.161:3300/0 conn(0x7f6a9806d230 0x7f6a98072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a96a00640 1 -- 172.21.15.84:0/1649121028 >> v2:172.21.15.161:3300/0 conn(0x7f6a9806d230 msgr2=0x7f6a98072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:57.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a96a00640 1 --2- 172.21.15.84:0/1649121028 >> v2:172.21.15.161:3300/0 conn(0x7f6a9806d230 0x7f6a98072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a96a00640 1 -- 172.21.15.84:0/1649121028 >> v1:172.21.15.161:6789/0 conn(0x7f6a980a9540 legacy=0x7f6a980ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.982+0000 7f6a96a00640 1 -- 172.21.15.84:0/1649121028 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9806e020 con 0x7f6a98145a30 2024-03-07T07:31:57.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a96a00640 1 --2- 172.21.15.84:0/1649121028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a98145a30 0x7f6a980729d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a98069010 tx=0x7f6a8801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae37fb6701e0df5 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a96000640 1 -- 172.21.15.84:0/1649121028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880b1070 con 0x7f6a98145a30 2024-03-07T07:31:57.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a96000640 1 -- 172.21.15.84:0/1649121028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a880ac640 con 0x7f6a98145a30 2024-03-07T07:31:57.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a96000640 1 -- 172.21.15.84:0/1649121028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880aca10 con 0x7f6a98145a30 2024-03-07T07:31:57.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 -- 172.21.15.84:0/1649121028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a98145a30 msgr2=0x7f6a980729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/1649121028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a98145a30 0x7f6a980729d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a98069010 tx=0x7f6a8801c400 comp rx=0 tx=0).stop 2024-03-07T07:31:57.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 -- 172.21.15.84:0/1649121028 shutdown_connections 2024-03-07T07:31:57.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/1649121028 >> v2:172.21.15.161:3300/0 conn(0x7f6a9806d230 0x7f6a98072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/1649121028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a98145a30 0x7f6a980729d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 -- 172.21.15.84:0/1649121028 >> 172.21.15.84:0/1649121028 conn(0x7f6a980704b0 msgr2=0x7f6a980708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:57.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 -- 172.21.15.84:0/1649121028 shutdown_connections 2024-03-07T07:31:57.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 -- 172.21.15.84:0/1649121028 wait complete. 2024-03-07T07:31:57.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 Processor -- start 2024-03-07T07:31:57.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 -- start start 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9806d230 0x7f6a9814e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a98145a30 0x7f6a9813eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.986+0000 7f6a9dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a9813f090 0x7f6a98162820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a9dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98168d60 con 0x7f6a9813f090 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a9dc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98168be0 con 0x7f6a98145a30 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a9dc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98168ee0 con 0x7f6a9806d230 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a9813f090 0x7f6a98162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a9813f090 0x7f6a98162820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40554/0 (socket says 172.21.15.84:40554) 2024-03-07T07:31:57.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a96a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9806d230 0x7f6a9814e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 -- 172.21.15.84:0/2934460341 learned_addr learned my addr 172.21.15.84:0/2934460341 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a8e000640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a98145a30 0x7f6a9813eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 -- 172.21.15.84:0/2934460341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9806d230 msgr2=0x7f6a9814e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9806d230 0x7f6a9814e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 -- 172.21.15.84:0/2934460341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a98145a30 msgr2=0x7f6a9813eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a98145a30 0x7f6a9813eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 -- 172.21.15.84:0/2934460341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9813f5d0 con 0x7f6a9813f090 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a97400640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a9813f090 0x7f6a98162820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007e60 tx=0x7f6a9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a8f400640 1 -- 172.21.15.84:0/2934460341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90014420 con 0x7f6a9813f090 2024-03-07T07:31:57.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a8f400640 1 -- 172.21.15.84:0/2934460341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a90019070 con 0x7f6a9813f090 2024-03-07T07:31:57.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9813f8b0 con 0x7f6a9813f090 2024-03-07T07:31:57.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a8f400640 1 -- 172.21.15.84:0/2934460341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90014820 con 0x7f6a9813f090 2024-03-07T07:31:57.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a98165a70 con 0x7f6a9813f090 2024-03-07T07:31:57.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a98062d40 con 0x7f6a9813f090 2024-03-07T07:31:57.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a8f400640 1 -- 172.21.15.84:0/2934460341 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f6a900149c0 con 0x7f6a9813f090 2024-03-07T07:31:57.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.990+0000 7f6a8f400640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6a74066f60 0x7f6a74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:57.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.994+0000 7f6a8f400640 1 -- 172.21.15.84:0/2934460341 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6a90085790 con 0x7f6a9813f090 2024-03-07T07:31:57.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.994+0000 7f6a96a00640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6a74066f60 0x7f6a74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:57.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.994+0000 7f6a96a00640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6a74066f60 0x7f6a74069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6a880ae000 tx=0x7f6a88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:57.994+0000 7f6a8f400640 1 -- 172.21.15.84:0/2934460341 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6a90056130 con 0x7f6a9813f090 2024-03-07T07:31:58.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a98070c10 con 0x7f6a9813f090 2024-03-07T07:31:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a8f400640 1 -- 172.21.15.84:0/2934460341 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4974 (secure 0 0 0) 0x7f6a9005a1d0 con 0x7f6a9813f090 2024-03-07T07:31:58.182 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:58.182 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:31:13.375093+0000","modified":"2024-03-07T07:31:16.379882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4315,"qdb_cluster":[4315]},"id":1}]} 2024-03-07T07:31:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6a74066f60 msgr2=0x7f6a74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6a74066f60 0x7f6a74069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6a880ae000 tx=0x7f6a88008040 comp rx=0 tx=0).stop 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a9813f090 msgr2=0x7f6a98162820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a9813f090 0x7f6a98162820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007e60 tx=0x7f6a9000e4b0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 shutdown_connections 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6a74066f60 0x7f6a74069420 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a9813f090 0x7f6a98162820 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a98145a30 0x7f6a9813eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 --2- 172.21.15.84:0/2934460341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9806d230 0x7f6a9814e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 >> 172.21.15.84:0/2934460341 conn(0x7f6a980704b0 msgr2=0x7f6a98142680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:58.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 shutdown_connections 2024-03-07T07:31:58.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.182+0000 7f6a9dc00640 1 -- 172.21.15.84:0/2934460341 wait complete. 2024-03-07T07:31:58.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:31:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.338+0000 7fced1400640 1 Processor -- start 2024-03-07T07:31:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.338+0000 7fced1400640 1 -- start start 2024-03-07T07:31:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.338+0000 7fced1400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.338+0000 7fced1400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc0cc880 con 0x7fcecc0730e0 2024-03-07T07:31:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.338+0000 7fced1400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc0ccb60 con 0x7fcecc144360 2024-03-07T07:31:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.338+0000 7fced1400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc1441b0 con 0x7fcecc143dd0 2024-03-07T07:31:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.338+0000 7fceca800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fcecb200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcecc0730e0 0x7fcecc15b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40888/0 (socket says 172.21.15.84:40888) 2024-03-07T07:31:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fcec9e00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fcecc144360 0x7fcecc0729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:54128/0 (socket says 172.21.15.84:54128) 2024-03-07T07:31:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fcecb200640 1 -- 172.21.15.84:0/660160315 learned_addr learned my addr 172.21.15.84:0/660160315 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fcec9400640 1 -- 172.21.15.84:0/660160315 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274558089 0 0) 0x7fcecc0cc880 con 0x7fcecc0730e0 2024-03-07T07:31:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fceca800640 1 -- 172.21.15.84:0/660160315 >> v1:172.21.15.161:6789/0 conn(0x7fcecc144360 legacy=0x7fcecc0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fceca800640 1 -- 172.21.15.84:0/660160315 >> v1:172.21.15.84:6789/0 conn(0x7fcecc0730e0 legacy=0x7fcecc15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fceca800640 1 -- 172.21.15.84:0/660160315 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0cce40 con 0x7fcecc143dd0 2024-03-07T07:31:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fceca800640 1 --2- 172.21.15.84:0/660160315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc0cdc00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009770 tx=0x7fcebc01c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe2b122382d446d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fcec9400640 1 -- 172.21.15.84:0/660160315 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0b0070 con 0x7fcecc143dd0 2024-03-07T07:31:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fcec9400640 1 -- 172.21.15.84:0/660160315 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc0ab600 con 0x7fcecc143dd0 2024-03-07T07:31:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.342+0000 7fcec9400640 1 -- 172.21.15.84:0/660160315 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0ab9d0 con 0x7fcecc143dd0 2024-03-07T07:31:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- 172.21.15.84:0/660160315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 msgr2=0x7fcecc0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 --2- 172.21.15.84:0/660160315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc0cdc00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009770 tx=0x7fcebc01c310 comp rx=0 tx=0).stop 2024-03-07T07:31:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- 172.21.15.84:0/660160315 shutdown_connections 2024-03-07T07:31:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 --2- 172.21.15.84:0/660160315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc0cdc00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- 172.21.15.84:0/660160315 >> 172.21.15.84:0/660160315 conn(0x7fcecc0704b0 msgr2=0x7fcecc0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- 172.21.15.84:0/660160315 shutdown_connections 2024-03-07T07:31:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- 172.21.15.84:0/660160315 wait complete. 2024-03-07T07:31:58.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 Processor -- start 2024-03-07T07:31:58.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- start start 2024-03-07T07:31:58.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcecc0730e0 0x7fcecc1f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc13dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcecc144360 0x7fcecc0ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0cd400 con 0x7fcecc144360 2024-03-07T07:31:58.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0cf050 con 0x7fcecc0730e0 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fced1400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0cd6e0 con 0x7fcecc143dd0 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcecb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcecc144360 0x7fcecc0ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcecb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcecc144360 0x7fcecc0ab840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40562/0 (socket says 172.21.15.84:40562) 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fceca800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcecc0730e0 0x7fcecc1f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcecb200640 1 -- 172.21.15.84:0/1536528273 learned_addr learned my addr 172.21.15.84:0/1536528273 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcec9e00640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc13dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcecb200640 1 -- 172.21.15.84:0/1536528273 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 msgr2=0x7fcecc13dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcecb200640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc13dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcecb200640 1 -- 172.21.15.84:0/1536528273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcecc0730e0 msgr2=0x7fcecc1f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcecb200640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcecc0730e0 0x7fcecc1f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.346+0000 7fcecb200640 1 -- 172.21.15.84:0/1536528273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc1e7c00 con 0x7fcecc144360 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fcecb200640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcecc144360 0x7fcecc0ab840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcec400c750 tx=0x7fcec400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fcec2a00640 1 -- 172.21.15.84:0/1536528273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4018070 con 0x7fcecc144360 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fcec2a00640 1 -- 172.21.15.84:0/1536528273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec400a640 con 0x7fcecc144360 2024-03-07T07:31:58.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fcec2a00640 1 -- 172.21.15.84:0/1536528273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400ce60 con 0x7fcecc144360 2024-03-07T07:31:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc1e7ee0 con 0x7fcecc144360 2024-03-07T07:31:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc1e84a0 con 0x7fcecc144360 2024-03-07T07:31:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc062d40 con 0x7fcecc144360 2024-03-07T07:31:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fcec2a00640 1 -- 172.21.15.84:0/1536528273 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fcec400aa70 con 0x7fcecc144360 2024-03-07T07:31:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fcec2a00640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcea8066f60 0x7fcea8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fcec2a00640 1 -- 172.21.15.84:0/1536528273 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcec40845e0 con 0x7fcecc144360 2024-03-07T07:31:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.350+0000 7fceca800640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcea8066f60 0x7fcea8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.354+0000 7fceca800640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcea8066f60 0x7fcea8069420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0ad000 tx=0x7fcebc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.354+0000 7fcec2a00640 1 -- 172.21.15.84:0/1536528273 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fcec4054ee0 con 0x7fcecc144360 2024-03-07T07:31:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcecc15b1f0 con 0x7fcecc144360 2024-03-07T07:31:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fcec2a00640 1 -- 172.21.15.84:0/1536528273 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4974 (secure 0 0 0) 0x7fcec4058f80 con 0x7fcecc144360 2024-03-07T07:31:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:58.547 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3100448348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3100448348},{"type":"v1","addr":"172.21.15.84:6836","nonce":3100448348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2091596813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2091596813},{"type":"v1","addr":"172.21.15.161:6835","nonce":2091596813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3304655232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3304655232},{"type":"v1","addr":"172.21.15.84:6837","nonce":3304655232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:31:13.375093+0000","modified":"2024-03-07T07:31:16.379882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/347324593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":347324593},{"type":"v1","addr":"172.21.15.161:6834","nonce":347324593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4315,"qdb_cluster":[4315]},"id":1}]} 2024-03-07T07:31:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcea8066f60 msgr2=0x7fcea8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcea8066f60 0x7fcea8069420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0ad000 tx=0x7fcebc0a6000 comp rx=0 tx=0).stop 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcecc144360 msgr2=0x7fcecc0ab840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcecc144360 0x7fcecc0ab840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcec400c750 tx=0x7fcec400cc10 comp rx=0 tx=0).stop 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 shutdown_connections 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fcea8066f60 0x7fcea8069420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcecc144360 0x7fcecc0ab840 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcecc143dd0 0x7fcecc13dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.546+0000 7fced1400640 1 --2- 172.21.15.84:0/1536528273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcecc0730e0 0x7fcecc1f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.550+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 >> 172.21.15.84:0/1536528273 conn(0x7fcecc0704b0 msgr2=0x7fcecc0aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.550+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 shutdown_connections 2024-03-07T07:31:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.550+0000 7fced1400640 1 -- 172.21.15.84:0/1536528273 wait complete. 2024-03-07T07:31:58.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:31:58.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb485e00640 1 Processor -- start 2024-03-07T07:31:58.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb485e00640 1 -- start start 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb485e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb480143dd0 0x7fb4800cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb485e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4800730e0 0x7fb48015b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb485e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800cc880 con 0x7fb480144360 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb485e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4801441b0 con 0x7fb480143dd0 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb485e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800cf050 con 0x7fb4800730e0 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb47ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb480143dd0 0x7fb4800cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb47ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb480143dd0 0x7fb4800cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:32834/0 (socket says 172.21.15.84:32834) 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb47ea00640 1 -- 172.21.15.84:0/3974744793 learned_addr learned my addr 172.21.15.84:0/3974744793 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:58.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb47f400640 1 --2- 172.21.15.84:0/3974744793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4800730e0 0x7fb48015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb47ea00640 1 -- 172.21.15.84:0/3974744793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4800730e0 msgr2=0x7fb48015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:58.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb47ea00640 1 --2- 172.21.15.84:0/3974744793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4800730e0 0x7fb48015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb47ea00640 1 -- 172.21.15.84:0/3974744793 >> v1:172.21.15.84:6789/0 conn(0x7fb480144360 legacy=0x7fb4800729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.701+0000 7fb47ea00640 1 -- 172.21.15.84:0/3974744793 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800ccb60 con 0x7fb480143dd0 2024-03-07T07:31:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb47ea00640 1 --2- 172.21.15.84:0/3974744793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480143dd0 0x7fb4800cdc00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb4700098a0 tx=0x7fb47001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87f8bfd998161863 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb47e000640 1 -- 172.21.15.84:0/3974744793 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700a95f0 con 0x7fb480143dd0 2024-03-07T07:31:58.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb47e000640 1 -- 172.21.15.84:0/3974744793 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700a9790 con 0x7fb480143dd0 2024-03-07T07:31:58.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb47e000640 1 -- 172.21.15.84:0/3974744793 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700a9b60 con 0x7fb480143dd0 2024-03-07T07:31:58.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb485e00640 1 -- 172.21.15.84:0/3974744793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480143dd0 msgr2=0x7fb4800cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb485e00640 1 --2- 172.21.15.84:0/3974744793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480143dd0 0x7fb4800cdc00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb4700098a0 tx=0x7fb47001c510 comp rx=0 tx=0).stop 2024-03-07T07:31:58.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb485e00640 1 -- 172.21.15.84:0/3974744793 shutdown_connections 2024-03-07T07:31:58.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb485e00640 1 --2- 172.21.15.84:0/3974744793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb4800730e0 0x7fb48015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb485e00640 1 --2- 172.21.15.84:0/3974744793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480143dd0 0x7fb4800cdc00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb485e00640 1 -- 172.21.15.84:0/3974744793 >> 172.21.15.84:0/3974744793 conn(0x7fb4800704b0 msgr2=0x7fb4800708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:58.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb485e00640 1 -- 172.21.15.84:0/3974744793 shutdown_connections 2024-03-07T07:31:58.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.705+0000 7fb485e00640 1 -- 172.21.15.84:0/3974744793 wait complete. 2024-03-07T07:31:58.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 Processor -- start 2024-03-07T07:31:58.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 -- start start 2024-03-07T07:31:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4800730e0 0x7fb480135620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480143dd0 0x7fb480135e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480144360 0x7fb4800ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480167960 con 0x7fb4800730e0 2024-03-07T07:31:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800cd6e0 con 0x7fb480144360 2024-03-07T07:31:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480167ae0 con 0x7fb480143dd0 2024-03-07T07:31:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4800730e0 0x7fb480135620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4800730e0 0x7fb480135620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40568/0 (socket says 172.21.15.84:40568) 2024-03-07T07:31:58.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 -- 172.21.15.84:0/3270352399 learned_addr learned my addr 172.21.15.84:0/3270352399 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:58.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb476000640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480143dd0 0x7fb480135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47f400640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480144360 0x7fb4800ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 -- 172.21.15.84:0/3270352399 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480143dd0 msgr2=0x7fb480135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480143dd0 0x7fb480135e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 -- 172.21.15.84:0/3270352399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480144360 msgr2=0x7fb4800ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480144360 0x7fb4800ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 -- 172.21.15.84:0/3270352399 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4801365c0 con 0x7fb4800730e0 2024-03-07T07:31:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb47ea00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4800730e0 0x7fb480135620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb4700ab040 tx=0x7fb47001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb477e00640 1 -- 172.21.15.84:0/3270352399 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700a95f0 con 0x7fb4800730e0 2024-03-07T07:31:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb477e00640 1 -- 172.21.15.84:0/3270352399 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700b1840 con 0x7fb4800730e0 2024-03-07T07:31:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4801368a0 con 0x7fb4800730e0 2024-03-07T07:31:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb477e00640 1 -- 172.21.15.84:0/3270352399 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700b1c30 con 0x7fb4800730e0 2024-03-07T07:31:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.709+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb480136e60 con 0x7fb4800730e0 2024-03-07T07:31:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.713+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb480062d40 con 0x7fb4800730e0 2024-03-07T07:31:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.713+0000 7fb477e00640 1 -- 172.21.15.84:0/3270352399 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb4700c53f0 con 0x7fb4800730e0 2024-03-07T07:31:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.713+0000 7fb477e00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb45c066f90 0x7fb45c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.713+0000 7fb477e00640 1 -- 172.21.15.84:0/3270352399 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb47011f760 con 0x7fb4800730e0 2024-03-07T07:31:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.713+0000 7fb476000640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb45c066f90 0x7fb45c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.713+0000 7fb476000640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb45c066f90 0x7fb45c069450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb468001770 tx=0x7fb468009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.717+0000 7fb477e00640 1 -- 172.21.15.84:0/3270352399 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb4700ad020 con 0x7fb4800730e0 2024-03-07T07:31:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb48013d1e0 con 0x7fb4800730e0 2024-03-07T07:31:58.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb477e00640 1 -- 172.21.15.84:0/3270352399 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16622 (secure 0 0 0) 0x7fb470016130 con 0x7fb4800730e0 2024-03-07T07:31:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:31:58.875 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:31:54.477764+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:31:11.035500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-07T07:31:12.364058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:31:58.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb45c066f90 msgr2=0x7fb45c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb45c066f90 0x7fb45c069450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb468001770 tx=0x7fb468009040 comp rx=0 tx=0).stop 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4800730e0 msgr2=0x7fb480135620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4800730e0 0x7fb480135620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb4700ab040 tx=0x7fb47001ad50 comp rx=0 tx=0).stop 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 shutdown_connections 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb45c066f90 0x7fb45c069450 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb480144360 0x7fb4800ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb480143dd0 0x7fb480135e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 --2- 172.21.15.84:0/3270352399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4800730e0 0x7fb480135620 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 >> 172.21.15.84:0/3270352399 conn(0x7fb4800704b0 msgr2=0x7fb480072250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 shutdown_connections 2024-03-07T07:31:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:58.873+0000 7fb485e00640 1 -- 172.21.15.84:0/3270352399 wait complete. 2024-03-07T07:31:58.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-07T07:31:59.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a7a00640 1 Processor -- start 2024-03-07T07:31:59.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a7a00640 1 -- start start 2024-03-07T07:31:59.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a7a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a015f250 0x7f66a0072d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a7a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a015f6d0 con 0x7f66a01586d0 2024-03-07T07:31:59.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a7a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a0073490 con 0x7f66a00aab90 2024-03-07T07:31:59.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a7a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0161db0 con 0x7f66a015f250 2024-03-07T07:31:59.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a5000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f66a01586d0 0x7f66a00aa480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40912/0 (socket says 172.21.15.84:40912) 2024-03-07T07:31:59.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a5000640 1 -- 172.21.15.84:0/3827915488 learned_addr learned my addr 172.21.15.84:0/3827915488 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:31:59.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a5a00640 1 --2- 172.21.15.84:0/3827915488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a015f250 0x7f66a0072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f669fe00640 1 -- 172.21.15.84:0/3827915488 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345033643 0 0) 0x7f66a015f6d0 con 0x7f66a01586d0 2024-03-07T07:31:59.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f669fe00640 1 -- 172.21.15.84:0/3827915488 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6684003530 con 0x7f66a01586d0 2024-03-07T07:31:59.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f669fe00640 1 -- 172.21.15.84:0/3827915488 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380981487 0 0) 0x7f66a0073490 con 0x7f66a00aab90 2024-03-07T07:31:59.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a5a00640 1 -- 172.21.15.84:0/3827915488 >> v1:172.21.15.161:6789/0 conn(0x7f66a00aab90 legacy=0x7f66a00704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a5a00640 1 -- 172.21.15.84:0/3827915488 >> v1:172.21.15.84:6789/0 conn(0x7f66a01586d0 legacy=0x7f66a00aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.033+0000 7f66a5a00640 1 -- 172.21.15.84:0/3827915488 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a0162090 con 0x7f66a015f250 2024-03-07T07:31:59.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a5a00640 1 --2- 172.21.15.84:0/3827915488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a015f250 0x7f66a0072d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6698009dc0 tx=0x7f669801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ab6af1a547cd65 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:59.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f669fe00640 1 -- 172.21.15.84:0/3827915488 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66980b2070 con 0x7f66a015f250 2024-03-07T07:31:59.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f669fe00640 1 -- 172.21.15.84:0/3827915488 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66980a5940 con 0x7f66a015f250 2024-03-07T07:31:59.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f669fe00640 1 -- 172.21.15.84:0/3827915488 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66980a5d10 con 0x7f66a015f250 2024-03-07T07:31:59.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a7a00640 1 -- 172.21.15.84:0/3827915488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a015f250 msgr2=0x7f66a0072d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a7a00640 1 --2- 172.21.15.84:0/3827915488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a015f250 0x7f66a0072d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6698009dc0 tx=0x7f669801c990 comp rx=0 tx=0).stop 2024-03-07T07:31:59.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a7a00640 1 -- 172.21.15.84:0/3827915488 shutdown_connections 2024-03-07T07:31:59.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a7a00640 1 --2- 172.21.15.84:0/3827915488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a015f250 0x7f66a0072d60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a7a00640 1 -- 172.21.15.84:0/3827915488 >> 172.21.15.84:0/3827915488 conn(0x7f66a0072240 msgr2=0x7f66a0072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:59.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a7a00640 1 -- 172.21.15.84:0/3827915488 shutdown_connections 2024-03-07T07:31:59.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a7a00640 1 -- 172.21.15.84:0/3827915488 wait complete. 2024-03-07T07:31:59.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.037+0000 7f66a7a00640 1 Processor -- start 2024-03-07T07:31:59.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 -- start start 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a00aab90 0x7f66a0157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66a01586d0 0x7f66a0138b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a015f250 0x7f66a0136370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0158c30 con 0x7f66a01586d0 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0158ab0 con 0x7f66a015f250 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a016c0c0 con 0x7f66a00aab90 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f6697e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66a01586d0 0x7f66a0138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a00aab90 0x7f66a0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a00aab90 0x7f66a0157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:43782/0 (socket says 172.21.15.84:43782) 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 -- 172.21.15.84:0/3437595770 learned_addr learned my addr 172.21.15.84:0/3437595770 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:59.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f6697e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66a01586d0 0x7f66a0138b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40570/0 (socket says 172.21.15.84:40570) 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5a00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a015f250 0x7f66a0136370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 -- 172.21.15.84:0/3437595770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a015f250 msgr2=0x7f66a0136370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a015f250 0x7f66a0136370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 -- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66a01586d0 msgr2=0x7f66a0138b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66a01586d0 0x7f66a0138b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 -- 172.21.15.84:0/3437595770 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a0146c50 con 0x7f66a00aab90 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a5000640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a00aab90 0x7f66a0157280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f669000c450 tx=0x7f669000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f669d600640 1 -- 172.21.15.84:0/3437595770 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690017070 con 0x7f66a00aab90 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f669d600640 1 -- 172.21.15.84:0/3437595770 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690005cf0 con 0x7f66a00aab90 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f669d600640 1 -- 172.21.15.84:0/3437595770 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690007290 con 0x7f66a00aab90 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a0146f30 con 0x7f66a00aab90 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a01474f0 con 0x7f66a00aab90 2024-03-07T07:31:59.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.041+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a0062d40 con 0x7f66a00aab90 2024-03-07T07:31:59.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.045+0000 7f669d600640 1 -- 172.21.15.84:0/3437595770 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f669001a070 con 0x7f66a00aab90 2024-03-07T07:31:59.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.045+0000 7f669d600640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f667c066f60 0x7f667c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.045+0000 7f669d600640 1 -- 172.21.15.84:0/3437595770 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6690084360 con 0x7f66a00aab90 2024-03-07T07:31:59.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.045+0000 7f6697e00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f667c066f60 0x7f667c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.045+0000 7f6697e00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f667c066f60 0x7f667c069420 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66a0138ac0 tx=0x7f6688009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:59.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.049+0000 7f669d600640 1 -- 172.21.15.84:0/3437595770 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6690054cf0 con 0x7f66a00aab90 2024-03-07T07:31:59.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.233+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f66a0067400 con 0x7f66a00aab90 2024-03-07T07:31:59.237 INFO:tasks.ceph.mon.a.smithi084.stderr:2024-03-07T07:31:59.237+0000 7f8f05a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-07T07:31:59.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.241+0000 7f669d600640 1 -- 172.21.15.84:0/3437595770 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6690058d90 con 0x7f66a00aab90 2024-03-07T07:31:59.242 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.241+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f667c066f60 msgr2=0x7f667c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.241+0000 7f66a7a00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f667c066f60 0x7f667c069420 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66a0138ac0 tx=0x7f6688009040 comp rx=0 tx=0).stop 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.241+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a00aab90 msgr2=0x7f66a0157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.241+0000 7f66a7a00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a00aab90 0x7f66a0157280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f669000c450 tx=0x7f669000c910 comp rx=0 tx=0).stop 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.241+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 shutdown_connections 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.245+0000 7f66a7a00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f667c066f60 0x7f667c069420 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.245+0000 7f66a7a00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a015f250 0x7f66a0136370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.245+0000 7f66a7a00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66a01586d0 0x7f66a0138b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.245+0000 7f66a7a00640 1 --2- 172.21.15.84:0/3437595770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a00aab90 0x7f66a0157280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.245+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 >> 172.21.15.84:0/3437595770 conn(0x7f66a0072240 msgr2=0x7f66a0160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.245+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 shutdown_connections 2024-03-07T07:31:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.245+0000 7f66a7a00640 1 -- 172.21.15.84:0/3437595770 wait complete. 2024-03-07T07:31:59.254 INFO:tasks.ceph.mds.b.smithi161.stderr: -7061> 2024-03-07T07:31:17.389+0000 7f15e1600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T07:31:59.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-07T07:31:59.302 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2024-03-07T07:31:59.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.401+0000 7f4b1b200640 1 Processor -- start 2024-03-07T07:31:59.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.401+0000 7f4b1b200640 1 -- start start 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.401+0000 7f4b1b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15bd60 0x7f4b1c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.401+0000 7f4b1b200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b1c06bcd0 0x7f4b1c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.401+0000 7f4b1b200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c15c630 con 0x7f4b1c15c140 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.401+0000 7f4b1b200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c06dd60 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.401+0000 7f4b1b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c06da80 con 0x7f4b1c15bd60 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.401+0000 7f4b19e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15bd60 0x7f4b1c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15bd60 0x7f4b1c06d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:43784/0 (socket says 172.21.15.84:43784) 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19e00640 1 -- 172.21.15.84:0/1338841334 learned_addr learned my addr 172.21.15.84:0/1338841334 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:59.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b1a800640 1 --2- 172.21.15.84:0/1338841334 >> v2:172.21.15.161:3300/0 conn(0x7f4b1c06bcd0 0x7f4b1c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b11400640 1 --1- 172.21.15.84:0/1338841334 >> v1:172.21.15.161:6789/0 conn(0x7f4b1c15c140 0x7f4b1c06b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:54136/0 (socket says 172.21.15.84:54136) 2024-03-07T07:31:59.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19e00640 1 -- 172.21.15.84:0/1338841334 >> v2:172.21.15.161:3300/0 conn(0x7f4b1c06bcd0 msgr2=0x7f4b1c0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:31:59.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19e00640 1 --2- 172.21.15.84:0/1338841334 >> v2:172.21.15.161:3300/0 conn(0x7f4b1c06bcd0 0x7f4b1c0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19e00640 1 -- 172.21.15.84:0/1338841334 >> v1:172.21.15.161:6789/0 conn(0x7f4b1c15c140 legacy=0x7f4b1c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19e00640 1 -- 172.21.15.84:0/1338841334 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c15c8d0 con 0x7f4b1c15bd60 2024-03-07T07:31:59.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19e00640 1 --2- 172.21.15.84:0/1338841334 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15bd60 0x7f4b1c06d180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009870 tx=0x7f4b0c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73112477089f2dac server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19400640 1 -- 172.21.15.84:0/1338841334 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0ab640 con 0x7f4b1c15bd60 2024-03-07T07:31:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19400640 1 -- 172.21.15.84:0/1338841334 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0b0070 con 0x7f4b1c15bd60 2024-03-07T07:31:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.405+0000 7f4b19400640 1 -- 172.21.15.84:0/1338841334 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0aba00 con 0x7f4b1c15bd60 2024-03-07T07:31:59.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- 172.21.15.84:0/1338841334 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15bd60 msgr2=0x7f4b1c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 --2- 172.21.15.84:0/1338841334 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15bd60 0x7f4b1c06d180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009870 tx=0x7f4b0c01c530 comp rx=0 tx=0).stop 2024-03-07T07:31:59.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- 172.21.15.84:0/1338841334 shutdown_connections 2024-03-07T07:31:59.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 --2- 172.21.15.84:0/1338841334 >> v2:172.21.15.161:3300/0 conn(0x7f4b1c06bcd0 0x7f4b1c0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 --2- 172.21.15.84:0/1338841334 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15bd60 0x7f4b1c06d180 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- 172.21.15.84:0/1338841334 >> 172.21.15.84:0/1338841334 conn(0x7f4b1c0b3920 msgr2=0x7f4b1c0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:31:59.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- 172.21.15.84:0/1338841334 shutdown_connections 2024-03-07T07:31:59.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- 172.21.15.84:0/1338841334 wait complete. 2024-03-07T07:31:59.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 Processor -- start 2024-03-07T07:31:59.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- start start 2024-03-07T07:31:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c06bcd0 0x7f4b1c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1c15bd60 0x7f4b1c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15c140 0x7f4b1c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c168db0 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0cf600 con 0x7f4b1c15bd60 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c168f30 con 0x7f4b1c15c140 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b19e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c06bcd0 0x7f4b1c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b19e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c06bcd0 0x7f4b1c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40572/0 (socket says 172.21.15.84:40572) 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b19e00640 1 -- 172.21.15.84:0/2075808340 learned_addr learned my addr 172.21.15.84:0/2075808340 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b11400640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1c15bd60 0x7f4b1c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b1a800640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15c140 0x7f4b1c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b19e00640 1 -- 172.21.15.84:0/2075808340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15c140 msgr2=0x7f4b1c15d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b19e00640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15c140 0x7f4b1c15d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b19e00640 1 -- 172.21.15.84:0/2075808340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1c15bd60 msgr2=0x7f4b1c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b19e00640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1c15bd60 0x7f4b1c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.409+0000 7f4b19e00640 1 -- 172.21.15.84:0/2075808340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c155f00 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b19e00640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c06bcd0 0x7f4b1c158000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0ad040 tx=0x7f4b0c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:59.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b12a00640 1 -- 172.21.15.84:0/2075808340 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0be3f0 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b12a00640 1 -- 172.21.15.84:0/2075808340 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0be5b0 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c155940 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b12a00640 1 -- 172.21.15.84:0/2075808340 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0be9a0 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c15a1c0 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c062d40 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b12a00640 1 -- 172.21.15.84:0/2075808340 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f4b0c0b43f0 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b12a00640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4af8066f60 0x7f4af8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:31:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b12a00640 1 -- 172.21.15.84:0/2075808340 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f4b0c11f540 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.413+0000 7f4b11400640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4af8066f60 0x7f4af8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:31:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.417+0000 7f4b11400640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4af8066f60 0x7f4af8069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c15b760 tx=0x7f4b04007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:31:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.417+0000 7f4b12a00640 1 -- 172.21.15.84:0/2075808340 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f4b0c0c4060 con 0x7f4b1c06bcd0 2024-03-07T07:31:59.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:31:59.609+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4b1c157de0 con 0x7f4b1c06bcd0 2024-03-07T07:32:00.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b12a00640 1 -- 172.21.15.84:0/2075808340 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4b0c016150 con 0x7f4b1c06bcd0 2024-03-07T07:32:00.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4af8066f60 msgr2=0x7f4af8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:00.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4af8066f60 0x7f4af8069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c15b760 tx=0x7f4b04007e90 comp rx=0 tx=0).stop 2024-03-07T07:32:00.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c06bcd0 msgr2=0x7f4b1c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:00.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c06bcd0 0x7f4b1c158000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0ad040 tx=0x7f4b0c01ad70 comp rx=0 tx=0).stop 2024-03-07T07:32:00.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 shutdown_connections 2024-03-07T07:32:00.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4af8066f60 0x7f4af8069420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:00.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1c15c140 0x7f4b1c15d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:00.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1c15bd60 0x7f4b1c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:00.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 --2- 172.21.15.84:0/2075808340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c06bcd0 0x7f4b1c158000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:00.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 >> 172.21.15.84:0/2075808340 conn(0x7f4b1c0b3920 msgr2=0x7f4b1c15ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:00.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 shutdown_connections 2024-03-07T07:32:00.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.241+0000 7f4b1b200640 1 -- 172.21.15.84:0/2075808340 wait complete. 2024-03-07T07:32:00.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-07T07:32:00.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.401+0000 7f2f13e00640 1 Processor -- start 2024-03-07T07:32:00.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.401+0000 7f2f13e00640 1 -- start start 2024-03-07T07:32:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f13e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2f141449d0 0x7f2f1406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f13e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f14144db0 con 0x7f2f140b66b0 2024-03-07T07:32:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f13e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f140d0300 con 0x7f2f14144fd0 2024-03-07T07:32:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f13e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1406e6d0 con 0x7f2f141449d0 2024-03-07T07:32:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f13400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2f140b66b0 0x7f2f1415c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40918/0 (socket says 172.21.15.84:40918) 2024-03-07T07:32:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f13400640 1 -- 172.21.15.84:0/2663627996 learned_addr learned my addr 172.21.15.84:0/2663627996 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f12a00640 1 --2- 172.21.15.84:0/2663627996 >> v2:172.21.15.161:3300/0 conn(0x7f2f141449d0 0x7f2f1406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f11600640 1 -- 172.21.15.84:0/2663627996 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745554917 0 0) 0x7f2f14144db0 con 0x7f2f140b66b0 2024-03-07T07:32:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f11600640 1 -- 172.21.15.84:0/2663627996 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef8003530 con 0x7f2f140b66b0 2024-03-07T07:32:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f11600640 1 -- 172.21.15.84:0/2663627996 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299273887 0 0) 0x7f2f140d0300 con 0x7f2f14144fd0 2024-03-07T07:32:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f11600640 1 -- 172.21.15.84:0/2663627996 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f14144db0 con 0x7f2f14144fd0 2024-03-07T07:32:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f12a00640 1 -- 172.21.15.84:0/2663627996 >> v1:172.21.15.161:6789/0 conn(0x7f2f14144fd0 legacy=0x7f2f140b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f12a00640 1 -- 172.21.15.84:0/2663627996 >> v1:172.21.15.84:6789/0 conn(0x7f2f140b66b0 legacy=0x7f2f1415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.405+0000 7f2f12a00640 1 -- 172.21.15.84:0/2663627996 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140d05a0 con 0x7f2f141449d0 2024-03-07T07:32:00.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f12a00640 1 --2- 172.21.15.84:0/2663627996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f141449d0 0x7f2f1406f120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097c0 tx=0x7f2f0401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=399a2cff8b987ebd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:00.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f11600640 1 -- 172.21.15.84:0/2663627996 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040b1070 con 0x7f2f141449d0 2024-03-07T07:32:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f11600640 1 -- 172.21.15.84:0/2663627996 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f040a8050 con 0x7f2f141449d0 2024-03-07T07:32:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f11600640 1 -- 172.21.15.84:0/2663627996 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040ac860 con 0x7f2f141449d0 2024-03-07T07:32:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 -- 172.21.15.84:0/2663627996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f141449d0 msgr2=0x7f2f1406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 --2- 172.21.15.84:0/2663627996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f141449d0 0x7f2f1406f120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097c0 tx=0x7f2f0401c3e0 comp rx=0 tx=0).stop 2024-03-07T07:32:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 -- 172.21.15.84:0/2663627996 shutdown_connections 2024-03-07T07:32:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 --2- 172.21.15.84:0/2663627996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f141449d0 0x7f2f1406f120 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 -- 172.21.15.84:0/2663627996 >> 172.21.15.84:0/2663627996 conn(0x7f2f14071600 msgr2=0x7f2f14071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 -- 172.21.15.84:0/2663627996 shutdown_connections 2024-03-07T07:32:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 -- 172.21.15.84:0/2663627996 wait complete. 2024-03-07T07:32:00.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 Processor -- start 2024-03-07T07:32:00.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.409+0000 7f2f13e00640 1 -- start start 2024-03-07T07:32:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f140b66b0 0x7f2f140afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f141449d0 0x7f2f1415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14144fd0 0x7f2f1415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1415ccf0 con 0x7f2f141449d0 2024-03-07T07:32:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140cecf0 con 0x7f2f14144fd0 2024-03-07T07:32:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1415ce70 con 0x7f2f140b66b0 2024-03-07T07:32:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f141449d0 0x7f2f1415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f141449d0 0x7f2f1415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40580/0 (socket says 172.21.15.84:40580) 2024-03-07T07:32:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 -- 172.21.15.84:0/3321762430 learned_addr learned my addr 172.21.15.84:0/3321762430 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12a00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f140b66b0 0x7f2f140afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13400640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14144fd0 0x7f2f1415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 -- 172.21.15.84:0/3321762430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f140b66b0 msgr2=0x7f2f140afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f140b66b0 0x7f2f140afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 -- 172.21.15.84:0/3321762430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14144fd0 msgr2=0x7f2f1415acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14144fd0 0x7f2f1415acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 -- 172.21.15.84:0/3321762430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1413e3c0 con 0x7f2f141449d0 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f12000640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f141449d0 0x7f2f1415a770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c390 tx=0x7f2f0000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f0aa00640 1 -- 172.21.15.84:0/3321762430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00017070 con 0x7f2f141449d0 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f0aa00640 1 -- 172.21.15.84:0/3321762430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f000052d0 con 0x7f2f141449d0 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f140b3380 con 0x7f2f141449d0 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f0aa00640 1 -- 172.21.15.84:0/3321762430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00003840 con 0x7f2f141449d0 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1413ec20 con 0x7f2f141449d0 2024-03-07T07:32:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.413+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1413ee20 con 0x7f2f141449d0 2024-03-07T07:32:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.417+0000 7f2f0aa00640 1 -- 172.21.15.84:0/3321762430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f2f0001a070 con 0x7f2f141449d0 2024-03-07T07:32:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.417+0000 7f2f0aa00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2ef4066f60 0x7f2ef4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.417+0000 7f2f0aa00640 1 -- 172.21.15.84:0/3321762430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f2f00084330 con 0x7f2f141449d0 2024-03-07T07:32:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.417+0000 7f2f12a00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2ef4066f60 0x7f2ef4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.417+0000 7f2f12a00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2ef4066f60 0x7f2ef4069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f040ae000 tx=0x7f2f040a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:00.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.421+0000 7f2f0aa00640 1 -- 172.21.15.84:0/3321762430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f2f1413ee20 con 0x7f2f141449d0 2024-03-07T07:32:00.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:00.581+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f14062d40 con 0x7f2f141449d0 2024-03-07T07:32:01.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.505+0000 7f2f0aa00640 1 -- 172.21.15.84:0/3321762430 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2f00005480 con 0x7f2f141449d0 2024-03-07T07:32:01.506 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2024-03-07T07:32:01.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2ef4066f60 msgr2=0x7f2ef4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:01.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2ef4066f60 0x7f2ef4069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f040ae000 tx=0x7f2f040a7000 comp rx=0 tx=0).stop 2024-03-07T07:32:01.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f141449d0 msgr2=0x7f2f1415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:01.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f141449d0 0x7f2f1415a770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c390 tx=0x7f2f0000c850 comp rx=0 tx=0).stop 2024-03-07T07:32:01.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 shutdown_connections 2024-03-07T07:32:01.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2ef4066f60 0x7f2ef4069420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14144fd0 0x7f2f1415acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f141449d0 0x7f2f1415a770 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 --2- 172.21.15.84:0/3321762430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f140b66b0 0x7f2f140afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 >> 172.21.15.84:0/3321762430 conn(0x7f2f14071600 msgr2=0x7f2f140b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:01.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 shutdown_connections 2024-03-07T07:32:01.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.509+0000 7f2f13e00640 1 -- 172.21.15.84:0/3321762430 wait complete. 2024-03-07T07:32:01.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-07T07:32:01.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc910c00640 1 Processor -- start 2024-03-07T07:32:01.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc910c00640 1 -- start start 2024-03-07T07:32:01.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc910c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 0x7fc90c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc910c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc90c0b33b0 0x7fc90c15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc910c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c0cf6a0 con 0x7fc90c15f270 2024-03-07T07:32:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc910c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c0ae5d0 con 0x7fc90c0b33b0 2024-03-07T07:32:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc910c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0cf980 con 0x7fc90c15e950 2024-03-07T07:32:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc90a800640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc90c15f270 0x7fc90c0725d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41250/0 (socket says 172.21.15.84:41250) 2024-03-07T07:32:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc90a800640 1 -- 172.21.15.84:0/542727003 learned_addr learned my addr 172.21.15.84:0/542727003 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909e00640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 0x7fc90c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc901400640 1 --2- 172.21.15.84:0/542727003 >> v2:172.21.15.161:3300/0 conn(0x7fc90c0b33b0 0x7fc90c15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279254513 0 0) 0x7fc90c0cf6a0 con 0x7fc90c15f270 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f0003530 con 0x7fc90c15f270 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1573459936 0 0) 0x7fc8f0003530 con 0x7fc90c15f270 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 msgr2=0x7fc90c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 0x7fc90c0ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 >> v2:172.21.15.161:3300/0 conn(0x7fc90c0b33b0 msgr2=0x7fc90c15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 --2- 172.21.15.84:0/542727003 >> v2:172.21.15.161:3300/0 conn(0x7fc90c0b33b0 0x7fc90c15ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c071af0 con 0x7fc90c15f270 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7fc904001a00 con 0x7fc90c15f270 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909e00640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 0x7fc90c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc901400640 1 --2- 172.21.15.84:0/542727003 >> v2:172.21.15.161:3300/0 conn(0x7fc90c0b33b0 0x7fc90c15ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:32:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 >> v1:172.21.15.84:6789/0 conn(0x7fc90c15f270 legacy=0x7fc90c0725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8f00039c0 0x7fc8f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 0x7fc8f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f0004d50 0x7fc8f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0ae5d0 con 0x7fc8f00039c0 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0cf980 con 0x7fc8f0004d50 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f000b9d0 con 0x7fc90c15e950 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909e00640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8f00039c0 0x7fc8f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc90a800640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f0004d50 0x7fc8f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc901400640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 0x7fc8f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909e00640 1 -- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 msgr2=0x7fc8f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909e00640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc90c15e950 0x7fc8f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909e00640 1 -- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f0004d50 msgr2=0x7fc8f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909e00640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f0004d50 0x7fc8f00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc909e00640 1 -- 172.21.15.84:0/542727003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0003530 con 0x7fc8f00039c0 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.677+0000 7fc90a800640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f0004d50 0x7fc8f00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc909e00640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8f00039c0 0x7fc8f0003de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009cb0 tx=0x7fc8fc01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ccc1869e3a8d13 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0b2070 con 0x7fc8f00039c0 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc0a57a0 con 0x7fc8f00039c0 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc909400640 1 -- 172.21.15.84:0/542727003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc009880 con 0x7fc8f00039c0 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc910c00640 1 -- 172.21.15.84:0/542727003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8f00039c0 msgr2=0x7fc8f0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc910c00640 1 --2- 172.21.15.84:0/542727003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8f00039c0 0x7fc8f0003de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009cb0 tx=0x7fc8fc01cbe0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc90a800640 1 -- 172.21.15.84:0/542727003 reap_dead start 2024-03-07T07:32:01.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc910c00640 1 -- 172.21.15.84:0/542727003 shutdown_connections 2024-03-07T07:32:01.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc910c00640 1 -- 172.21.15.84:0/542727003 >> 172.21.15.84:0/542727003 conn(0x7fc90c0cc840 msgr2=0x7fc90c0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:01.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc910c00640 1 -- 172.21.15.84:0/542727003 shutdown_connections 2024-03-07T07:32:01.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.681+0000 7fc910c00640 1 -- 172.21.15.84:0/542727003 wait complete. 2024-03-07T07:32:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 Processor -- start 2024-03-07T07:32:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 -- start start 2024-03-07T07:32:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8f00039c0 0x7fc90c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc90c155490 0x7fc90c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90c151510 0x7fc90c155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c072e60 con 0x7fc90c155490 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c072ce0 con 0x7fc90c151510 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c072fe0 con 0x7fc8f00039c0 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc90c155490 0x7fc90c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc90c155490 0x7fc90c159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40746/0 (socket says 172.21.15.84:40746) 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 -- 172.21.15.84:0/2851698121 learned_addr learned my addr 172.21.15.84:0/2851698121 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc90a800640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90c151510 0x7fc90c155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc909e00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8f00039c0 0x7fc90c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 -- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8f00039c0 msgr2=0x7fc90c06e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8f00039c0 0x7fc90c06e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 -- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90c151510 msgr2=0x7fc90c155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90c151510 0x7fc90c155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 -- 172.21.15.84:0/2851698121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c159870 con 0x7fc90c155490 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc90a800640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90c151510 0x7fc90c155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc909e00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8f00039c0 0x7fc90c06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc901400640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc90c155490 0x7fc90c159330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4011930 tx=0x7fc8f4011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc902a00640 1 -- 172.21.15.84:0/2851698121 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4004220 con 0x7fc90c155490 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc902a00640 1 -- 172.21.15.84:0/2851698121 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f40043c0 con 0x7fc90c155490 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc902a00640 1 -- 172.21.15.84:0/2851698121 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f400fb70 con 0x7fc90c155490 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c06d640 con 0x7fc90c155490 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.685+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c06dc00 con 0x7fc90c155490 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.689+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90c062d40 con 0x7fc90c155490 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.689+0000 7fc902a00640 1 -- 172.21.15.84:0/2851698121 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc8f400fd10 con 0x7fc90c155490 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.689+0000 7fc902a00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc8e8066f60 0x7fc8e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:01.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.689+0000 7fc902a00640 1 -- 172.21.15.84:0/2851698121 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5386+0+0 (secure 0 0 0) 0x7fc8f4085280 con 0x7fc90c155490 2024-03-07T07:32:01.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.689+0000 7fc909e00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc8e8066f60 0x7fc8e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:01.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.689+0000 7fc909e00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc8e8066f60 0x7fc8e8069420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0af000 tx=0x7fc8fc0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:01.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.693+0000 7fc902a00640 1 -- 172.21.15.84:0/2851698121 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc90c159870 con 0x7fc90c155490 2024-03-07T07:32:01.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:01.849+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc90c06ec20 con 0x7fc90c155490 2024-03-07T07:32:02.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.505+0000 7fc902a00640 1 -- 172.21.15.84:0/2851698121 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc8f4019030 con 0x7fc90c155490 2024-03-07T07:32:02.508 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2024-03-07T07:32:02.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc8e8066f60 msgr2=0x7fc8e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:02.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc8e8066f60 0x7fc8e8069420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0af000 tx=0x7fc8fc0046d0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc90c155490 msgr2=0x7fc90c159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:02.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc90c155490 0x7fc90c159330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4011930 tx=0x7fc8f4011df0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 shutdown_connections 2024-03-07T07:32:02.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc8e8066f60 0x7fc8e8069420 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90c151510 0x7fc90c155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc90c155490 0x7fc90c159330 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4011930 tx=0x7fc8f4011df0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 --2- 172.21.15.84:0/2851698121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8f00039c0 0x7fc90c06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 >> 172.21.15.84:0/2851698121 conn(0x7fc90c0cc840 msgr2=0x7fc90c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 shutdown_connections 2024-03-07T07:32:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.513+0000 7fc910c00640 1 -- 172.21.15.84:0/2851698121 wait complete. 2024-03-07T07:32:02.540 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-07T07:32:02.540 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-07T07:32:02.540 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-07T07:32:02.540 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:32:02.540 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-07T07:32:02.541 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-07T07:32:02.541 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-07T07:32:02.541 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:32:02.541 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-07T07:32:02.541 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-07T07:32:02.541 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-07T07:32:02.541 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:32:02.542 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-07T07:32:02.542 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-07T07:32:02.542 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-07T07:32:02.542 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:32:02.554 INFO:tasks.ceph.mds.c:Stopped 2024-03-07T07:32:02.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-07T07:32:02.555 INFO:tasks.ceph.mds.a:Stopped 2024-03-07T07:32:02.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-07T07:32:02.558 INFO:tasks.ceph.mds.b:Stopped 2024-03-07T07:32:02.559 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-07T07:32:02.559 INFO:tasks.ceph.mds.d:Stopped 2024-03-07T07:32:02.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-07T07:32:02.599 INFO:tasks.ceph.mds.c:Started 2024-03-07T07:32:02.599 DEBUG:teuthology.parallel:result is None 2024-03-07T07:32:02.601 INFO:tasks.ceph.mds.a:Started 2024-03-07T07:32:02.601 DEBUG:teuthology.parallel:result is None 2024-03-07T07:32:02.605 INFO:tasks.ceph.mds.b:Started 2024-03-07T07:32:02.605 DEBUG:teuthology.parallel:result is None 2024-03-07T07:32:02.606 INFO:tasks.ceph.mds.d:Started 2024-03-07T07:32:02.606 DEBUG:teuthology.parallel:result is None 2024-03-07T07:32:02.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-07T07:32:02.686 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2024-03-07T07:32:02.686 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2024-03-07T07:32:02.691 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2024-03-07T07:32:02.691 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2024-03-07T07:32:02.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f6bc00640 1 Processor -- start 2024-03-07T07:32:02.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f6bc00640 1 -- start start 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f6bc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f640aef70 0x7f0f64168810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f6bc00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640af440 con 0x7f0f640cef50 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f6bc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640af720 con 0x7f0f640729d0 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f6bc00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6406d550 con 0x7f0f640aef70 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f63e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0f640cef50 0x7f0f640ad850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41268/0 (socket says 172.21.15.84:41268) 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f63e00640 1 -- 172.21.15.84:0/1093180193 learned_addr learned my addr 172.21.15.84:0/1093180193 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f69c00640 1 --2- 172.21.15.84:0/1093180193 >> v2:172.21.15.161:3300/0 conn(0x7f0f640aef70 0x7f0f64168810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f63400640 1 -- 172.21.15.84:0/1093180193 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458249605 0 0) 0x7f0f640af440 con 0x7f0f640cef50 2024-03-07T07:32:02.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f63400640 1 -- 172.21.15.84:0/1093180193 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c003530 con 0x7f0f640cef50 2024-03-07T07:32:02.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f63400640 1 -- 172.21.15.84:0/1093180193 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873497657 0 0) 0x7f0f640af720 con 0x7f0f640729d0 2024-03-07T07:32:02.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f63400640 1 -- 172.21.15.84:0/1093180193 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f640af440 con 0x7f0f640729d0 2024-03-07T07:32:02.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f69c00640 1 -- 172.21.15.84:0/1093180193 >> v1:172.21.15.161:6789/0 conn(0x7f0f640729d0 legacy=0x7f0f64072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:02.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f69c00640 1 -- 172.21.15.84:0/1093180193 >> v1:172.21.15.84:6789/0 conn(0x7f0f640cef50 legacy=0x7f0f640ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:02.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.749+0000 7f0f69c00640 1 -- 172.21.15.84:0/1093180193 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f640cd460 con 0x7f0f640aef70 2024-03-07T07:32:02.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f69c00640 1 --2- 172.21.15.84:0/1093180193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640aef70 0x7f0f64168810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009d90 tx=0x7f0f5c01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c67ada25bd279b6b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f63400640 1 -- 172.21.15.84:0/1093180193 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0b4070 con 0x7f0f640aef70 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f63400640 1 -- 172.21.15.84:0/1093180193 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0af600 con 0x7f0f640aef70 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f63400640 1 -- 172.21.15.84:0/1093180193 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0af9d0 con 0x7f0f640aef70 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f6bc00640 1 -- 172.21.15.84:0/1093180193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640aef70 msgr2=0x7f0f64168810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f6bc00640 1 --2- 172.21.15.84:0/1093180193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640aef70 0x7f0f64168810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009d90 tx=0x7f0f5c01f150 comp rx=0 tx=0).stop 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f6bc00640 1 -- 172.21.15.84:0/1093180193 shutdown_connections 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f6bc00640 1 --2- 172.21.15.84:0/1093180193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640aef70 0x7f0f64168810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f6bc00640 1 -- 172.21.15.84:0/1093180193 >> 172.21.15.84:0/1093180193 conn(0x7f0f640704b0 msgr2=0x7f0f640708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f6bc00640 1 -- 172.21.15.84:0/1093180193 shutdown_connections 2024-03-07T07:32:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.753+0000 7f0f6bc00640 1 -- 172.21.15.84:0/1093180193 wait complete. 2024-03-07T07:32:02.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 Processor -- start 2024-03-07T07:32:02.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 -- start start 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640729d0 0x7f0f6413a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640aef70 0x7f0f6415b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f640cef50 0x7f0f6415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64168d50 con 0x7f0f640cef50 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640cda20 con 0x7f0f640729d0 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64168ed0 con 0x7f0f640aef70 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f640cef50 0x7f0f6415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f640cef50 0x7f0f6415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40768/0 (socket says 172.21.15.84:40768) 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 -- 172.21.15.84:0/2418333784 learned_addr learned my addr 172.21.15.84:0/2418333784 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f63e00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640aef70 0x7f0f6415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69200640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640729d0 0x7f0f6413a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 -- 172.21.15.84:0/2418333784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640aef70 msgr2=0x7f0f6415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640aef70 0x7f0f6415b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 -- 172.21.15.84:0/2418333784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640729d0 msgr2=0x7f0f6413a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640729d0 0x7f0f6413a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 -- 172.21.15.84:0/2418333784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f641430c0 con 0x7f0f640cef50 2024-03-07T07:32:02.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f69c00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f640cef50 0x7f0f6415bc50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0b2040 tx=0x7f0f5c01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:02.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f60c00640 1 -- 172.21.15.84:0/2418333784 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0b4040 con 0x7f0f640cef50 2024-03-07T07:32:02.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f60c00640 1 -- 172.21.15.84:0/2418333784 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0c1070 con 0x7f0f640cef50 2024-03-07T07:32:02.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f64145580 con 0x7f0f640cef50 2024-03-07T07:32:02.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f60c00640 1 -- 172.21.15.84:0/2418333784 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c009450 con 0x7f0f640cef50 2024-03-07T07:32:02.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.757+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f64143660 con 0x7f0f640cef50 2024-03-07T07:32:02.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.761+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f64062d40 con 0x7f0f640cef50 2024-03-07T07:32:02.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.761+0000 7f0f60c00640 1 -- 172.21.15.84:0/2418333784 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f0f5c0ba6b0 con 0x7f0f640cef50 2024-03-07T07:32:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.761+0000 7f0f60c00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0f44066f60 0x7f0f44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.761+0000 7f0f60c00640 1 -- 172.21.15.84:0/2418333784 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0f5c1236c0 con 0x7f0f640cef50 2024-03-07T07:32:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.761+0000 7f0f69200640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0f44066f60 0x7f0f44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.761+0000 7f0f69200640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0f44066f60 0x7f0f44069420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0f6406d4f0 tx=0x7f0f58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:02.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.765+0000 7f0f60c00640 1 -- 172.21.15.84:0/2418333784 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f0f5c018cb0 con 0x7f0f640cef50 2024-03-07T07:32:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:02.941+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0f6406e430 con 0x7f0f640cef50 2024-03-07T07:32:03.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.525+0000 7f0f60c00640 1 -- 172.21.15.84:0/2418333784 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0f5c0f4930 con 0x7f0f640cef50 2024-03-07T07:32:03.527 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2024-03-07T07:32:03.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0f44066f60 msgr2=0x7f0f44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:03.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0f44066f60 0x7f0f44069420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0f6406d4f0 tx=0x7f0f58009040 comp rx=0 tx=0).stop 2024-03-07T07:32:03.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f640cef50 msgr2=0x7f0f6415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:03.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f640cef50 0x7f0f6415bc50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0b2040 tx=0x7f0f5c01bef0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 shutdown_connections 2024-03-07T07:32:03.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0f44066f60 0x7f0f44069420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f640cef50 0x7f0f6415bc50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640aef70 0x7f0f6415b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 --2- 172.21.15.84:0/2418333784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640729d0 0x7f0f6413a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 >> 172.21.15.84:0/2418333784 conn(0x7f0f640704b0 msgr2=0x7f0f64146640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:03.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 shutdown_connections 2024-03-07T07:32:03.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.529+0000 7f0f6bc00640 1 -- 172.21.15.84:0/2418333784 wait complete. 2024-03-07T07:32:03.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-07T07:32:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.681+0000 7f0663c00640 1 Processor -- start 2024-03-07T07:32:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.681+0000 7f0663c00640 1 -- start start 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0663c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f065c145a30 0x7f065c0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0663c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f065c0a9540 0x7f065c072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0663c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c06d230 0x7f065c0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0663c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c06d780 con 0x7f065c145a30 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0663c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c06da60 con 0x7f065c0a9540 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0663c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c06dd40 con 0x7f065c06d230 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f065c145a30 0x7f065c0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f065c145a30 0x7f065c0729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40780/0 (socket says 172.21.15.84:40780) 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661200640 1 -- 172.21.15.84:0/1353352888 learned_addr learned my addr 172.21.15.84:0/1353352888 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0653e00640 1 --2- 172.21.15.84:0/1353352888 >> v2:172.21.15.161:3300/0 conn(0x7f065c0a9540 0x7f065c072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661c00640 1 --2- 172.21.15.84:0/1353352888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c06d230 0x7f065c0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:03.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661200640 1 -- 172.21.15.84:0/1353352888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c06d230 msgr2=0x7f065c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:03.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661200640 1 --2- 172.21.15.84:0/1353352888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c06d230 0x7f065c0ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661200640 1 -- 172.21.15.84:0/1353352888 >> v2:172.21.15.161:3300/0 conn(0x7f065c0a9540 msgr2=0x7f065c072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:03.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661200640 1 --2- 172.21.15.84:0/1353352888 >> v2:172.21.15.161:3300/0 conn(0x7f065c0a9540 0x7f065c072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.685+0000 7f0661200640 1 -- 172.21.15.84:0/1353352888 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c06e020 con 0x7f065c145a30 2024-03-07T07:32:03.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0661200640 1 --2- 172.21.15.84:0/1353352888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0729d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f065c071760 tx=0x7f064c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a8bc0bc301e209 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f065be00640 1 -- 172.21.15.84:0/1353352888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0b0070 con 0x7f065c145a30 2024-03-07T07:32:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f065be00640 1 -- 172.21.15.84:0/1353352888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c0ab600 con 0x7f065c145a30 2024-03-07T07:32:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f065be00640 1 -- 172.21.15.84:0/1353352888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0ab9d0 con 0x7f065c145a30 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- 172.21.15.84:0/1353352888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 msgr2=0x7f065c0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 --2- 172.21.15.84:0/1353352888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0729d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f065c071760 tx=0x7f064c01c400 comp rx=0 tx=0).stop 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- 172.21.15.84:0/1353352888 shutdown_connections 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 --2- 172.21.15.84:0/1353352888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c06d230 0x7f065c0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 --2- 172.21.15.84:0/1353352888 >> v2:172.21.15.161:3300/0 conn(0x7f065c0a9540 0x7f065c072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 --2- 172.21.15.84:0/1353352888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0729d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- 172.21.15.84:0/1353352888 >> 172.21.15.84:0/1353352888 conn(0x7f065c0704b0 msgr2=0x7f065c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- 172.21.15.84:0/1353352888 shutdown_connections 2024-03-07T07:32:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- 172.21.15.84:0/1353352888 wait complete. 2024-03-07T07:32:03.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 Processor -- start 2024-03-07T07:32:03.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- start start 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f065c06d230 0x7f065c136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c1385d0 0x7f065c15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c15cb70 con 0x7f065c145a30 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c15c9f0 con 0x7f065c06d230 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.689+0000 7f0663c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c15ccf0 con 0x7f065c1385d0 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40786/0 (socket says 172.21.15.84:40786) 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 -- 172.21.15.84:0/3552303455 learned_addr learned my addr 172.21.15.84:0/3552303455 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0661200640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f065c06d230 0x7f065c136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0661c00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c1385d0 0x7f065c15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 -- 172.21.15.84:0/3552303455 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c1385d0 msgr2=0x7f065c15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c1385d0 0x7f065c15b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 -- 172.21.15.84:0/3552303455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f065c06d230 msgr2=0x7f065c136bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f065c06d230 0x7f065c136bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 -- 172.21.15.84:0/3552303455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c138a90 con 0x7f065c145a30 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0653e00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0cb710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f064400e930 tx=0x7f064400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0659600640 1 -- 172.21.15.84:0/3552303455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644017070 con 0x7f065c145a30 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0659600640 1 -- 172.21.15.84:0/3552303455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064400c9a0 con 0x7f065c145a30 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c138d70 con 0x7f065c145a30 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0659600640 1 -- 172.21.15.84:0/3552303455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400cd50 con 0x7f065c145a30 2024-03-07T07:32:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c139330 con 0x7f065c145a30 2024-03-07T07:32:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c139d00 con 0x7f065c145a30 2024-03-07T07:32:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0659600640 1 -- 172.21.15.84:0/3552303455 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f064401a070 con 0x7f065c145a30 2024-03-07T07:32:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.693+0000 7f0659600640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0638066f60 0x7f0638069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.697+0000 7f0659600640 1 -- 172.21.15.84:0/3552303455 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0644084f70 con 0x7f065c145a30 2024-03-07T07:32:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.697+0000 7f0661200640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0638066f60 0x7f0638069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:03.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.697+0000 7f0661200640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0638066f60 0x7f0638069420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f064c0ad000 tx=0x7f064c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.697+0000 7f0659600640 1 -- 172.21.15.84:0/3552303455 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f0644055d30 con 0x7f065c145a30 2024-03-07T07:32:03.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.905+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f065c062d40 con 0x7f065c145a30 2024-03-07T07:32:03.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0659600640 1 -- 172.21.15.84:0/3552303455 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f0644059dd0 con 0x7f065c145a30 2024-03-07T07:32:03.909 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:03.909 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:32:03.909 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAFbell6To0IRAAChisIQQE5JT+rNEcdE3/ig==", 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2024-03-07T07:32:03.910 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAFbelln6lELRAALMUJSsEN+yK9EoJy7VahFw==", 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAFbellkuxCKBAAWixrH+Za1dcFNe37Fqrq0g==", 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2024-03-07T07:32:03.911 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAFbellHeORNBAA2JBt8e8ubFbHqlZxREqjZw==", 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAJbellacaIDxAAYDl3wXcovkd5lcu9RxsVPQ==", 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAMbellJFOtFBAA36VhuWzCb1E86F1PTGhrkQ==", 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2024-03-07T07:32:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAPbellreHGGhAANQqk/azqNoIYstSgVWzA4Q==", 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQASbellr3swIRAAUzKYTs38ZFLlSx+CKKcyKQ==", 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAYbellbaBEJhAAKVM13Oe9d7zkyqdxh+yVGQ==", 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2024-03-07T07:32:03.915 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAbbellwFMELBAASpZ5dJUU7hf2WjknWGUa+Q==", 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAebellsG6vMRAAhJk8YjL24PDJ7j6T0WwssQ==", 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAhbelliXDwNxAAtU1tGZFKb+9ZpzKgBfqL+Q==", 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2024-03-07T07:32:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAFbellW6BnOBAAntECnVfbCrv87gpYUuAGtw==", 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAGbellWYJNBhAAI8LLeTLMhlRk4766XNjY9g==", 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAGbell6f3BAhAAil9x99pkySEoqZlAV2gJEQ==", 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.919 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAGbelleF85DBAAJ/7i3qCpRmcl8I0levTDzA==", 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2024-03-07T07:32:03.920 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAFbellfpmFBRAAxfDauhaAh5SVVEtgkfskOA==", 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.921 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mds", 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAnbellUZ9UNBAAk2hJaZbNgUsJ98bih3z8CA==", 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mds" 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mgr", 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAnbellU6lUNBAA5PT0NzRzSlskfOZ86oD5kA==", 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-osd", 2024-03-07T07:32:03.922 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAnbellPLJUNBAABcWkJm65jI/Zz11m2MTGRg==", 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-osd" 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd", 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAnbellyrpUNBAAuuiKmB9vlMDV5Upv7hFsNQ==", 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-07T07:32:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAnbellicNUNBAAs0b9kCH/t/LEWeEqNHH0oQ==", 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rgw", 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAnbellasxUNBAAIVAZaWusB5iUbXgcOhMQLQ==", 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAFbellgM6pHBAAEahL88xcFba3qhDLk2AELg==", 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQAFbell2VPNGBAA+AetKp6m6DrLumQdIwjK/w==", 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2024-03-07T07:32:03.925 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2024-03-07T07:32:03.926 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2024-03-07T07:32:03.926 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2024-03-07T07:32:03.926 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.926 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:03.926 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-03-07T07:32:03.926 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:32:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0638066f60 msgr2=0x7f0638069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0638066f60 0x7f0638069420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f064c0ad000 tx=0x7f064c008040 comp rx=0 tx=0).stop 2024-03-07T07:32:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 msgr2=0x7f065c0cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0cb710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f064400e930 tx=0x7f064400edf0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 shutdown_connections 2024-03-07T07:32:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0638066f60 0x7f0638069420 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f065c1385d0 0x7f065c15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f065c145a30 0x7f065c0cb710 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 --2- 172.21.15.84:0/3552303455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f065c06d230 0x7f065c136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 >> 172.21.15.84:0/3552303455 conn(0x7f065c0704b0 msgr2=0x7f065c0a9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 shutdown_connections 2024-03-07T07:32:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:03.909+0000 7f0663c00640 1 -- 172.21.15.84:0/3552303455 wait complete. 2024-03-07T07:32:03.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-07T07:32:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46c800640 1 Processor -- start 2024-03-07T07:32:04.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46c800640 1 -- start start 2024-03-07T07:32:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46c800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4640a9540 0x7ff46415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46c800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff4640730e0 0x7ff46415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46c800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46406d780 con 0x7ff464145a30 2024-03-07T07:32:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46c800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46406da60 con 0x7ff4640730e0 2024-03-07T07:32:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46c800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46406dd40 con 0x7ff4640a9540 2024-03-07T07:32:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff469e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff464145a30 0x7ff4640729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41284/0 (socket says 172.21.15.84:41284) 2024-03-07T07:32:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff469e00640 1 -- 172.21.15.84:0/41473211 learned_addr learned my addr 172.21.15.84:0/41473211 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46a800640 1 --2- 172.21.15.84:0/41473211 >> v2:172.21.15.84:3300/0 conn(0x7ff4640730e0 0x7ff46415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff469400640 1 --2- 172.21.15.84:0/41473211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4640a9540 0x7ff46415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff468a00640 1 -- 172.21.15.84:0/41473211 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282784719 0 0) 0x7ff46406d780 con 0x7ff464145a30 2024-03-07T07:32:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff468a00640 1 -- 172.21.15.84:0/41473211 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff44c003530 con 0x7ff464145a30 2024-03-07T07:32:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46a800640 1 -- 172.21.15.84:0/41473211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4640a9540 msgr2=0x7ff46415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46a800640 1 --2- 172.21.15.84:0/41473211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4640a9540 0x7ff46415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46a800640 1 -- 172.21.15.84:0/41473211 >> v1:172.21.15.84:6789/0 conn(0x7ff464145a30 legacy=0x7ff4640729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.065+0000 7ff46a800640 1 -- 172.21.15.84:0/41473211 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46406e020 con 0x7ff4640730e0 2024-03-07T07:32:04.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46a800640 1 --2- 172.21.15.84:0/41473211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff46415cd20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff460009d90 tx=0x7ff46001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1be6cea72e6c63 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff468a00640 1 -- 172.21.15.84:0/41473211 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600b2070 con 0x7ff4640730e0 2024-03-07T07:32:04.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff468a00640 1 -- 172.21.15.84:0/41473211 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4600a5820 con 0x7ff4640730e0 2024-03-07T07:32:04.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff468a00640 1 -- 172.21.15.84:0/41473211 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600a5bf0 con 0x7ff4640730e0 2024-03-07T07:32:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46c800640 1 -- 172.21.15.84:0/41473211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 msgr2=0x7ff46415cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46c800640 1 --2- 172.21.15.84:0/41473211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff46415cd20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff460009d90 tx=0x7ff46001c850 comp rx=0 tx=0).stop 2024-03-07T07:32:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46c800640 1 -- 172.21.15.84:0/41473211 shutdown_connections 2024-03-07T07:32:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46c800640 1 --2- 172.21.15.84:0/41473211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff46415cd20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46c800640 1 --2- 172.21.15.84:0/41473211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4640a9540 0x7ff46415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46c800640 1 -- 172.21.15.84:0/41473211 >> 172.21.15.84:0/41473211 conn(0x7ff4640704b0 msgr2=0x7ff4640708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46c800640 1 -- 172.21.15.84:0/41473211 shutdown_connections 2024-03-07T07:32:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.069+0000 7ff46c800640 1 -- 172.21.15.84:0/41473211 wait complete. 2024-03-07T07:32:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 Processor -- start 2024-03-07T07:32:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 -- start start 2024-03-07T07:32:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff4640aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff464145a30 0x7ff4641431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff464142470 0x7ff4641f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464168d60 con 0x7ff4640730e0 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464168be0 con 0x7ff464142470 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff464168ee0 con 0x7ff464145a30 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff4640aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff4640aadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40808/0 (socket says 172.21.15.84:40808) 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 -- 172.21.15.84:0/915870992 learned_addr learned my addr 172.21.15.84:0/915870992 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469400640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff464145a30 0x7ff4641431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46a800640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff464142470 0x7ff4641f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 -- 172.21.15.84:0/915870992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff464145a30 msgr2=0x7ff4641431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff464145a30 0x7ff4641431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 -- 172.21.15.84:0/915870992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff464142470 msgr2=0x7ff4641f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff464142470 0x7ff4641f7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 -- 172.21.15.84:0/915870992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640ce270 con 0x7ff4640730e0 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff469e00640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff4640aadb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c3f0 tx=0x7ff45800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff45e000640 1 -- 172.21.15.84:0/915870992 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458017070 con 0x7ff4640730e0 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff45e000640 1 -- 172.21.15.84:0/915870992 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff458005cf0 con 0x7ff4640730e0 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff45e000640 1 -- 172.21.15.84:0/915870992 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580072f0 con 0x7ff4640730e0 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4641439d0 con 0x7ff4640730e0 2024-03-07T07:32:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4640cd4b0 con 0x7ff4640730e0 2024-03-07T07:32:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.073+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464062d40 con 0x7ff4640730e0 2024-03-07T07:32:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.077+0000 7ff45e000640 1 -- 172.21.15.84:0/915870992 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7ff45801a070 con 0x7ff4640730e0 2024-03-07T07:32:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.077+0000 7ff45e000640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff448066f60 0x7ff448069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.077+0000 7ff45e000640 1 -- 172.21.15.84:0/915870992 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff458084100 con 0x7ff4640730e0 2024-03-07T07:32:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.077+0000 7ff469400640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff448066f60 0x7ff448069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.077+0000 7ff469400640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff448066f60 0x7ff448069420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4640ce480 tx=0x7ff454008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.081+0000 7ff45e000640 1 -- 172.21.15.84:0/915870992 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7ff458054d70 con 0x7ff4640730e0 2024-03-07T07:32:04.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.285+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff4640b1160 con 0x7ff4640730e0 2024-03-07T07:32:04.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.289+0000 7ff45e000640 1 -- 172.21.15.84:0/915870992 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff458058e10 con 0x7ff4640730e0 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.289+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff448066f60 msgr2=0x7ff448069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.289+0000 7ff46c800640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff448066f60 0x7ff448069420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4640ce480 tx=0x7ff454008040 comp rx=0 tx=0).stop 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.289+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 msgr2=0x7ff4640aadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.289+0000 7ff46c800640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff4640aadb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c3f0 tx=0x7ff45800c8b0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.293+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 shutdown_connections 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.293+0000 7ff46c800640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff448066f60 0x7ff448069420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.293+0000 7ff46c800640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff464142470 0x7ff4641f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.293+0000 7ff46c800640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff464145a30 0x7ff4641431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.293+0000 7ff46c800640 1 --2- 172.21.15.84:0/915870992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4640730e0 0x7ff4640aadb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.293+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 >> 172.21.15.84:0/915870992 conn(0x7ff4640704b0 msgr2=0x7ff46415c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:04.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.293+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 shutdown_connections 2024-03-07T07:32:04.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.293+0000 7ff46c800640 1 -- 172.21.15.84:0/915870992 wait complete. 2024-03-07T07:32:04.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-07T07:32:04.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.445+0000 7fe868c00640 1 Processor -- start 2024-03-07T07:32:04.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.445+0000 7fe868c00640 1 -- start start 2024-03-07T07:32:04.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe868c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe864143dd0 0x7fe8640cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe868c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe864144360 0x7fe8640729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe868c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8640cc880 con 0x7fe8641448b0 2024-03-07T07:32:04.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe868c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8641441b0 con 0x7fe864143dd0 2024-03-07T07:32:04.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe868c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8640cf050 con 0x7fe864144360 2024-03-07T07:32:04.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe861e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe864143dd0 0x7fe8640cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe861e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe864143dd0 0x7fe8640cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40824/0 (socket says 172.21.15.84:40824) 2024-03-07T07:32:04.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe861e00640 1 -- 172.21.15.84:0/395948828 learned_addr learned my addr 172.21.15.84:0/395948828 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:04.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe859400640 1 --2- 172.21.15.84:0/395948828 >> v2:172.21.15.161:3300/0 conn(0x7fe864144360 0x7fe8640729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe861e00640 1 -- 172.21.15.84:0/395948828 >> v2:172.21.15.161:3300/0 conn(0x7fe864144360 msgr2=0x7fe8640729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:04.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe861e00640 1 --2- 172.21.15.84:0/395948828 >> v2:172.21.15.161:3300/0 conn(0x7fe864144360 0x7fe8640729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe861e00640 1 -- 172.21.15.84:0/395948828 >> v1:172.21.15.161:6789/0 conn(0x7fe8641448b0 legacy=0x7fe86415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe861e00640 1 -- 172.21.15.84:0/395948828 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640ccb60 con 0x7fe864143dd0 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.449+0000 7fe861e00640 1 --2- 172.21.15.84:0/395948828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864143dd0 0x7fe8640cdc00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe864073790 tx=0x7fe85401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdda8e0438073fb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe861400640 1 -- 172.21.15.84:0/395948828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8540a5890 con 0x7fe864143dd0 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe861400640 1 -- 172.21.15.84:0/395948828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8540a5a30 con 0x7fe864143dd0 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe861400640 1 -- 172.21.15.84:0/395948828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8540a5e00 con 0x7fe864143dd0 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- 172.21.15.84:0/395948828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864143dd0 msgr2=0x7fe8640cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 --2- 172.21.15.84:0/395948828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864143dd0 0x7fe8640cdc00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe864073790 tx=0x7fe85401c9b0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- 172.21.15.84:0/395948828 shutdown_connections 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 --2- 172.21.15.84:0/395948828 >> v2:172.21.15.161:3300/0 conn(0x7fe864144360 0x7fe8640729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 --2- 172.21.15.84:0/395948828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864143dd0 0x7fe8640cdc00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- 172.21.15.84:0/395948828 >> 172.21.15.84:0/395948828 conn(0x7fe8640704b0 msgr2=0x7fe8640708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- 172.21.15.84:0/395948828 shutdown_connections 2024-03-07T07:32:04.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- 172.21.15.84:0/395948828 wait complete. 2024-03-07T07:32:04.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 Processor -- start 2024-03-07T07:32:04.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- start start 2024-03-07T07:32:04.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe864143dd0 0x7fe864142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864144360 0x7fe86413d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8641448b0 0x7fe86413de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640cd6e0 con 0x7fe864144360 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe864073320 con 0x7fe8641448b0 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe868c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86415bf30 con 0x7fe864143dd0 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe859400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864144360 0x7fe86413d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe859400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864144360 0x7fe86413d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40840/0 (socket says 172.21.15.84:40840) 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.453+0000 7fe859400640 1 -- 172.21.15.84:0/520711423 learned_addr learned my addr 172.21.15.84:0/520711423 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe862800640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8641448b0 0x7fe86413de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe861e00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe864143dd0 0x7fe864142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe859400640 1 -- 172.21.15.84:0/520711423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe864143dd0 msgr2=0x7fe864142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe859400640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe864143dd0 0x7fe864142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe859400640 1 -- 172.21.15.84:0/520711423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8641448b0 msgr2=0x7fe86413de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe859400640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8641448b0 0x7fe86413de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe859400640 1 -- 172.21.15.84:0/520711423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640b41d0 con 0x7fe864144360 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe859400640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864144360 0x7fe86413d8c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00d830 tx=0x7fe84c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe85aa00640 1 -- 172.21.15.84:0/520711423 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c00b6c0 con 0x7fe864144360 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe85aa00640 1 -- 172.21.15.84:0/520711423 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c019070 con 0x7fe864144360 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8640ae0f0 con 0x7fe864144360 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe85aa00640 1 -- 172.21.15.84:0/520711423 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c00ba60 con 0x7fe864144360 2024-03-07T07:32:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8640ae6b0 con 0x7fe864144360 2024-03-07T07:32:04.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe864062d40 con 0x7fe864144360 2024-03-07T07:32:04.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe85aa00640 1 -- 172.21.15.84:0/520711423 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe84c00bc00 con 0x7fe864144360 2024-03-07T07:32:04.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe85aa00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe840066f60 0x7fe840069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe85aa00640 1 -- 172.21.15.84:0/520711423 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe84c0851d0 con 0x7fe864144360 2024-03-07T07:32:04.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.457+0000 7fe861e00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe840066f60 0x7fe840069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.461+0000 7fe861e00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe840066f60 0x7fe840069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe8540ae000 tx=0x7fe8540a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.461+0000 7fe85aa00640 1 -- 172.21.15.84:0/520711423 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe84c056520 con 0x7fe864144360 2024-03-07T07:32:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.673+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe86415b1f0 con 0x7fe864144360 2024-03-07T07:32:04.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.677+0000 7fe85aa00640 1 -- 172.21.15.84:0/520711423 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe84c055e20 con 0x7fe864144360 2024-03-07T07:32:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe840066f60 msgr2=0x7fe840069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe840066f60 0x7fe840069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe8540ae000 tx=0x7fe8540a7070 comp rx=0 tx=0).stop 2024-03-07T07:32:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864144360 msgr2=0x7fe86413d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864144360 0x7fe86413d8c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00d830 tx=0x7fe84c00dcf0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 shutdown_connections 2024-03-07T07:32:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe840066f60 0x7fe840069420 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8641448b0 0x7fe86413de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864144360 0x7fe86413d8c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 --2- 172.21.15.84:0/520711423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe864143dd0 0x7fe864142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 >> 172.21.15.84:0/520711423 conn(0x7fe8640704b0 msgr2=0x7fe86413bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:04.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 shutdown_connections 2024-03-07T07:32:04.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.681+0000 7fe868c00640 1 -- 172.21.15.84:0/520711423 wait complete. 2024-03-07T07:32:04.702 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-07T07:32:04.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ee00640 1 Processor -- start 2024-03-07T07:32:04.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ee00640 1 -- start start 2024-03-07T07:32:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ee00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1628144360 0x7f16280cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ee00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280cc880 con 0x7f1628143dd0 2024-03-07T07:32:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ee00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280ccb60 con 0x7f16280730e0 2024-03-07T07:32:04.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ee00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16281441b0 con 0x7f1628144360 2024-03-07T07:32:04.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1627e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1628143dd0 0x7f16280729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41300/0 (socket says 172.21.15.84:41300) 2024-03-07T07:32:04.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1627e00640 1 -- 172.21.15.84:0/2696455296 learned_addr learned my addr 172.21.15.84:0/2696455296 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ce00640 1 --2- 172.21.15.84:0/2696455296 >> v2:172.21.15.161:3300/0 conn(0x7f1628144360 0x7f16280cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140839116 0 0) 0x7f16280cc880 con 0x7f1628143dd0 2024-03-07T07:32:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f160c003530 con 0x7f1628143dd0 2024-03-07T07:32:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651919280 0 0) 0x7f160c003530 con 0x7f1628143dd0 2024-03-07T07:32:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 >> v2:172.21.15.161:3300/0 conn(0x7f1628144360 msgr2=0x7f16280cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 --2- 172.21.15.84:0/2696455296 >> v2:172.21.15.161:3300/0 conn(0x7f1628144360 0x7f16280cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 >> v1:172.21.15.161:6789/0 conn(0x7f16280730e0 legacy=0x7f162815b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280cce40 con 0x7f1628143dd0 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f16180016a0 con 0x7f1628143dd0 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 >> v1:172.21.15.84:6789/0 conn(0x7f1628143dd0 legacy=0x7f16280729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f160c003a10 0x7f160c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c004810 0x7f160c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f160c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c00c0a0 con 0x7f160c0051d0 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c00c250 con 0x7f160c004810 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c00c450 con 0x7f160c003a10 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ce00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f160c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1627e00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f160c003a10 0x7f160c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f1627400640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c004810 0x7f160c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ce00640 1 -- 172.21.15.84:0/2696455296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f160c003a10 msgr2=0x7f160c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:04.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ce00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f160c003a10 0x7f160c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ce00640 1 -- 172.21.15.84:0/2696455296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c004810 msgr2=0x7f160c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:04.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ce00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f160c004810 0x7f160c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.837+0000 7f162ce00640 1 -- 172.21.15.84:0/2696455296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c003530 con 0x7f160c0051d0 2024-03-07T07:32:04.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ce00640 1 -- 172.21.15.84:0/2696455296 reap_dead start 2024-03-07T07:32:04.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ce00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f160c00b9d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1620009fc0 tx=0x7f162001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e436c32dfdd1917 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620009c10 con 0x7f160c0051d0 2024-03-07T07:32:04.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16200a5cd0 con 0x7f160c0051d0 2024-03-07T07:32:04.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f1626a00640 1 -- 172.21.15.84:0/2696455296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620003be0 con 0x7f160c0051d0 2024-03-07T07:32:04.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ee00640 1 -- 172.21.15.84:0/2696455296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 msgr2=0x7f160c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ee00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f160c00b9d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1620009fc0 tx=0x7f162001ccc0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ee00640 1 -- 172.21.15.84:0/2696455296 shutdown_connections 2024-03-07T07:32:04.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ee00640 1 --2- 172.21.15.84:0/2696455296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f160c00b9d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ee00640 1 -- 172.21.15.84:0/2696455296 >> 172.21.15.84:0/2696455296 conn(0x7f16280704b0 msgr2=0x7f16280708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:04.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ee00640 1 -- 172.21.15.84:0/2696455296 shutdown_connections 2024-03-07T07:32:04.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.841+0000 7f162ee00640 1 -- 172.21.15.84:0/2696455296 wait complete. 2024-03-07T07:32:04.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 Processor -- start 2024-03-07T07:32:04.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 -- start start 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f16281f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16281e6980 0x7f16281e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16281e6e00 0x7f16281e3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cd400 con 0x7f160c0051d0 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cf050 con 0x7f16281e6e00 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cd6e0 con 0x7f16281e6980 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f16281f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f16281f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40854/0 (socket says 172.21.15.84:40854) 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 -- 172.21.15.84:0/2592813879 learned_addr learned my addr 172.21.15.84:0/2592813879 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627400640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16281e6980 0x7f16281e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ce00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16281e6e00 0x7f16281e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 -- 172.21.15.84:0/2592813879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16281e6980 msgr2=0x7f16281e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16281e6980 0x7f16281e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 -- 172.21.15.84:0/2592813879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16281e6e00 msgr2=0x7f16281e3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16281e6e00 0x7f16281e3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 -- 172.21.15.84:0/2592813879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16281e7360 con 0x7f160c0051d0 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f1627e00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f16281f4500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1618004f80 tx=0x7f16180074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f161fe00640 1 -- 172.21.15.84:0/2592813879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161800f750 con 0x7f160c0051d0 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f161fe00640 1 -- 172.21.15.84:0/2592813879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618018070 con 0x7f160c0051d0 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16281e7640 con 0x7f160c0051d0 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f161fe00640 1 -- 172.21.15.84:0/2592813879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161800fb30 con 0x7f160c0051d0 2024-03-07T07:32:04.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.845+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16281e7c00 con 0x7f160c0051d0 2024-03-07T07:32:04.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.849+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1628062d40 con 0x7f160c0051d0 2024-03-07T07:32:04.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.849+0000 7f161fe00640 1 -- 172.21.15.84:0/2592813879 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f161800fcd0 con 0x7f160c0051d0 2024-03-07T07:32:04.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.849+0000 7f161fe00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1608066f60 0x7f1608069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:04.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.849+0000 7f161fe00640 1 -- 172.21.15.84:0/2592813879 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1618084c00 con 0x7f160c0051d0 2024-03-07T07:32:04.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.849+0000 7f1627400640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1608066f60 0x7f1608069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:04.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.849+0000 7f1627400640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1608066f60 0x7f1608069420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1614000c10 tx=0x7f1614009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:04.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:04.853+0000 7f161fe00640 1 -- 172.21.15.84:0/2592813879 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f1618055f50 con 0x7f160c0051d0 2024-03-07T07:32:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.061+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f162815b1f0 con 0x7f160c0051d0 2024-03-07T07:32:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f161fe00640 1 -- 172.21.15.84:0/2592813879 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1618055850 con 0x7f160c0051d0 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1608066f60 msgr2=0x7f1608069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1608066f60 0x7f1608069420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1614000c10 tx=0x7f1614009040 comp rx=0 tx=0).stop 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 msgr2=0x7f16281f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f16281f4500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1618004f80 tx=0x7f16180074f0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 shutdown_connections 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1608066f60 0x7f1608069420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16281e6e00 0x7f16281e3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16281e6980 0x7f16281e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 --2- 172.21.15.84:0/2592813879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160c0051d0 0x7f16281f4500 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 >> 172.21.15.84:0/2592813879 conn(0x7f16280704b0 msgr2=0x7f16280afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.065+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 shutdown_connections 2024-03-07T07:32:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.069+0000 7f162ee00640 1 -- 172.21.15.84:0/2592813879 wait complete. 2024-03-07T07:32:05.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-07T07:32:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.221+0000 7fd26d800640 1 Processor -- start 2024-03-07T07:32:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.221+0000 7fd26d800640 1 -- start start 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd26d800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2680704f0 0x7fd2680708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd26d800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2681606e0 0x7fd2680b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd26d800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd268159e90 con 0x7fd26815d220 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd26d800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd268160250 con 0x7fd2680704f0 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd26d800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd268070e10 con 0x7fd2681606e0 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd266a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2680704f0 0x7fd2680708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd25fe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd26815d220 0x7fd2680ae7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41312/0 (socket says 172.21.15.84:41312) 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd25fe00640 1 -- 172.21.15.84:0/3947072507 learned_addr learned my addr 172.21.15.84:0/3947072507 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd267400640 1 --2- 172.21.15.84:0/3947072507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2681606e0 0x7fd2680b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd266a00640 1 -- 172.21.15.84:0/3947072507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2681606e0 msgr2=0x7fd2680b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd266a00640 1 --2- 172.21.15.84:0/3947072507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2681606e0 0x7fd2680b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd266a00640 1 -- 172.21.15.84:0/3947072507 >> v1:172.21.15.84:6789/0 conn(0x7fd26815d220 legacy=0x7fd2680ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd266000640 1 -- 172.21.15.84:0/3947072507 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641845416 0 0) 0x7fd268159e90 con 0x7fd26815d220 2024-03-07T07:32:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.225+0000 7fd266a00640 1 -- 172.21.15.84:0/3947072507 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2680af480 con 0x7fd2680704f0 2024-03-07T07:32:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd266a00640 1 --2- 172.21.15.84:0/3947072507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2680708d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2580097c0 tx=0x7fd25801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3aaa4052144ad84 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd266000640 1 -- 172.21.15.84:0/3947072507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580ab680 con 0x7fd2680704f0 2024-03-07T07:32:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd266000640 1 -- 172.21.15.84:0/3947072507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2580b0070 con 0x7fd2680704f0 2024-03-07T07:32:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd266000640 1 -- 172.21.15.84:0/3947072507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580aba40 con 0x7fd2680704f0 2024-03-07T07:32:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 -- 172.21.15.84:0/3947072507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 msgr2=0x7fd2680708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 --2- 172.21.15.84:0/3947072507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2680708d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2580097c0 tx=0x7fd25801c480 comp rx=0 tx=0).stop 2024-03-07T07:32:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 -- 172.21.15.84:0/3947072507 shutdown_connections 2024-03-07T07:32:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 --2- 172.21.15.84:0/3947072507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2681606e0 0x7fd2680b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 --2- 172.21.15.84:0/3947072507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2680708d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 -- 172.21.15.84:0/3947072507 >> 172.21.15.84:0/3947072507 conn(0x7fd26806b0f0 msgr2=0x7fd26806b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:05.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 -- 172.21.15.84:0/3947072507 shutdown_connections 2024-03-07T07:32:05.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 -- 172.21.15.84:0/3947072507 wait complete. 2024-03-07T07:32:05.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 Processor -- start 2024-03-07T07:32:05.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 -- start start 2024-03-07T07:32:05.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.229+0000 7fd26d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2681587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd26d800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2681606e0 0x7fd268150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd26d800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2680cdb20 0x7fd268155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd26d800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd268168e00 con 0x7fd2680704f0 2024-03-07T07:32:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd26d800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26815fee0 con 0x7fd2681606e0 2024-03-07T07:32:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd26d800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd268168f80 con 0x7fd2680cdb20 2024-03-07T07:32:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2681587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2681587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40872/0 (socket says 172.21.15.84:40872) 2024-03-07T07:32:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 -- 172.21.15.84:0/2388166276 learned_addr learned my addr 172.21.15.84:0/2388166276 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd267400640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2680cdb20 0x7fd268155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd25fe00640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2681606e0 0x7fd268150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 -- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2680cdb20 msgr2=0x7fd268155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2680cdb20 0x7fd268155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 -- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2681606e0 msgr2=0x7fd268150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2681606e0 0x7fd268150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 -- 172.21.15.84:0/2388166276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2681583b0 con 0x7fd2680704f0 2024-03-07T07:32:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd25fe00640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2681606e0 0x7fd268150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd266a00640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2681587b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd25801a0b0 tx=0x7fd25801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd25ea00640 1 -- 172.21.15.84:0/2388166276 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580bf610 con 0x7fd2680704f0 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd25ea00640 1 -- 172.21.15.84:0/2388166276 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2580a7070 con 0x7fd2680704f0 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd268153430 con 0x7fd2680704f0 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd25ea00640 1 -- 172.21.15.84:0/2388166276 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580bfa10 con 0x7fd2680704f0 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd268153da0 con 0x7fd2680704f0 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd268062d40 con 0x7fd2680704f0 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.233+0000 7fd25ea00640 1 -- 172.21.15.84:0/2388166276 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fd2580bd020 con 0x7fd2680704f0 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.237+0000 7fd25ea00640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd244066f60 0x7fd244069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.237+0000 7fd25ea00640 1 -- 172.21.15.84:0/2388166276 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd25811f4f0 con 0x7fd2680704f0 2024-03-07T07:32:05.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.237+0000 7fd25fe00640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd244066f60 0x7fd244069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.237+0000 7fd25fe00640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd244066f60 0x7fd244069420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd268158760 tx=0x7fd250007c40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:05.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.241+0000 7fd25ea00640 1 -- 172.21.15.84:0/2388166276 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fd2681583b0 con 0x7fd2680704f0 2024-03-07T07:32:05.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.445+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd2680b0ac0 con 0x7fd2680704f0 2024-03-07T07:32:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.449+0000 7fd25ea00640 1 -- 172.21.15.84:0/2388166276 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd258016070 con 0x7fd2680704f0 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd244066f60 msgr2=0x7fd244069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd244066f60 0x7fd244069420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd268158760 tx=0x7fd250007c40 comp rx=0 tx=0).stop 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 msgr2=0x7fd2681587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2681587b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd25801a0b0 tx=0x7fd25801acc0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 shutdown_connections 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd244066f60 0x7fd244069420 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2680cdb20 0x7fd268155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2681606e0 0x7fd268150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 --2- 172.21.15.84:0/2388166276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2680704f0 0x7fd2681587b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 >> 172.21.15.84:0/2388166276 conn(0x7fd26806b0f0 msgr2=0x7fd2680b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 shutdown_connections 2024-03-07T07:32:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.453+0000 7fd26d800640 1 -- 172.21.15.84:0/2388166276 wait complete. 2024-03-07T07:32:05.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-07T07:32:05.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ee00640 1 Processor -- start 2024-03-07T07:32:05.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ee00640 1 -- start start 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc488143dd0 0x7fc4880cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ee00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4880730e0 0x7fc48815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ee00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4880cc880 con 0x7fc488144360 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ee00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4881441b0 con 0x7fc4880730e0 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ee00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4880cf050 con 0x7fc488143dd0 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ce00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4880730e0 0x7fc48815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ce00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4880730e0 0x7fc48815b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40876/0 (socket says 172.21.15.84:40876) 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ce00640 1 -- 172.21.15.84:0/2999998939 learned_addr learned my addr 172.21.15.84:0/2999998939 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc487e00640 1 --2- 172.21.15.84:0/2999998939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc488143dd0 0x7fc4880cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ce00640 1 -- 172.21.15.84:0/2999998939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc488143dd0 msgr2=0x7fc4880cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ce00640 1 --2- 172.21.15.84:0/2999998939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc488143dd0 0x7fc4880cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ce00640 1 -- 172.21.15.84:0/2999998939 >> v1:172.21.15.161:6789/0 conn(0x7fc488144360 legacy=0x7fc4880729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.609+0000 7fc48ce00640 1 -- 172.21.15.84:0/2999998939 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4880ccb60 con 0x7fc4880730e0 2024-03-07T07:32:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ce00640 1 --2- 172.21.15.84:0/2999998939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4880730e0 0x7fc48815b410 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc480009870 tx=0x7fc48001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499857e8bb06b4cb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc487400640 1 -- 172.21.15.84:0/2999998939 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800a9610 con 0x7fc4880730e0 2024-03-07T07:32:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc487400640 1 -- 172.21.15.84:0/2999998939 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4800a97b0 con 0x7fc4880730e0 2024-03-07T07:32:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc487400640 1 -- 172.21.15.84:0/2999998939 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800a9b80 con 0x7fc4880730e0 2024-03-07T07:32:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 -- 172.21.15.84:0/2999998939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4880730e0 msgr2=0x7fc48815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 --2- 172.21.15.84:0/2999998939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4880730e0 0x7fc48815b410 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc480009870 tx=0x7fc48001c530 comp rx=0 tx=0).stop 2024-03-07T07:32:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 -- 172.21.15.84:0/2999998939 shutdown_connections 2024-03-07T07:32:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 --2- 172.21.15.84:0/2999998939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4880730e0 0x7fc48815b410 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 --2- 172.21.15.84:0/2999998939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc488143dd0 0x7fc4880cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 -- 172.21.15.84:0/2999998939 >> 172.21.15.84:0/2999998939 conn(0x7fc4880704b0 msgr2=0x7fc4880708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:05.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 -- 172.21.15.84:0/2999998939 shutdown_connections 2024-03-07T07:32:05.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 -- 172.21.15.84:0/2999998939 wait complete. 2024-03-07T07:32:05.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 Processor -- start 2024-03-07T07:32:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.613+0000 7fc48ee00640 1 -- start start 2024-03-07T07:32:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4880730e0 0x7fc4880ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc488143dd0 0x7fc48813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc488144360 0x7fc48815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc488167960 con 0x7fc488144360 2024-03-07T07:32:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4880cd6e0 con 0x7fc488143dd0 2024-03-07T07:32:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc488167ae0 con 0x7fc4880730e0 2024-03-07T07:32:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc488144360 0x7fc48815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc488144360 0x7fc48815a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40892/0 (socket says 172.21.15.84:40892) 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 -- 172.21.15.84:0/3481150165 learned_addr learned my addr 172.21.15.84:0/3481150165 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc487e00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4880730e0 0x7fc4880ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc47f400640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc488143dd0 0x7fc48813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 -- 172.21.15.84:0/3481150165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4880730e0 msgr2=0x7fc4880ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4880730e0 0x7fc4880ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 -- 172.21.15.84:0/3481150165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc488143dd0 msgr2=0x7fc48813fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc488143dd0 0x7fc48813fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 -- 172.21.15.84:0/3481150165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48815ac20 con 0x7fc488144360 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ce00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc488144360 0x7fc48815a6e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc4800ab040 tx=0x7fc48001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc484c00640 1 -- 172.21.15.84:0/3481150165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800bc650 con 0x7fc488144360 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc484c00640 1 -- 172.21.15.84:0/3481150165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4800bc7f0 con 0x7fc488144360 2024-03-07T07:32:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc484c00640 1 -- 172.21.15.84:0/3481150165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800bcbe0 con 0x7fc488144360 2024-03-07T07:32:05.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4881405a0 con 0x7fc488144360 2024-03-07T07:32:05.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc488140b60 con 0x7fc488144360 2024-03-07T07:32:05.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc488062d40 con 0x7fc488144360 2024-03-07T07:32:05.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.617+0000 7fc484c00640 1 -- 172.21.15.84:0/3481150165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc4800a9640 con 0x7fc488144360 2024-03-07T07:32:05.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.621+0000 7fc484c00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc464066f60 0x7fc464069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.621+0000 7fc484c00640 1 -- 172.21.15.84:0/3481150165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc48011f430 con 0x7fc488144360 2024-03-07T07:32:05.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.621+0000 7fc487e00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc464066f60 0x7fc464069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:05.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.621+0000 7fc487e00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc464066f60 0x7fc464069420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc48813af50 tx=0x7fc4780098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.625+0000 7fc484c00640 1 -- 172.21.15.84:0/3481150165 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc4800ad020 con 0x7fc488144360 2024-03-07T07:32:05.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.837+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc48815b1f0 con 0x7fc488144360 2024-03-07T07:32:05.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc484c00640 1 -- 172.21.15.84:0/3481150165 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc480016150 con 0x7fc488144360 2024-03-07T07:32:05.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc464066f60 msgr2=0x7fc464069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc464066f60 0x7fc464069420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc48813af50 tx=0x7fc4780098d0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc488144360 msgr2=0x7fc48815a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc488144360 0x7fc48815a6e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc4800ab040 tx=0x7fc48001ad70 comp rx=0 tx=0).stop 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 shutdown_connections 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc464066f60 0x7fc464069420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc488144360 0x7fc48815a6e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc488143dd0 0x7fc48813fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 --2- 172.21.15.84:0/3481150165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4880730e0 0x7fc4880ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 >> 172.21.15.84:0/3481150165 conn(0x7fc4880704b0 msgr2=0x7fc4880ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 shutdown_connections 2024-03-07T07:32:05.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.841+0000 7fc48ee00640 1 -- 172.21.15.84:0/3481150165 wait complete. 2024-03-07T07:32:05.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-07T07:32:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3eae00640 1 Processor -- start 2024-03-07T07:32:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3eae00640 1 -- start start 2024-03-07T07:32:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3eae00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e406efe0 0x7fc3e41653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3eae00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e40cd6c0 con 0x7fc3e41408e0 2024-03-07T07:32:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3eae00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e406d230 con 0x7fc3e4143a00 2024-03-07T07:32:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3eae00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40ce680 con 0x7fc3e406efe0 2024-03-07T07:32:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e3e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc3e41408e0 0x7fc3e40cc8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41324/0 (socket says 172.21.15.84:41324) 2024-03-07T07:32:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e3e00640 1 -- 172.21.15.84:0/946735625 learned_addr learned my addr 172.21.15.84:0/946735625 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e8e00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e406efe0 0x7fc3e41653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263079309 0 0) 0x7fc3e40cd6c0 con 0x7fc3e41408e0 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3c8003530 con 0x7fc3e41408e0 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 962876928 0 0) 0x7fc3c8003530 con 0x7fc3e41408e0 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e406efe0 msgr2=0x7fc3e41653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e406efe0 0x7fc3e41653f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 >> v1:172.21.15.161:6789/0 conn(0x7fc3e4143a00 legacy=0x7fc3e40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e406d4f0 con 0x7fc3e41408e0 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7fc3d4001680 con 0x7fc3e41408e0 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 >> v1:172.21.15.84:6789/0 conn(0x7fc3e41408e0 legacy=0x7fc3e40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e406efe0 0x7fc3c80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8004d50 0x7fc3c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40ce680 con 0x7fc3c8003f30 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c800ba30 con 0x7fc3c8004d50 2024-03-07T07:32:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c800bc30 con 0x7fc3e406efe0 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e3400640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:05.997+0000 7fc3e3e00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e406efe0 0x7fc3c80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e8e00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8004d50 0x7fc3c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e3400640 1 -- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e406efe0 msgr2=0x7fc3c80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e3400640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e406efe0 0x7fc3c80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e3400640 1 -- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8004d50 msgr2=0x7fc3c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e3400640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8004d50 0x7fc3c80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e3400640 1 -- 172.21.15.84:0/946735625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8003530 con 0x7fc3c8003f30 2024-03-07T07:32:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e8e00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8004d50 0x7fc3c80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:06.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e3400640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3c8004810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4067c10 tx=0x7fc3d001eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae2e0b1de9273df server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00b5070 con 0x7fc3c8003f30 2024-03-07T07:32:06.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00a8790 con 0x7fc3c8003f30 2024-03-07T07:32:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e2a00640 1 -- 172.21.15.84:0/946735625 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0001460 con 0x7fc3c8003f30 2024-03-07T07:32:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3eae00640 1 -- 172.21.15.84:0/946735625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 msgr2=0x7fc3c8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3eae00640 1 --2- 172.21.15.84:0/946735625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3c8004810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4067c10 tx=0x7fc3d001eb70 comp rx=0 tx=0).stop 2024-03-07T07:32:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3e8e00640 1 -- 172.21.15.84:0/946735625 reap_dead start 2024-03-07T07:32:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3eae00640 1 -- 172.21.15.84:0/946735625 shutdown_connections 2024-03-07T07:32:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3eae00640 1 -- 172.21.15.84:0/946735625 >> 172.21.15.84:0/946735625 conn(0x7fc3e40704b0 msgr2=0x7fc3e40708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.001+0000 7fc3eae00640 1 -- 172.21.15.84:0/946735625 shutdown_connections 2024-03-07T07:32:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 -- 172.21.15.84:0/946735625 wait complete. 2024-03-07T07:32:06.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 Processor -- start 2024-03-07T07:32:06.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 -- start start 2024-03-07T07:32:06.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3e414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e4150720 0x7fc3e413caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e4155d30 0x7fc3e4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4140cc0 con 0x7fc3c8003f30 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e406dab0 con 0x7fc3e4155d30 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40ce2c0 con 0x7fc3e4150720 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3e414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3e414f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40922/0 (socket says 172.21.15.84:40922) 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 -- 172.21.15.84:0/3018477102 learned_addr learned my addr 172.21.15.84:0/3018477102 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 -- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e4150720 msgr2=0x7fc3e413caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e8e00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e4155d30 0x7fc3e4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3400640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e4150720 0x7fc3e413caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e4150720 0x7fc3e413caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 -- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e4155d30 msgr2=0x7fc3e4152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e4155d30 0x7fc3e4152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 -- 172.21.15.84:0/3018477102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e415ee60 con 0x7fc3c8003f30 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e8e00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e4155d30 0x7fc3e4152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3e3e00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3e414f2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40072f0 tx=0x7fc3d40077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3dbe00640 1 -- 172.21.15.84:0/3018477102 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d401a070 con 0x7fc3c8003f30 2024-03-07T07:32:06.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3dbe00640 1 -- 172.21.15.84:0/3018477102 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d400f960 con 0x7fc3c8003f30 2024-03-07T07:32:06.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3dbe00640 1 -- 172.21.15.84:0/3018477102 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400fd50 con 0x7fc3c8003f30 2024-03-07T07:32:06.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e414fd90 con 0x7fc3c8003f30 2024-03-07T07:32:06.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.005+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e4150330 con 0x7fc3c8003f30 2024-03-07T07:32:06.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.009+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e4150530 con 0x7fc3c8003f30 2024-03-07T07:32:06.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.009+0000 7fc3dbe00640 1 -- 172.21.15.84:0/3018477102 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc3d401d070 con 0x7fc3c8003f30 2024-03-07T07:32:06.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.009+0000 7fc3dbe00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3c4066f60 0x7fc3c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.009+0000 7fc3dbe00640 1 -- 172.21.15.84:0/3018477102 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc3d4084680 con 0x7fc3c8003f30 2024-03-07T07:32:06.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.009+0000 7fc3e3400640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3c4066f60 0x7fc3c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.009+0000 7fc3e3400640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3c4066f60 0x7fc3c4069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00b2000 tx=0x7fc3d00aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.013+0000 7fc3dbe00640 1 -- 172.21.15.84:0/3018477102 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc3d40559d0 con 0x7fc3c8003f30 2024-03-07T07:32:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.221+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc3e4062d40 con 0x7fc3c8003f30 2024-03-07T07:32:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.221+0000 7fc3dbe00640 1 -- 172.21.15.84:0/3018477102 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc3d40552d0 con 0x7fc3c8003f30 2024-03-07T07:32:06.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3c4066f60 msgr2=0x7fc3c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3c4066f60 0x7fc3c4069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00b2000 tx=0x7fc3d00aa070 comp rx=0 tx=0).stop 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 msgr2=0x7fc3e414f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3e414f2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40072f0 tx=0x7fc3d40077b0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 shutdown_connections 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc3c4066f60 0x7fc3c4069420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e4155d30 0x7fc3e4152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e4150720 0x7fc3e413caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 --2- 172.21.15.84:0/3018477102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c8003f30 0x7fc3e414f2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 >> 172.21.15.84:0/3018477102 conn(0x7fc3e40704b0 msgr2=0x7fc3e40b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 shutdown_connections 2024-03-07T07:32:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.225+0000 7fc3eae00640 1 -- 172.21.15.84:0/3018477102 wait complete. 2024-03-07T07:32:06.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:32:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.377+0000 7f3f2ae00640 1 Processor -- start 2024-03-07T07:32:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.377+0000 7f3f2ae00640 1 -- start start 2024-03-07T07:32:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f2ae00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3f24145a30 0x7f3f240729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f2ae00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2406d230 0x7f3f24072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f2ae00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2406d780 con 0x7f3f240a9540 2024-03-07T07:32:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f2ae00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2406da60 con 0x7f3f24145a30 2024-03-07T07:32:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f2ae00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2406dd40 con 0x7f3f2406d230 2024-03-07T07:32:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f1b400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3f240a9540 0x7f3f240ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41342/0 (socket says 172.21.15.84:41342) 2024-03-07T07:32:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f1b400640 1 -- 172.21.15.84:0/1188706073 learned_addr learned my addr 172.21.15.84:0/1188706073 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f23e00640 1 --2- 172.21.15.84:0/1188706073 >> v2:172.21.15.84:3300/0 conn(0x7f3f24145a30 0x7f3f240729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f28e00640 1 --2- 172.21.15.84:0/1188706073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2406d230 0x7f3f24072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f23400640 1 -- 172.21.15.84:0/1188706073 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990029438 0 0) 0x7f3f2406d780 con 0x7f3f240a9540 2024-03-07T07:32:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f23400640 1 -- 172.21.15.84:0/1188706073 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f08003530 con 0x7f3f240a9540 2024-03-07T07:32:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f23e00640 1 -- 172.21.15.84:0/1188706073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2406d230 msgr2=0x7f3f24072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f23e00640 1 --2- 172.21.15.84:0/1188706073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2406d230 0x7f3f24072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f23e00640 1 -- 172.21.15.84:0/1188706073 >> v1:172.21.15.84:6789/0 conn(0x7f3f240a9540 legacy=0x7f3f240ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f23e00640 1 -- 172.21.15.84:0/1188706073 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2406e020 con 0x7f3f24145a30 2024-03-07T07:32:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.381+0000 7f3f23e00640 1 --2- 172.21.15.84:0/1188706073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f24145a30 0x7f3f240729d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009d90 tx=0x7f3f1401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ad9fb9f4edb425 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f23400640 1 -- 172.21.15.84:0/1188706073 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140b2070 con 0x7f3f24145a30 2024-03-07T07:32:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f23400640 1 -- 172.21.15.84:0/1188706073 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f140a5820 con 0x7f3f24145a30 2024-03-07T07:32:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f23400640 1 -- 172.21.15.84:0/1188706073 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140a5bf0 con 0x7f3f24145a30 2024-03-07T07:32:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- 172.21.15.84:0/1188706073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f24145a30 msgr2=0x7f3f240729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/1188706073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f24145a30 0x7f3f240729d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009d90 tx=0x7f3f1401c850 comp rx=0 tx=0).stop 2024-03-07T07:32:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- 172.21.15.84:0/1188706073 shutdown_connections 2024-03-07T07:32:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/1188706073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2406d230 0x7f3f24072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/1188706073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f24145a30 0x7f3f240729d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- 172.21.15.84:0/1188706073 >> 172.21.15.84:0/1188706073 conn(0x7f3f240704b0 msgr2=0x7f3f240708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- 172.21.15.84:0/1188706073 shutdown_connections 2024-03-07T07:32:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- 172.21.15.84:0/1188706073 wait complete. 2024-03-07T07:32:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 Processor -- start 2024-03-07T07:32:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- start start 2024-03-07T07:32:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2406d230 0x7f3f24160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f24145a30 0x7f3f2413f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2415dfd0 0x7f3f2415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24168d60 con 0x7f3f2406d230 2024-03-07T07:32:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24168be0 con 0x7f3f2415dfd0 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f2ae00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24168ee0 con 0x7f3f24145a30 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f23e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2406d230 0x7f3f24160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f23e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2406d230 0x7f3f24160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40946/0 (socket says 172.21.15.84:40946) 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f23e00640 1 -- 172.21.15.84:0/2088855506 learned_addr learned my addr 172.21.15.84:0/2088855506 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f1b400640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f24145a30 0x7f3f2413f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.385+0000 7f3f28e00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2415dfd0 0x7f3f2415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f23e00640 1 -- 172.21.15.84:0/2088855506 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f24145a30 msgr2=0x7f3f2413f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f23e00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f24145a30 0x7f3f2413f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f23e00640 1 -- 172.21.15.84:0/2088855506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2415dfd0 msgr2=0x7f3f2415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f23e00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2415dfd0 0x7f3f2415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f23e00640 1 -- 172.21.15.84:0/2088855506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f240acf10 con 0x7f3f2406d230 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f23e00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2406d230 0x7f3f24160580 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f140b0040 tx=0x7f3f140195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f20c00640 1 -- 172.21.15.84:0/2088855506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140b2050 con 0x7f3f2406d230 2024-03-07T07:32:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f20c00640 1 -- 172.21.15.84:0/2088855506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f140be070 con 0x7f3f2406d230 2024-03-07T07:32:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f20c00640 1 -- 172.21.15.84:0/2088855506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14009450 con 0x7f3f2406d230 2024-03-07T07:32:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f240ad1f0 con 0x7f3f2406d230 2024-03-07T07:32:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f240ad7b0 con 0x7f3f2406d230 2024-03-07T07:32:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f24062d40 con 0x7f3f2406d230 2024-03-07T07:32:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f20c00640 1 -- 172.21.15.84:0/2088855506 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f3f140adcc0 con 0x7f3f2406d230 2024-03-07T07:32:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f20c00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f00066f60 0x7f3f00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f20c00640 1 -- 172.21.15.84:0/2088855506 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f1411fea0 con 0x7f3f2406d230 2024-03-07T07:32:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.389+0000 7f3f1b400640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f00066f60 0x7f3f00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.393+0000 7f3f1b400640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f00066f60 0x7f3f00069420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f24073190 tx=0x7f3f0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.393+0000 7f3f20c00640 1 -- 172.21.15.84:0/2088855506 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f3f14016560 con 0x7f3f2406d230 2024-03-07T07:32:06.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.545+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f2406f420 con 0x7f3f2406d230 2024-03-07T07:32:06.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f20c00640 1 -- 172.21.15.84:0/2088855506 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12855 (secure 0 0 0) 0x7f3f140f1160 con 0x7f3f2406d230 2024-03-07T07:32:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:06.549 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":30,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:32:03.541483+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:32:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f00066f60 msgr2=0x7f3f00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f00066f60 0x7f3f00069420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f24073190 tx=0x7f3f0c009040 comp rx=0 tx=0).stop 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2406d230 msgr2=0x7f3f24160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2406d230 0x7f3f24160580 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f140b0040 tx=0x7f3f140195f0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 shutdown_connections 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3f00066f60 0x7f3f00069420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2415dfd0 0x7f3f2415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f24145a30 0x7f3f2413f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 --2- 172.21.15.84:0/2088855506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f2406d230 0x7f3f24160580 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 >> 172.21.15.84:0/2088855506 conn(0x7f3f240704b0 msgr2=0x7f3f24143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 shutdown_connections 2024-03-07T07:32:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.549+0000 7f3f2ae00640 1 -- 172.21.15.84:0/2088855506 wait complete. 2024-03-07T07:32:06.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:32:06.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:32:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e32000640 1 Processor -- start 2024-03-07T07:32:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e32000640 1 -- start start 2024-03-07T07:32:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e32000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c09ac40 0x7f7e2c0cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e32000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e2c15fa50 0x7f7e2c06c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e32000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0d0720 con 0x7f7e2c0b46c0 2024-03-07T07:32:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e32000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0d0ce0 con 0x7f7e2c15fa50 2024-03-07T07:32:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e32000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c06b6e0 con 0x7f7e2c09ac40 2024-03-07T07:32:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e23e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7e2c0b46c0 0x7f7e2c15f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41354/0 (socket says 172.21.15.84:41354) 2024-03-07T07:32:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e23e00640 1 -- 172.21.15.84:0/614204824 learned_addr learned my addr 172.21.15.84:0/614204824 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e2be00640 1 --2- 172.21.15.84:0/614204824 >> v2:172.21.15.84:3300/0 conn(0x7f7e2c15fa50 0x7f7e2c06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e2b400640 1 --2- 172.21.15.84:0/614204824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c09ac40 0x7f7e2c0cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e2aa00640 1 -- 172.21.15.84:0/614204824 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108104672 0 0) 0x7f7e2c0d0720 con 0x7f7e2c0b46c0 2024-03-07T07:32:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e2aa00640 1 -- 172.21.15.84:0/614204824 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e10003530 con 0x7f7e2c0b46c0 2024-03-07T07:32:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e2be00640 1 -- 172.21.15.84:0/614204824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c09ac40 msgr2=0x7f7e2c0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e2be00640 1 --2- 172.21.15.84:0/614204824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c09ac40 0x7f7e2c0cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e2be00640 1 -- 172.21.15.84:0/614204824 >> v1:172.21.15.84:6789/0 conn(0x7f7e2c0b46c0 legacy=0x7f7e2c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.709+0000 7f7e2be00640 1 -- 172.21.15.84:0/614204824 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0d0a00 con 0x7f7e2c15fa50 2024-03-07T07:32:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e2be00640 1 --2- 172.21.15.84:0/614204824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c15fa50 0x7f7e2c06c130 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009d90 tx=0x7f7e2401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4212d718bdc03dc server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e2aa00640 1 -- 172.21.15.84:0/614204824 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e240b2070 con 0x7f7e2c15fa50 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e2aa00640 1 -- 172.21.15.84:0/614204824 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e240a5830 con 0x7f7e2c15fa50 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e2aa00640 1 -- 172.21.15.84:0/614204824 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e240a5c00 con 0x7f7e2c15fa50 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 -- 172.21.15.84:0/614204824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c15fa50 msgr2=0x7f7e2c06c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 --2- 172.21.15.84:0/614204824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c15fa50 0x7f7e2c06c130 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009d90 tx=0x7f7e2401c970 comp rx=0 tx=0).stop 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 -- 172.21.15.84:0/614204824 shutdown_connections 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 --2- 172.21.15.84:0/614204824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c15fa50 0x7f7e2c06c130 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 --2- 172.21.15.84:0/614204824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c09ac40 0x7f7e2c0cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 -- 172.21.15.84:0/614204824 >> 172.21.15.84:0/614204824 conn(0x7f7e2c0b3ba0 msgr2=0x7f7e2c0b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 -- 172.21.15.84:0/614204824 shutdown_connections 2024-03-07T07:32:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 -- 172.21.15.84:0/614204824 wait complete. 2024-03-07T07:32:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 Processor -- start 2024-03-07T07:32:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.713+0000 7f7e32000640 1 -- start start 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c09ac40 0x7f7e2c0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e2c0b46c0 0x7f7e2c0b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c15fa50 0x7f7e2c15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c06d210 con 0x7f7e2c09ac40 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c06d090 con 0x7f7e2c0b46c0 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c06d390 con 0x7f7e2c15fa50 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c09ac40 0x7f7e2c0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c09ac40 0x7f7e2c0cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40976/0 (socket says 172.21.15.84:40976) 2024-03-07T07:32:06.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 -- 172.21.15.84:0/1332739384 learned_addr learned my addr 172.21.15.84:0/1332739384 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e23e00640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e2c0b46c0 0x7f7e2c0b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2be00640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c15fa50 0x7f7e2c15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 -- 172.21.15.84:0/1332739384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c15fa50 msgr2=0x7f7e2c15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c15fa50 0x7f7e2c15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 -- 172.21.15.84:0/1332739384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e2c0b46c0 msgr2=0x7f7e2c0b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e2c0b46c0 0x7f7e2c0b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 -- 172.21.15.84:0/1332739384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c158c00 con 0x7f7e2c09ac40 2024-03-07T07:32:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e2b400640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c09ac40 0x7f7e2c0cb020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00d5f0 tx=0x7f7e1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e23400640 1 -- 172.21.15.84:0/1332739384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0125f0 con 0x7f7e2c09ac40 2024-03-07T07:32:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e23400640 1 -- 172.21.15.84:0/1332739384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c019070 con 0x7f7e2c09ac40 2024-03-07T07:32:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e23400640 1 -- 172.21.15.84:0/1332739384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0129b0 con 0x7f7e2c09ac40 2024-03-07T07:32:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c0b5b40 con 0x7f7e2c09ac40 2024-03-07T07:32:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c0b63e0 con 0x7f7e2c09ac40 2024-03-07T07:32:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c062d40 con 0x7f7e2c09ac40 2024-03-07T07:32:06.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.717+0000 7f7e23400640 1 -- 172.21.15.84:0/1332739384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f7e1c012b50 con 0x7f7e2c09ac40 2024-03-07T07:32:06.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.721+0000 7f7e23400640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7e08066f60 0x7f7e08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:06.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.721+0000 7f7e23400640 1 -- 172.21.15.84:0/1332739384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e1c0851a0 con 0x7f7e2c09ac40 2024-03-07T07:32:06.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.721+0000 7f7e23e00640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7e08066f60 0x7f7e08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:06.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.721+0000 7f7e23e00640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7e08066f60 0x7f7e08069420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c1524d0 tx=0x7f7e14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.725+0000 7f7e23400640 1 -- 172.21.15.84:0/1332739384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f7e2c158c00 con 0x7f7e2c09ac40 2024-03-07T07:32:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.877+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e2c0b1d70 con 0x7f7e2c09ac40 2024-03-07T07:32:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e23400640 1 -- 172.21.15.84:0/1332739384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e1c056460 con 0x7f7e2c09ac40 2024-03-07T07:32:06.881 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:32:06.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7e08066f60 msgr2=0x7f7e08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7e08066f60 0x7f7e08069420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c1524d0 tx=0x7f7e14009040 comp rx=0 tx=0).stop 2024-03-07T07:32:06.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c09ac40 msgr2=0x7f7e2c0cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c09ac40 0x7f7e2c0cb020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00d5f0 tx=0x7f7e1c00dab0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 shutdown_connections 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f7e08066f60 0x7f7e08069420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e2c15fa50 0x7f7e2c15ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e2c0b46c0 0x7f7e2c0b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 --2- 172.21.15.84:0/1332739384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e2c09ac40 0x7f7e2c0cb020 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 >> 172.21.15.84:0/1332739384 conn(0x7f7e2c0b3ba0 msgr2=0x7f7e2c0af170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 shutdown_connections 2024-03-07T07:32:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:06.881+0000 7f7e32000640 1 -- 172.21.15.84:0/1332739384 wait complete. 2024-03-07T07:32:06.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-07T07:32:07.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.033+0000 7fed6ba00640 1 Processor -- start 2024-03-07T07:32:07.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed6ba00640 1 -- start start 2024-03-07T07:32:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed6ba00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fed64147d10 0x7fed640b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed6ba00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed640d07c0 0x7fed640b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed6ba00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed640724f0 con 0x7fed64071600 2024-03-07T07:32:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed6ba00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed641480f0 con 0x7fed64147d10 2024-03-07T07:32:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed6ba00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed640b0f80 con 0x7fed640d07c0 2024-03-07T07:32:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed69000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fed64147d10 0x7fed640b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed63e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fed64071600 0x7fed640aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41356/0 (socket says 172.21.15.84:41356) 2024-03-07T07:32:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed63e00640 1 -- 172.21.15.84:0/3127270697 learned_addr learned my addr 172.21.15.84:0/3127270697 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed69a00640 1 --2- 172.21.15.84:0/3127270697 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed640d07c0 0x7fed640b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed69000640 1 -- 172.21.15.84:0/3127270697 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed640d07c0 msgr2=0x7fed640b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed69000640 1 --2- 172.21.15.84:0/3127270697 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed640d07c0 0x7fed640b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed69000640 1 -- 172.21.15.84:0/3127270697 >> v1:172.21.15.84:6789/0 conn(0x7fed64071600 legacy=0x7fed640aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed63400640 1 -- 172.21.15.84:0/3127270697 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114214809 0 0) 0x7fed50001120 con 0x7fed64071600 2024-03-07T07:32:07.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.037+0000 7fed69000640 1 -- 172.21.15.84:0/3127270697 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640732f0 con 0x7fed64147d10 2024-03-07T07:32:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed69000640 1 --2- 172.21.15.84:0/3127270697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64147d10 0x7fed640b01c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fed580097c0 tx=0x7fed5801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422294534fe6a36d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed63400640 1 -- 172.21.15.84:0/3127270697 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580b5070 con 0x7fed64147d10 2024-03-07T07:32:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed63400640 1 -- 172.21.15.84:0/3127270697 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed580a8990 con 0x7fed64147d10 2024-03-07T07:32:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed63400640 1 -- 172.21.15.84:0/3127270697 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580a8d60 con 0x7fed64147d10 2024-03-07T07:32:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 -- 172.21.15.84:0/3127270697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64147d10 msgr2=0x7fed640b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 --2- 172.21.15.84:0/3127270697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64147d10 0x7fed640b01c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fed580097c0 tx=0x7fed5801ec90 comp rx=0 tx=0).stop 2024-03-07T07:32:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 -- 172.21.15.84:0/3127270697 shutdown_connections 2024-03-07T07:32:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 --2- 172.21.15.84:0/3127270697 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed640d07c0 0x7fed640b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 --2- 172.21.15.84:0/3127270697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64147d10 0x7fed640b01c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 -- 172.21.15.84:0/3127270697 >> 172.21.15.84:0/3127270697 conn(0x7fed640b1ed0 msgr2=0x7fed640b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 -- 172.21.15.84:0/3127270697 shutdown_connections 2024-03-07T07:32:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 -- 172.21.15.84:0/3127270697 wait complete. 2024-03-07T07:32:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 Processor -- start 2024-03-07T07:32:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.041+0000 7fed6ba00640 1 -- start start 2024-03-07T07:32:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64071600 0x7fed64157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed640d07c0 0x7fed640cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed64147d10 0x7fed640cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64072d30 con 0x7fed64071600 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64072a50 con 0x7fed640d07c0 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed64073010 con 0x7fed64147d10 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64071600 0x7fed64157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64071600 0x7fed64157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40984/0 (socket says 172.21.15.84:40984) 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 -- 172.21.15.84:0/1469126842 learned_addr learned my addr 172.21.15.84:0/1469126842 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69a00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed64147d10 0x7fed640cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed63e00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed640d07c0 0x7fed640cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 -- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed64147d10 msgr2=0x7fed640cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed64147d10 0x7fed640cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 -- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed640d07c0 msgr2=0x7fed640cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed640d07c0 0x7fed640cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 -- 172.21.15.84:0/1469126842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640cc490 con 0x7fed64071600 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed63e00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed640d07c0 0x7fed640cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed69000640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64071600 0x7fed64157a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fed5801c8c0 tx=0x7fed5801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed60c00640 1 -- 172.21.15.84:0/1469126842 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580b5040 con 0x7fed64071600 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed60c00640 1 -- 172.21.15.84:0/1469126842 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed580bf070 con 0x7fed64071600 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed640cc720 con 0x7fed64071600 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed60c00640 1 -- 172.21.15.84:0/1469126842 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580b0960 con 0x7fed64071600 2024-03-07T07:32:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed640ccce0 con 0x7fed64071600 2024-03-07T07:32:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed64062d40 con 0x7fed64071600 2024-03-07T07:32:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.045+0000 7fed60c00640 1 -- 172.21.15.84:0/1469126842 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fed580b0b00 con 0x7fed64071600 2024-03-07T07:32:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.049+0000 7fed60c00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fed44066f60 0x7fed44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.049+0000 7fed60c00640 1 -- 172.21.15.84:0/1469126842 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed58122210 con 0x7fed64071600 2024-03-07T07:32:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.049+0000 7fed63e00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fed44066f60 0x7fed44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.049+0000 7fed63e00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fed44066f60 0x7fed44069420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed50007fd0 tx=0x7fed50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.053+0000 7fed60c00640 1 -- 172.21.15.84:0/1469126842 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fed580187f0 con 0x7fed64071600 2024-03-07T07:32:07.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.205+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fed640b3890 con 0x7fed64071600 2024-03-07T07:32:07.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.205+0000 7fed60c00640 1 -- 172.21.15.84:0/1469126842 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fed580f34d0 con 0x7fed64071600 2024-03-07T07:32:07.208 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:07.212 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2024-03-07T07:32:07.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-07T07:32:07.212 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2024-03-07T07:32:07.212 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2024-03-07T07:32:07.212 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-07T07:32:07.212 INFO:teuthology.orchestra.run.smithi084.stdout:] 2024-03-07T07:32:07.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fed44066f60 msgr2=0x7fed44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fed44066f60 0x7fed44069420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed50007fd0 tx=0x7fed50009040 comp rx=0 tx=0).stop 2024-03-07T07:32:07.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64071600 msgr2=0x7fed64157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64071600 0x7fed64157a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fed5801c8c0 tx=0x7fed5801ba30 comp rx=0 tx=0).stop 2024-03-07T07:32:07.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 shutdown_connections 2024-03-07T07:32:07.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fed44066f60 0x7fed44069420 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed64147d10 0x7fed640cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed640d07c0 0x7fed640cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 --2- 172.21.15.84:0/1469126842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed64071600 0x7fed64157a10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 >> 172.21.15.84:0/1469126842 conn(0x7fed640b1ed0 msgr2=0x7fed6406c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:07.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 shutdown_connections 2024-03-07T07:32:07.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.209+0000 7fed6ba00640 1 -- 172.21.15.84:0/1469126842 wait complete. 2024-03-07T07:32:07.229 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-07T07:32:07.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-07T07:32:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.365+0000 7f2482800640 1 Processor -- start 2024-03-07T07:32:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.365+0000 7f2482800640 1 -- start start 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.365+0000 7f2482800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f2482800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f247c0b3500 0x7f247c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f2482800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c071f50 con 0x7f247c071af0 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f2482800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c0b4290 con 0x7f247c0b3500 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f2482800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0b4550 con 0x7f247c143e30 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247be00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f247c0b3500 0x7f247c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247be00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f247c0b3500 0x7f247c06e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40996/0 (socket says 172.21.15.84:40996) 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247be00640 1 -- 172.21.15.84:0/1870091714 learned_addr learned my addr 172.21.15.84:0/1870091714 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247b400640 1 --2- 172.21.15.84:0/1870091714 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247be00640 1 -- 172.21.15.84:0/1870091714 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 msgr2=0x7f247c0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247be00640 1 --2- 172.21.15.84:0/1870091714 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247be00640 1 -- 172.21.15.84:0/1870091714 >> v1:172.21.15.161:6789/0 conn(0x7f247c071af0 legacy=0x7f247c0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247be00640 1 -- 172.21.15.84:0/1870091714 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0b4830 con 0x7f247c0b3500 2024-03-07T07:32:07.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247be00640 1 --2- 172.21.15.84:0/1870091714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c06e370 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2474009e50 tx=0x7f247401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b6a28a83fa96cf server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247aa00640 1 -- 172.21.15.84:0/1870091714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740a5820 con 0x7f247c0b3500 2024-03-07T07:32:07.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.369+0000 7f247aa00640 1 -- 172.21.15.84:0/1870091714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24740a59c0 con 0x7f247c0b3500 2024-03-07T07:32:07.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f247aa00640 1 -- 172.21.15.84:0/1870091714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740a5d90 con 0x7f247c0b3500 2024-03-07T07:32:07.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- 172.21.15.84:0/1870091714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 msgr2=0x7f247c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 --2- 172.21.15.84:0/1870091714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c06e370 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2474009e50 tx=0x7f247401ca30 comp rx=0 tx=0).stop 2024-03-07T07:32:07.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- 172.21.15.84:0/1870091714 shutdown_connections 2024-03-07T07:32:07.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 --2- 172.21.15.84:0/1870091714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c06e370 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 --2- 172.21.15.84:0/1870091714 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- 172.21.15.84:0/1870091714 >> 172.21.15.84:0/1870091714 conn(0x7f247c0cc840 msgr2=0x7f247c0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:07.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- 172.21.15.84:0/1870091714 shutdown_connections 2024-03-07T07:32:07.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- 172.21.15.84:0/1870091714 wait complete. 2024-03-07T07:32:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 Processor -- start 2024-03-07T07:32:07.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- start start 2024-03-07T07:32:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f247c071af0 0x7f247c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c1f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c06f450 con 0x7f247c0b3500 2024-03-07T07:32:07.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c06f2d0 con 0x7f247c071af0 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2482800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c167cc0 con 0x7f247c143e30 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2472a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c1f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2472a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c1f7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40998/0 (socket says 172.21.15.84:40998) 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2472a00640 1 -- 172.21.15.84:0/1674121101 learned_addr learned my addr 172.21.15.84:0/1674121101 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f247be00640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f247b400640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f247c071af0 0x7f247c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2472a00640 1 -- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 msgr2=0x7f247c0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2472a00640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2472a00640 1 -- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f247c071af0 msgr2=0x7f247c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2472a00640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f247c071af0 0x7f247c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f2472a00640 1 -- 172.21.15.84:0/1674121101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c159f00 con 0x7f247c0b3500 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f247be00640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.373+0000 7f247b400640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f247c071af0 0x7f247c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:07.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2472a00640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c1f7b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f246400c500 tx=0x7f246400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2473e00640 1 -- 172.21.15.84:0/1674121101 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464016020 con 0x7f247c0b3500 2024-03-07T07:32:07.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2473e00640 1 -- 172.21.15.84:0/1674121101 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2464005220 con 0x7f247c0b3500 2024-03-07T07:32:07.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c15a1e0 con 0x7f247c0b3500 2024-03-07T07:32:07.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2473e00640 1 -- 172.21.15.84:0/1674121101 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464007030 con 0x7f247c0b3500 2024-03-07T07:32:07.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c1f7670 con 0x7f247c0b3500 2024-03-07T07:32:07.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c1f7870 con 0x7f247c0b3500 2024-03-07T07:32:07.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2473e00640 1 -- 172.21.15.84:0/1674121101 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f24640071d0 con 0x7f247c0b3500 2024-03-07T07:32:07.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2473e00640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2458066f60 0x7f2458069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f2473e00640 1 -- 172.21.15.84:0/1674121101 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2464084760 con 0x7f247c0b3500 2024-03-07T07:32:07.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.377+0000 7f247b400640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2458066f60 0x7f2458069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.381+0000 7f247b400640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2458066f60 0x7f2458069420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f246c009a40 tx=0x7f246c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.381+0000 7f2473e00640 1 -- 172.21.15.84:0/1674121101 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f247c1f7870 con 0x7f247c0b3500 2024-03-07T07:32:07.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.537+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f247c062d40 con 0x7f247c0b3500 2024-03-07T07:32:07.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2473e00640 1 -- 172.21.15.84:0/1674121101 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2464020020 con 0x7f247c0b3500 2024-03-07T07:32:07.693 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2024-03-07T07:32:07.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2458066f60 msgr2=0x7f2458069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2458066f60 0x7f2458069420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f246c009a40 tx=0x7f246c008040 comp rx=0 tx=0).stop 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 msgr2=0x7f247c1f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c1f7b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f246400c500 tx=0x7f246400c9c0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 shutdown_connections 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2458066f60 0x7f2458069420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f247c143e30 0x7f247c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f247c0b3500 0x7f247c1f7b90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 --2- 172.21.15.84:0/1674121101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f247c071af0 0x7f247c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 >> 172.21.15.84:0/1674121101 conn(0x7f247c0cc840 msgr2=0x7f247c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 shutdown_connections 2024-03-07T07:32:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.693+0000 7f2482800640 1 -- 172.21.15.84:0/1674121101 wait complete. 2024-03-07T07:32:07.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-07T07:32:07.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe65d000640 1 Processor -- start 2024-03-07T07:32:07.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe65d000640 1 -- start start 2024-03-07T07:32:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe65d000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe65815c3d0 0x7fe6580cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe65d000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6580cd950 0x7fe6580724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe65d000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6580b4a60 con 0x7fe658145090 2024-03-07T07:32:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe65d000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6580cddc0 con 0x7fe65815c3d0 2024-03-07T07:32:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe65d000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580b4d40 con 0x7fe6580cd950 2024-03-07T07:32:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe64fe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe65815c3d0 0x7fe6580cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe64fe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe65815c3d0 0x7fe6580cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41004/0 (socket says 172.21.15.84:41004) 2024-03-07T07:32:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe64fe00640 1 -- 172.21.15.84:0/2089773056 learned_addr learned my addr 172.21.15.84:0/2089773056 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe656800640 1 --2- 172.21.15.84:0/2089773056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6580cd950 0x7fe6580724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe64fe00640 1 -- 172.21.15.84:0/2089773056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6580cd950 msgr2=0x7fe6580724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe64fe00640 1 --2- 172.21.15.84:0/2089773056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6580cd950 0x7fe6580724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe64fe00640 1 -- 172.21.15.84:0/2089773056 >> v1:172.21.15.161:6789/0 conn(0x7fe658145090 legacy=0x7fe6580cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.861+0000 7fe64fe00640 1 -- 172.21.15.84:0/2089773056 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580719c0 con 0x7fe65815c3d0 2024-03-07T07:32:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe64fe00640 1 --2- 172.21.15.84:0/2089773056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65815c3d0 0x7fe6580cd410 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe658160a60 tx=0x7fe64001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a1f3094c31e94a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe655400640 1 -- 172.21.15.84:0/2089773056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6400a7070 con 0x7fe65815c3d0 2024-03-07T07:32:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe655400640 1 -- 172.21.15.84:0/2089773056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6400b0070 con 0x7fe65815c3d0 2024-03-07T07:32:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe655400640 1 -- 172.21.15.84:0/2089773056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6400ab890 con 0x7fe65815c3d0 2024-03-07T07:32:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 -- 172.21.15.84:0/2089773056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65815c3d0 msgr2=0x7fe6580cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 --2- 172.21.15.84:0/2089773056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65815c3d0 0x7fe6580cd410 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe658160a60 tx=0x7fe64001c4b0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 -- 172.21.15.84:0/2089773056 shutdown_connections 2024-03-07T07:32:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 --2- 172.21.15.84:0/2089773056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6580cd950 0x7fe6580724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 --2- 172.21.15.84:0/2089773056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65815c3d0 0x7fe6580cd410 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 -- 172.21.15.84:0/2089773056 >> 172.21.15.84:0/2089773056 conn(0x7fe6580b1c50 msgr2=0x7fe6580b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 -- 172.21.15.84:0/2089773056 shutdown_connections 2024-03-07T07:32:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 -- 172.21.15.84:0/2089773056 wait complete. 2024-03-07T07:32:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 Processor -- start 2024-03-07T07:32:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.865+0000 7fe65d000640 1 -- start start 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6580cd950 0x7fe65815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe658145090 0x7fe658142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe65815c3d0 0x7fe658142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe658145830 con 0x7fe658145090 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580b4710 con 0x7fe6580cd950 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6581459b0 con 0x7fe65815c3d0 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe658145090 0x7fe658142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe658145090 0x7fe658142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41006/0 (socket says 172.21.15.84:41006) 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 -- 172.21.15.84:0/1535246168 learned_addr learned my addr 172.21.15.84:0/1535246168 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe656800640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe65815c3d0 0x7fe658142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe655e00640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6580cd950 0x7fe65815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 -- 172.21.15.84:0/1535246168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe65815c3d0 msgr2=0x7fe658142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe65815c3d0 0x7fe658142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 -- 172.21.15.84:0/1535246168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6580cd950 msgr2=0x7fe65815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6580cd950 0x7fe65815aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 -- 172.21.15.84:0/1535246168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6581417d0 con 0x7fe658145090 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64fe00640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe658145090 0x7fe658142690 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe64001cd50 tx=0x7fe640019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64e000640 1 -- 172.21.15.84:0/1535246168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6400bf610 con 0x7fe658145090 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64e000640 1 -- 172.21.15.84:0/1535246168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6400bf7d0 con 0x7fe658145090 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65813dd70 con 0x7fe658145090 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64e000640 1 -- 172.21.15.84:0/1535246168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6400bfbc0 con 0x7fe658145090 2024-03-07T07:32:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65813e330 con 0x7fe658145090 2024-03-07T07:32:07.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe658062d40 con 0x7fe658145090 2024-03-07T07:32:07.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.869+0000 7fe64e000640 1 -- 172.21.15.84:0/1535246168 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe6400bd020 con 0x7fe658145090 2024-03-07T07:32:07.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.873+0000 7fe64e000640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe634066f90 0x7fe634069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:07.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.873+0000 7fe64e000640 1 -- 172.21.15.84:0/1535246168 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe64011fb70 con 0x7fe658145090 2024-03-07T07:32:07.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.873+0000 7fe655e00640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe634066f90 0x7fe634069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:07.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.873+0000 7fe655e00640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe634066f90 0x7fe634069450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe658143250 tx=0x7fe648009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:07.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:07.877+0000 7fe64e000640 1 -- 172.21.15.84:0/1535246168 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe6400160d0 con 0x7fe658145090 2024-03-07T07:32:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.041+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe6580b0b60 con 0x7fe658145090 2024-03-07T07:32:08.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.693+0000 7fe64e000640 1 -- 172.21.15.84:0/1535246168 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe6400f0880 con 0x7fe658145090 2024-03-07T07:32:08.697 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2024-03-07T07:32:08.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.697+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe634066f90 msgr2=0x7fe634069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:08.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.697+0000 7fe65d000640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe634066f90 0x7fe634069450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe658143250 tx=0x7fe648009040 comp rx=0 tx=0).stop 2024-03-07T07:32:08.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.697+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe658145090 msgr2=0x7fe658142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:08.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.697+0000 7fe65d000640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe658145090 0x7fe658142690 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe64001cd50 tx=0x7fe640019250 comp rx=0 tx=0).stop 2024-03-07T07:32:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.705+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 shutdown_connections 2024-03-07T07:32:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.705+0000 7fe65d000640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe634066f90 0x7fe634069450 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.705+0000 7fe65d000640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe65815c3d0 0x7fe658142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.705+0000 7fe65d000640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe658145090 0x7fe658142690 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.705+0000 7fe65d000640 1 --2- 172.21.15.84:0/1535246168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6580cd950 0x7fe65815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.705+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 >> 172.21.15.84:0/1535246168 conn(0x7fe6580b1c50 msgr2=0x7fe6580b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:08.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.705+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 shutdown_connections 2024-03-07T07:32:08.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.709+0000 7fe65d000640 1 -- 172.21.15.84:0/1535246168 wait complete. 2024-03-07T07:32:08.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-07T07:32:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.881+0000 7f865b000640 1 Processor -- start 2024-03-07T07:32:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.881+0000 7f865b000640 1 -- start start 2024-03-07T07:32:08.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.881+0000 7f865b000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8654145090 0x7f86540cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:08.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.881+0000 7f865b000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540b4a60 con 0x7f86540cdb20 2024-03-07T07:32:08.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f865b000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540b4d40 con 0x7f865415c3d0 2024-03-07T07:32:08.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f865b000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86540719c0 con 0x7f8654145090 2024-03-07T07:32:08.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8653e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8654145090 0x7f86540cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:08.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8659000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86540cdb20 0x7f86540724a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41366/0 (socket says 172.21.15.84:41366) 2024-03-07T07:32:08.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8659000640 1 -- 172.21.15.84:0/2514205219 learned_addr learned my addr 172.21.15.84:0/2514205219 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:08.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8653e00640 1 -- 172.21.15.84:0/2514205219 >> v1:172.21.15.161:6789/0 conn(0x7f865415c3d0 legacy=0x7f86540cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:08.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8653e00640 1 -- 172.21.15.84:0/2514205219 >> v1:172.21.15.84:6789/0 conn(0x7f86540cdb20 legacy=0x7f86540724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:08.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8653e00640 1 -- 172.21.15.84:0/2514205219 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654071ca0 con 0x7f8654145090 2024-03-07T07:32:08.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8653e00640 1 --2- 172.21.15.84:0/2514205219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8654145090 0x7f86540cf540 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f86440097c0 tx=0x7f864401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3162895932c4f4ae server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:08.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8653400640 1 -- 172.21.15.84:0/2514205219 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440b2070 con 0x7f8654145090 2024-03-07T07:32:08.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.885+0000 7f8653400640 1 -- 172.21.15.84:0/2514205219 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86440ad680 con 0x7f8654145090 2024-03-07T07:32:08.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f8653400640 1 -- 172.21.15.84:0/2514205219 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440ada50 con 0x7f8654145090 2024-03-07T07:32:08.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- 172.21.15.84:0/2514205219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8654145090 msgr2=0x7f86540cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:08.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 --2- 172.21.15.84:0/2514205219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8654145090 0x7f86540cf540 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f86440097c0 tx=0x7f864401c3a0 comp rx=0 tx=0).stop 2024-03-07T07:32:08.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- 172.21.15.84:0/2514205219 shutdown_connections 2024-03-07T07:32:08.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 --2- 172.21.15.84:0/2514205219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8654145090 0x7f86540cf540 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:08.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- 172.21.15.84:0/2514205219 >> 172.21.15.84:0/2514205219 conn(0x7f86540b1c50 msgr2=0x7f86540b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:08.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- 172.21.15.84:0/2514205219 shutdown_connections 2024-03-07T07:32:08.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- 172.21.15.84:0/2514205219 wait complete. 2024-03-07T07:32:08.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 Processor -- start 2024-03-07T07:32:08.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- start start 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86540cdb20 0x7f865415d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8654145090 0x7f8654143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f865415c3d0 0x7f86541443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654145830 con 0x7f86540cdb20 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540b4710 con 0x7f8654145090 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f865b000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86541459b0 con 0x7f865415c3d0 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f8653e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86540cdb20 0x7f865415d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f8653e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86540cdb20 0x7f865415d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41016/0 (socket says 172.21.15.84:41016) 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f8653e00640 1 -- 172.21.15.84:0/2791971655 learned_addr learned my addr 172.21.15.84:0/2791971655 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f8659000640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f865415c3d0 0x7f86541443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.889+0000 7f864b400640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8654145090 0x7f8654143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:08.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8653e00640 1 -- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f865415c3d0 msgr2=0x7f86541443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8653e00640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f865415c3d0 0x7f86541443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8653e00640 1 -- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8654145090 msgr2=0x7f8654143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8653e00640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8654145090 0x7f8654143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8653e00640 1 -- 172.21.15.84:0/2791971655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865415d7e0 con 0x7f86540cdb20 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f864b400640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8654145090 0x7f8654143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8653e00640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86540cdb20 0x7f865415d2a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8644018fb0 tx=0x7f864401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8650c00640 1 -- 172.21.15.84:0/2791971655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440bc020 con 0x7f86540cdb20 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8650c00640 1 -- 172.21.15.84:0/2791971655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86440adc70 con 0x7f86540cdb20 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865415ca70 con 0x7f86540cdb20 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8650c00640 1 -- 172.21.15.84:0/2791971655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440b2040 con 0x7f86540cdb20 2024-03-07T07:32:08.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865415ec30 con 0x7f86540cdb20 2024-03-07T07:32:08.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8654062d40 con 0x7f86540cdb20 2024-03-07T07:32:08.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8650c00640 1 -- 172.21.15.84:0/2791971655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f86440bf020 con 0x7f86540cdb20 2024-03-07T07:32:08.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8650c00640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8630066f60 0x7f8630069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:08.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f8650c00640 1 -- 172.21.15.84:0/2791971655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f864411f2c0 con 0x7f86540cdb20 2024-03-07T07:32:08.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.893+0000 7f864b400640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8630066f60 0x7f8630069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:08.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.897+0000 7f864b400640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8630066f60 0x7f8630069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f86540b2560 tx=0x7f863c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:08.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:08.901+0000 7f8650c00640 1 -- 172.21.15.84:0/2791971655 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f86440c6030 con 0x7f86540cdb20 2024-03-07T07:32:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.089+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f86540682a0 con 0x7f86540cdb20 2024-03-07T07:32:09.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.721+0000 7f8650c00640 1 -- 172.21.15.84:0/2791971655 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8644016050 con 0x7f86540cdb20 2024-03-07T07:32:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 4 and data pool 5 2024-03-07T07:32:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.725+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8630066f60 msgr2=0x7f8630069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.725+0000 7f865b000640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8630066f60 0x7f8630069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f86540b2560 tx=0x7f863c009040 comp rx=0 tx=0).stop 2024-03-07T07:32:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.725+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86540cdb20 msgr2=0x7f865415d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.725+0000 7f865b000640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86540cdb20 0x7f865415d2a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8644018fb0 tx=0x7f864401abe0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.733+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 shutdown_connections 2024-03-07T07:32:09.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.733+0000 7f865b000640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8630066f60 0x7f8630069420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.733+0000 7f865b000640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f865415c3d0 0x7f86541443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.733+0000 7f865b000640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8654145090 0x7f8654143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.733+0000 7f865b000640 1 --2- 172.21.15.84:0/2791971655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86540cdb20 0x7f865415d2a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.733+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 >> 172.21.15.84:0/2791971655 conn(0x7f86540b1c50 msgr2=0x7f865413d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:09.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.733+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 shutdown_connections 2024-03-07T07:32:09.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.733+0000 7f865b000640 1 -- 172.21.15.84:0/2791971655 wait complete. 2024-03-07T07:32:09.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:32:09.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.901+0000 7fd136200640 1 Processor -- start 2024-03-07T07:32:09.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.901+0000 7fd136200640 1 -- start start 2024-03-07T07:32:09.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.901+0000 7fd136200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1300a9540 0x7fd13015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:09.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.901+0000 7fd136200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd1300730e0 0x7fd13015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:09.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.901+0000 7fd136200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13006d780 con 0x7fd130145a30 2024-03-07T07:32:09.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.901+0000 7fd136200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13006da60 con 0x7fd1300730e0 2024-03-07T07:32:09.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.901+0000 7fd136200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13006dd40 con 0x7fd1300a9540 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd126a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1300a9540 0x7fd13015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd12fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd1300730e0 0x7fd13015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd12fe00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd1300730e0 0x7fd13015cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51394/0 (socket says 172.21.15.84:51394) 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd12fe00640 1 -- 172.21.15.84:0/1757344771 learned_addr learned my addr 172.21.15.84:0/1757344771 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd126a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1300a9540 0x7fd13015c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:60526/0 (socket says 172.21.15.84:60526) 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd12f400640 1 --1- 172.21.15.84:0/1757344771 >> v1:172.21.15.161:6789/0 conn(0x7fd130145a30 0x7fd1300729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:36118/0 (socket says 172.21.15.84:36118) 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd126a00640 1 -- 172.21.15.84:0/1757344771 >> v2:172.21.15.161:3300/0 conn(0x7fd1300730e0 msgr2=0x7fd13015cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd126a00640 1 --2- 172.21.15.84:0/1757344771 >> v2:172.21.15.161:3300/0 conn(0x7fd1300730e0 0x7fd13015cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd126a00640 1 -- 172.21.15.84:0/1757344771 >> v1:172.21.15.161:6789/0 conn(0x7fd130145a30 legacy=0x7fd1300729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:09.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd126a00640 1 -- 172.21.15.84:0/1757344771 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13006e020 con 0x7fd1300a9540 2024-03-07T07:32:09.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.905+0000 7fd126a00640 1 --2- 172.21.15.84:0/1757344771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1300a9540 0x7fd13015c7e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1180097c0 tx=0x7fd11801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f8b2e4ff6ef0731 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:09.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd12ea00640 1 -- 172.21.15.84:0/1757344771 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180b0070 con 0x7fd1300a9540 2024-03-07T07:32:09.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd12ea00640 1 -- 172.21.15.84:0/1757344771 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1180ab600 con 0x7fd1300a9540 2024-03-07T07:32:09.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd12ea00640 1 -- 172.21.15.84:0/1757344771 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180ab9d0 con 0x7fd1300a9540 2024-03-07T07:32:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- 172.21.15.84:0/1757344771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1300a9540 msgr2=0x7fd13015c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 --2- 172.21.15.84:0/1757344771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1300a9540 0x7fd13015c7e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1180097c0 tx=0x7fd11801c380 comp rx=0 tx=0).stop 2024-03-07T07:32:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- 172.21.15.84:0/1757344771 shutdown_connections 2024-03-07T07:32:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 --2- 172.21.15.84:0/1757344771 >> v2:172.21.15.161:3300/0 conn(0x7fd1300730e0 0x7fd13015cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 --2- 172.21.15.84:0/1757344771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1300a9540 0x7fd13015c7e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- 172.21.15.84:0/1757344771 >> 172.21.15.84:0/1757344771 conn(0x7fd1300704b0 msgr2=0x7fd1300708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- 172.21.15.84:0/1757344771 shutdown_connections 2024-03-07T07:32:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- 172.21.15.84:0/1757344771 wait complete. 2024-03-07T07:32:09.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 Processor -- start 2024-03-07T07:32:09.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- start start 2024-03-07T07:32:09.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1300730e0 0x7fd13013a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd130145a30 0x7fd1300b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1301fb4c0 0x7fd1300b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130168d60 con 0x7fd1300730e0 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130168be0 con 0x7fd130145a30 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd136200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd130168ee0 con 0x7fd1301fb4c0 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd12f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1300730e0 0x7fd13013a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd12f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1300730e0 0x7fd13013a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41030/0 (socket says 172.21.15.84:41030) 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd12f400640 1 -- 172.21.15.84:0/1395014787 learned_addr learned my addr 172.21.15.84:0/1395014787 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd12fe00640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1301fb4c0 0x7fd1300b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.909+0000 7fd126a00640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd130145a30 0x7fd1300b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd12f400640 1 -- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1301fb4c0 msgr2=0x7fd1300b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd12f400640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1301fb4c0 0x7fd1300b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd12f400640 1 -- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd130145a30 msgr2=0x7fd1300b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd12f400640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd130145a30 0x7fd1300b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd12f400640 1 -- 172.21.15.84:0/1395014787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13015ba90 con 0x7fd1300730e0 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd12fe00640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1301fb4c0 0x7fd1300b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd126a00640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd130145a30 0x7fd1300b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd12f400640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1300730e0 0x7fd13013a910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c3d0 tx=0x7fd12000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd127e00640 1 -- 172.21.15.84:0/1395014787 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200074e0 con 0x7fd1300730e0 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd127e00640 1 -- 172.21.15.84:0/1395014787 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd120007680 con 0x7fd1300730e0 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd127e00640 1 -- 172.21.15.84:0/1395014787 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120004a30 con 0x7fd1300730e0 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13013d290 con 0x7fd1300730e0 2024-03-07T07:32:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1301facc0 con 0x7fd1300730e0 2024-03-07T07:32:09.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130062d40 con 0x7fd1300730e0 2024-03-07T07:32:09.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd127e00640 1 -- 172.21.15.84:0/1395014787 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fd12001a020 con 0x7fd1300730e0 2024-03-07T07:32:09.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd127e00640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd10c066f60 0x7fd10c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:09.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd127e00640 1 -- 172.21.15.84:0/1395014787 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1200847b0 con 0x7fd1300730e0 2024-03-07T07:32:09.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.913+0000 7fd126a00640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd10c066f60 0x7fd10c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:09.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.917+0000 7fd126a00640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd10c066f60 0x7fd10c069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1180ad000 tx=0x7fd118008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:09.917+0000 7fd127e00640 1 -- 172.21.15.84:0/1395014787 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fd13015ba90 con 0x7fd1300730e0 2024-03-07T07:32:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.077+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd130072a70 con 0x7fd1300730e0 2024-03-07T07:32:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.077+0000 7fd127e00640 1 -- 172.21.15.84:0/1395014787 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16586 (secure 0 0 0) 0x7fd1200557b0 con 0x7fd1300730e0 2024-03-07T07:32:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":33,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:32:09.092172+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:32:07.581845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-07T07:32:08.085165+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:32:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd10c066f60 msgr2=0x7fd10c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd10c066f60 0x7fd10c069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1180ad000 tx=0x7fd118008040 comp rx=0 tx=0).stop 2024-03-07T07:32:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1300730e0 msgr2=0x7fd13013a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1300730e0 0x7fd13013a910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c3d0 tx=0x7fd12000c890 comp rx=0 tx=0).stop 2024-03-07T07:32:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 shutdown_connections 2024-03-07T07:32:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd10c066f60 0x7fd10c069420 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1301fb4c0 0x7fd1300b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd130145a30 0x7fd1300b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 --2- 172.21.15.84:0/1395014787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1300730e0 0x7fd13013a910 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 >> 172.21.15.84:0/1395014787 conn(0x7fd1300704b0 msgr2=0x7fd1300afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 shutdown_connections 2024-03-07T07:32:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.081+0000 7fd136200640 1 -- 172.21.15.84:0/1395014787 wait complete. 2024-03-07T07:32:10.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:32:10.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.233+0000 7f6f6e000640 1 Processor -- start 2024-03-07T07:32:10.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.233+0000 7f6f6e000640 1 -- start start 2024-03-07T07:32:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.233+0000 7f6f6e000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f680730e0 0x7f6f680cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.233+0000 7f6f6e000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f68144360 0x7f6f6815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.233+0000 7f6f6e000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680cc880 con 0x7f6f68143dd0 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.233+0000 7f6f6e000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f681441b0 con 0x7f6f68144360 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.233+0000 7f6f6e000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680cf050 con 0x7f6f680730e0 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f67400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6f68143dd0 0x7f6f680729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41374/0 (socket says 172.21.15.84:41374) 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f67400640 1 -- 172.21.15.84:0/2981417622 learned_addr learned my addr 172.21.15.84:0/2981417622 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f67e00640 1 --2- 172.21.15.84:0/2981417622 >> v2:172.21.15.161:3300/0 conn(0x7f6f68144360 0x7f6f6815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f66a00640 1 --2- 172.21.15.84:0/2981417622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f680730e0 0x7f6f680cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f66000640 1 -- 172.21.15.84:0/2981417622 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551707617 0 0) 0x7f6f680cc880 con 0x7f6f68143dd0 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f66000640 1 -- 172.21.15.84:0/2981417622 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f4c005740 con 0x7f6f68143dd0 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f67e00640 1 -- 172.21.15.84:0/2981417622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f680730e0 msgr2=0x7f6f680cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f67e00640 1 --2- 172.21.15.84:0/2981417622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f680730e0 0x7f6f680cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f67e00640 1 -- 172.21.15.84:0/2981417622 >> v1:172.21.15.84:6789/0 conn(0x7f6f68143dd0 legacy=0x7f6f680729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f67e00640 1 -- 172.21.15.84:0/2981417622 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680ccb60 con 0x7f6f68144360 2024-03-07T07:32:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f67e00640 1 --2- 172.21.15.84:0/2981417622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f68144360 0x7f6f6815b410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009dc0 tx=0x7f6f6001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f8760e3c3c9b7e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.237+0000 7f6f66000640 1 -- 172.21.15.84:0/2981417622 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600b2070 con 0x7f6f68144360 2024-03-07T07:32:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f66000640 1 -- 172.21.15.84:0/2981417622 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f600a5a00 con 0x7f6f68144360 2024-03-07T07:32:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f66000640 1 -- 172.21.15.84:0/2981417622 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600a5dd0 con 0x7f6f68144360 2024-03-07T07:32:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- 172.21.15.84:0/2981417622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f68144360 msgr2=0x7f6f6815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 --2- 172.21.15.84:0/2981417622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f68144360 0x7f6f6815b410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009dc0 tx=0x7f6f6001c920 comp rx=0 tx=0).stop 2024-03-07T07:32:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- 172.21.15.84:0/2981417622 shutdown_connections 2024-03-07T07:32:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 --2- 172.21.15.84:0/2981417622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f68144360 0x7f6f6815b410 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 --2- 172.21.15.84:0/2981417622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f680730e0 0x7f6f680cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- 172.21.15.84:0/2981417622 >> 172.21.15.84:0/2981417622 conn(0x7f6f680704b0 msgr2=0x7f6f680708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- 172.21.15.84:0/2981417622 shutdown_connections 2024-03-07T07:32:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- 172.21.15.84:0/2981417622 wait complete. 2024-03-07T07:32:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 Processor -- start 2024-03-07T07:32:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- start start 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f680730e0 0x7f6f6813c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f68143dd0 0x7f6f68156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f68144360 0x7f6f6813f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6806d230 con 0x7f6f68144360 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680cd6e0 con 0x7f6f680730e0 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f6e000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6806d3b0 con 0x7f6f68143dd0 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f68144360 0x7f6f6813f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f68144360 0x7f6f6813f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41034/0 (socket says 172.21.15.84:41034) 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67e00640 1 -- 172.21.15.84:0/1245588899 learned_addr learned my addr 172.21.15.84:0/1245588899 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67400640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f680730e0 0x7f6f6813c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f66a00640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f68143dd0 0x7f6f68156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67e00640 1 -- 172.21.15.84:0/1245588899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f68143dd0 msgr2=0x7f6f68156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67e00640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f68143dd0 0x7f6f68156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67e00640 1 -- 172.21.15.84:0/1245588899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f680730e0 msgr2=0x7f6f6813c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67e00640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f680730e0 0x7f6f6813c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.241+0000 7f6f67e00640 1 -- 172.21.15.84:0/1245588899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68140c90 con 0x7f6f68144360 2024-03-07T07:32:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f67e00640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f68144360 0x7f6f6813f960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f6001a550 tx=0x7f6f600196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f5f400640 1 -- 172.21.15.84:0/1245588899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600b2050 con 0x7f6f68144360 2024-03-07T07:32:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f5f400640 1 -- 172.21.15.84:0/1245588899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f600be070 con 0x7f6f68144360 2024-03-07T07:32:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f68140f70 con 0x7f6f68144360 2024-03-07T07:32:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f5f400640 1 -- 172.21.15.84:0/1245588899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600ada90 con 0x7f6f68144360 2024-03-07T07:32:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f68140920 con 0x7f6f68144360 2024-03-07T07:32:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68062d40 con 0x7f6f68144360 2024-03-07T07:32:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f5f400640 1 -- 172.21.15.84:0/1245588899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f6f600adc30 con 0x7f6f68144360 2024-03-07T07:32:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f5f400640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6f48066f60 0x7f6f48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f5f400640 1 -- 172.21.15.84:0/1245588899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f60120170 con 0x7f6f68144360 2024-03-07T07:32:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.245+0000 7f6f67400640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6f48066f60 0x7f6f48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.249+0000 7f6f67400640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6f48066f60 0x7f6f48069420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f58005890 tx=0x7f6f58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.249+0000 7f6f5f400640 1 -- 172.21.15.84:0/1245588899 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6f60016540 con 0x7f6f68144360 2024-03-07T07:32:10.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.405+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f6815b1f0 con 0x7f6f68144360 2024-03-07T07:32:10.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.405+0000 7f6f5f400640 1 -- 172.21.15.84:0/1245588899 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16586 (secure 0 0 0) 0x7f6f600ab340 con 0x7f6f68144360 2024-03-07T07:32:10.408 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:10.408 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":33,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:32:09.092172+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:32:07.581845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-07T07:32:08.085165+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6f48066f60 msgr2=0x7f6f48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6f48066f60 0x7f6f48069420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f58005890 tx=0x7f6f58009040 comp rx=0 tx=0).stop 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f68144360 msgr2=0x7f6f6813f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f68144360 0x7f6f6813f960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f6001a550 tx=0x7f6f600196c0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 shutdown_connections 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6f48066f60 0x7f6f48069420 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f68144360 0x7f6f6813f960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f68143dd0 0x7f6f68156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 --2- 172.21.15.84:0/1245588899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f680730e0 0x7f6f6813c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 >> 172.21.15.84:0/1245588899 conn(0x7f6f680704b0 msgr2=0x7f6f68139df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:10.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 shutdown_connections 2024-03-07T07:32:10.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.409+0000 7f6f6e000640 1 -- 172.21.15.84:0/1245588899 wait complete. 2024-03-07T07:32:10.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-07T07:32:10.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ea00640 1 Processor -- start 2024-03-07T07:32:10.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ea00640 1 -- start start 2024-03-07T07:32:10.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 0x7fd5680cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ea00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd56815fa50 0x7fd56806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ea00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680d0720 con 0x7fd5680b46c0 2024-03-07T07:32:10.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ea00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680d0ce0 con 0x7fd56815fa50 2024-03-07T07:32:10.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56806b6e0 con 0x7fd56809ac40 2024-03-07T07:32:10.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd55f400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd5680b46c0 0x7fd56815f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41388/0 (socket says 172.21.15.84:41388) 2024-03-07T07:32:10.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd55f400640 1 -- 172.21.15.84:0/3492384808 learned_addr learned my addr 172.21.15.84:0/3492384808 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ca00640 1 --2- 172.21.15.84:0/3492384808 >> v2:172.21.15.161:3300/0 conn(0x7fd56815fa50 0x7fd56806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567e00640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 0x7fd5680cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138978542 0 0) 0x7fd5680d0720 con 0x7fd5680b46c0 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd54c003530 con 0x7fd5680b46c0 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449688619 0 0) 0x7fd54c003530 con 0x7fd5680b46c0 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 msgr2=0x7fd5680cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 0x7fd5680cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 >> v2:172.21.15.161:3300/0 conn(0x7fd56815fa50 msgr2=0x7fd56806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 --2- 172.21.15.84:0/3492384808 >> v2:172.21.15.161:3300/0 conn(0x7fd56815fa50 0x7fd56806c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680d0a00 con 0x7fd5680b46c0 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7fd550001680 con 0x7fd5680b46c0 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567e00640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 0x7fd5680cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd56ca00640 1 --2- 172.21.15.84:0/3492384808 >> v2:172.21.15.161:3300/0 conn(0x7fd56815fa50 0x7fd56806c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 >> v1:172.21.15.84:6789/0 conn(0x7fd5680b46c0 legacy=0x7fd56815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd54c0039c0 0x7fd54c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c004810 0x7fd54c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 0x7fd54c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56806b6e0 con 0x7fd54c0039c0 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c00b9d0 con 0x7fd54c004810 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.565+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c00bb50 con 0x7fd56809ac40 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567e00640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd54c0039c0 0x7fd54c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd55f400640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c004810 0x7fd54c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd56ca00640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 0x7fd54c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567e00640 1 -- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 msgr2=0x7fd54c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:10.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567e00640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56809ac40 0x7fd54c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567e00640 1 -- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c004810 msgr2=0x7fd54c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:10.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567e00640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c004810 0x7fd54c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567e00640 1 -- 172.21.15.84:0/3492384808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c003530 con 0x7fd54c0039c0 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567e00640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd54c0039c0 0x7fd54c003de0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd55800e350 tx=0x7fd55801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff0af39a54026d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5580b2070 con 0x7fd54c0039c0 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5580a5b10 con 0x7fd54c0039c0 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.569+0000 7fd567400640 1 -- 172.21.15.84:0/3492384808 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558009de0 con 0x7fd54c0039c0 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- 172.21.15.84:0/3492384808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd54c0039c0 msgr2=0x7fd54c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 --2- 172.21.15.84:0/3492384808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd54c0039c0 0x7fd54c003de0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd55800e350 tx=0x7fd55801ce00 comp rx=0 tx=0).stop 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ca00640 1 -- 172.21.15.84:0/3492384808 reap_dead start 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- 172.21.15.84:0/3492384808 shutdown_connections 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- 172.21.15.84:0/3492384808 >> 172.21.15.84:0/3492384808 conn(0x7fd5680b3ba0 msgr2=0x7fd5680b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- 172.21.15.84:0/3492384808 shutdown_connections 2024-03-07T07:32:10.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- 172.21.15.84:0/3492384808 wait complete. 2024-03-07T07:32:10.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 Processor -- start 2024-03-07T07:32:10.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- start start 2024-03-07T07:32:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c0039c0 0x7fd5680716e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5680b4e20 0x7fd568154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5680b7020 0x7fd5680b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56806d210 con 0x7fd5680b4e20 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56806d090 con 0x7fd54c0039c0 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56806d390 con 0x7fd5680b7020 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5680b4e20 0x7fd568154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5680b4e20 0x7fd568154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41056/0 (socket says 172.21.15.84:41056) 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 -- 172.21.15.84:0/1216911587 learned_addr learned my addr 172.21.15.84:0/1216911587 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ca00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5680b7020 0x7fd5680b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd567e00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c0039c0 0x7fd5680716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 -- 172.21.15.84:0/1216911587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5680b7020 msgr2=0x7fd5680b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5680b7020 0x7fd5680b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 -- 172.21.15.84:0/1216911587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c0039c0 msgr2=0x7fd5680716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c0039c0 0x7fd5680716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 -- 172.21.15.84:0/1216911587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680b52a0 con 0x7fd5680b4e20 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd55f400640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5680b4e20 0x7fd568154410 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd550007340 tx=0x7fd550007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd564c00640 1 -- 172.21.15.84:0/1216911587 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55000f9c0 con 0x7fd5680b4e20 2024-03-07T07:32:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd564c00640 1 -- 172.21.15.84:0/1216911587 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd550018070 con 0x7fd5680b4e20 2024-03-07T07:32:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd564c00640 1 -- 172.21.15.84:0/1216911587 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55000fda0 con 0x7fd5680b4e20 2024-03-07T07:32:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.573+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd568071da0 con 0x7fd5680b4e20 2024-03-07T07:32:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.577+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd568072360 con 0x7fd5680b4e20 2024-03-07T07:32:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.577+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568062d40 con 0x7fd5680b4e20 2024-03-07T07:32:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.577+0000 7fd564c00640 1 -- 172.21.15.84:0/1216911587 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fd55001d460 con 0x7fd5680b4e20 2024-03-07T07:32:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.577+0000 7fd564c00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd544066f60 0x7fd544069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.577+0000 7fd564c00640 1 -- 172.21.15.84:0/1216911587 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5500851e0 con 0x7fd5680b4e20 2024-03-07T07:32:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.577+0000 7fd567e00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd544066f60 0x7fd544069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.577+0000 7fd567e00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd544066f60 0x7fd544069420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd5580af000 tx=0x7fd558004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:10.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.581+0000 7fd564c00640 1 -- 172.21.15.84:0/1216911587 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fd550056150 con 0x7fd5680b4e20 2024-03-07T07:32:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:10.773+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd5680b79e0 con 0x7fd5680b4e20 2024-03-07T07:32:11.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:32:11.302 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:32:11.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.733+0000 7fd564c00640 1 -- 172.21.15.84:0/1216911587 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd550055a50 con 0x7fd5680b4e20 2024-03-07T07:32:11.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd544066f60 msgr2=0x7fd544069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:11.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd544066f60 0x7fd544069420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd5580af000 tx=0x7fd558004ac0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5680b4e20 msgr2=0x7fd568154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5680b4e20 0x7fd568154410 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd550007340 tx=0x7fd550007800 comp rx=0 tx=0).stop 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 shutdown_connections 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fd544066f60 0x7fd544069420 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5680b7020 0x7fd5680b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5680b4e20 0x7fd568154410 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 --2- 172.21.15.84:0/1216911587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c0039c0 0x7fd5680716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 >> 172.21.15.84:0/1216911587 conn(0x7fd5680b3ba0 msgr2=0x7fd5680b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 shutdown_connections 2024-03-07T07:32:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.737+0000 7fd56ea00640 1 -- 172.21.15.84:0/1216911587 wait complete. 2024-03-07T07:32:11.757 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-07T07:32:11.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-07T07:32:11.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.893+0000 7f5389000640 1 Processor -- start 2024-03-07T07:32:11.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.893+0000 7f5389000640 1 -- start start 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5389000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53840b63e0 0x7f538406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5389000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538415e470 con 0x7f53840b6000 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5389000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5384162470 con 0x7f53840afa30 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5389000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5384162750 con 0x7f53840b63e0 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5383400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f53840b6000 0x7f53840af320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56758/0 (socket says 172.21.15.84:56758) 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5383400640 1 -- 172.21.15.84:0/589645825 learned_addr learned my addr 172.21.15.84:0/589645825 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108511860 0 0) 0x7f5374001120 con 0x7f53840b6000 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5368003530 con 0x7f53840b6000 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f537be00640 1 --2- 172.21.15.84:0/589645825 >> v2:172.21.15.161:3300/0 conn(0x7f53840b63e0 0x7f538406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1713788639 0 0) 0x7f5368003530 con 0x7f53840b6000 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 >> v2:172.21.15.161:3300/0 conn(0x7f53840b63e0 msgr2=0x7f538406eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 --2- 172.21.15.84:0/589645825 >> v2:172.21.15.161:3300/0 conn(0x7f53840b63e0 0x7f538406eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 >> v1:172.21.15.161:6789/0 conn(0x7f53840afa30 legacy=0x7f5384070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538415e6f0 con 0x7f53840b6000 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f5374001850 con 0x7f53840b6000 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 >> v1:172.21.15.84:6789/0 conn(0x7f53840b6000 legacy=0x7f53840af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53680039c0 0x7f5368003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5368004810 0x7f5368004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53680053d0 0x7f536800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5384162750 con 0x7f5368004810 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536800c260 con 0x7f53680053d0 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536800c460 con 0x7f53680039c0 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f537be00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5368004810 0x7f5368004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5383400640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53680039c0 0x7f5368003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5383e00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53680053d0 0x7f536800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f537be00640 1 -- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53680039c0 msgr2=0x7f5368003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f537be00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53680039c0 0x7f5368003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f537be00640 1 -- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53680053d0 msgr2=0x7f536800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f537be00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53680053d0 0x7f536800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f537be00640 1 -- 172.21.15.84:0/589645825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368003530 con 0x7f5368004810 2024-03-07T07:32:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5383e00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53680053d0 0x7f536800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.897+0000 7f5383e00640 1 -- 172.21.15.84:0/589645825 reap_dead start 2024-03-07T07:32:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f537be00640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5368004810 0x7f5368004c90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f536c00ba30 tx=0x7f536c01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f324334fcf37ea server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c0b3070 con 0x7f5368004810 2024-03-07T07:32:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c0ae630 con 0x7f5368004810 2024-03-07T07:32:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5382a00640 1 -- 172.21.15.84:0/589645825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c0aa050 con 0x7f5368004810 2024-03-07T07:32:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5389000640 1 -- 172.21.15.84:0/589645825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5368004810 msgr2=0x7f5368004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5389000640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5368004810 0x7f5368004c90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f536c00ba30 tx=0x7f536c01c6a0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5389000640 1 -- 172.21.15.84:0/589645825 shutdown_connections 2024-03-07T07:32:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5389000640 1 --2- 172.21.15.84:0/589645825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5368004810 0x7f5368004c90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5389000640 1 -- 172.21.15.84:0/589645825 >> 172.21.15.84:0/589645825 conn(0x7f5384073070 msgr2=0x7f53840b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5389000640 1 -- 172.21.15.84:0/589645825 shutdown_connections 2024-03-07T07:32:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.901+0000 7f5389000640 1 -- 172.21.15.84:0/589645825 wait complete. 2024-03-07T07:32:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 Processor -- start 2024-03-07T07:32:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 -- start start 2024-03-07T07:32:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5368004810 0x7f5384140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5384070270 0x7f53840706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53840ce7c0 0x7f53840cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53840af6b0 con 0x7f5384070270 2024-03-07T07:32:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53840af530 con 0x7f5368004810 2024-03-07T07:32:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53840af830 con 0x7f53840ce7c0 2024-03-07T07:32:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5384070270 0x7f53840706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5384070270 0x7f53840706d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44494/0 (socket says 172.21.15.84:44494) 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 -- 172.21.15.84:0/3918032077 learned_addr learned my addr 172.21.15.84:0/3918032077 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5383400640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5368004810 0x7f5384140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 -- 172.21.15.84:0/3918032077 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53840ce7c0 msgr2=0x7f53840cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53840ce7c0 0x7f53840cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 -- 172.21.15.84:0/3918032077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5368004810 msgr2=0x7f5384140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5368004810 0x7f5384140b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 -- 172.21.15.84:0/3918032077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53840cf510 con 0x7f5384070270 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5383400640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5368004810 0x7f5384140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537be00640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5384070270 0x7f53840706d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f536c01c4d0 tx=0x7f5368005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537b400640 1 -- 172.21.15.84:0/3918032077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c0b3040 con 0x7f5384070270 2024-03-07T07:32:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537b400640 1 -- 172.21.15.84:0/3918032077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c0ae430 con 0x7f5384070270 2024-03-07T07:32:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f537b400640 1 -- 172.21.15.84:0/3918032077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c00b600 con 0x7f5384070270 2024-03-07T07:32:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5384152ad0 con 0x7f5384070270 2024-03-07T07:32:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5384153090 con 0x7f5384070270 2024-03-07T07:32:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.905+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5384070c10 con 0x7f5384070270 2024-03-07T07:32:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.909+0000 7f537b400640 1 -- 172.21.15.84:0/3918032077 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f536c0c0020 con 0x7f5384070270 2024-03-07T07:32:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.909+0000 7f537b400640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5360066f90 0x7f5360069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.909+0000 7f537b400640 1 -- 172.21.15.84:0/3918032077 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f536c11f320 con 0x7f5384070270 2024-03-07T07:32:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.909+0000 7f5383400640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5360066f90 0x7f5360069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.909+0000 7f5383400640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5360066f90 0x7f5360069450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5374000c10 tx=0x7f5374009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:11.913+0000 7f537b400640 1 -- 172.21.15.84:0/3918032077 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f536c0163b0 con 0x7f5384070270 2024-03-07T07:32:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.101+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f53840b1330 con 0x7f5384070270 2024-03-07T07:32:12.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.741+0000 7f537b400640 1 -- 172.21.15.84:0/3918032077 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f536c0f0320 con 0x7f5384070270 2024-03-07T07:32:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5360066f90 msgr2=0x7f5360069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5360066f90 0x7f5360069450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5374000c10 tx=0x7f5374009040 comp rx=0 tx=0).stop 2024-03-07T07:32:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5384070270 msgr2=0x7f53840706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5384070270 0x7f53840706d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f536c01c4d0 tx=0x7f5368005840 comp rx=0 tx=0).stop 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 shutdown_connections 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5360066f90 0x7f5360069450 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53840ce7c0 0x7f53840cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5384070270 0x7f53840706d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 --2- 172.21.15.84:0/3918032077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5368004810 0x7f5384140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 >> 172.21.15.84:0/3918032077 conn(0x7f5384073070 msgr2=0x7f53840b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 shutdown_connections 2024-03-07T07:32:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.745+0000 7f5389000640 1 -- 172.21.15.84:0/3918032077 wait complete. 2024-03-07T07:32:12.770 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-07T07:32:12.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:32:12.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc56d400640 1 Processor -- start 2024-03-07T07:32:12.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc56d400640 1 -- start start 2024-03-07T07:32:12.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc56d400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680730e0 0x7fc5680cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:12.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc56d400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc568144360 0x7fc56815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:12.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc56d400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680cc880 con 0x7fc568143dd0 2024-03-07T07:32:12.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc56d400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5681441b0 con 0x7fc568144360 2024-03-07T07:32:12.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc56d400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680cf050 con 0x7fc5680730e0 2024-03-07T07:32:12.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc567200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc568144360 0x7fc56815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:12.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc55fe00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680730e0 0x7fc5680cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:12.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc566800640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc568143dd0 0x7fc5680729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:34458/0 (socket says 172.21.15.84:34458) 2024-03-07T07:32:12.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc566800640 1 -- 172.21.15.84:0/2309822300 learned_addr learned my addr 172.21.15.84:0/2309822300 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:12.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc567200640 1 -- 172.21.15.84:0/2309822300 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680730e0 msgr2=0x7fc5680cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:12.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc567200640 1 --2- 172.21.15.84:0/2309822300 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680730e0 0x7fc5680cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc567200640 1 -- 172.21.15.84:0/2309822300 >> v1:172.21.15.161:6789/0 conn(0x7fc568143dd0 legacy=0x7fc5680729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:12.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.909+0000 7fc567200640 1 -- 172.21.15.84:0/2309822300 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680ccb60 con 0x7fc568144360 2024-03-07T07:32:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc567200640 1 --2- 172.21.15.84:0/2309822300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568144360 0x7fc56815b410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc560009dc0 tx=0x7fc56001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb0776d061f8dd66 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc565e00640 1 -- 172.21.15.84:0/2309822300 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600b2070 con 0x7fc568144360 2024-03-07T07:32:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc565e00640 1 -- 172.21.15.84:0/2309822300 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5600a5a00 con 0x7fc568144360 2024-03-07T07:32:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc565e00640 1 -- 172.21.15.84:0/2309822300 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600a5dd0 con 0x7fc568144360 2024-03-07T07:32:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc56d400640 1 -- 172.21.15.84:0/2309822300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568144360 msgr2=0x7fc56815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc56d400640 1 --2- 172.21.15.84:0/2309822300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568144360 0x7fc56815b410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc560009dc0 tx=0x7fc56001c920 comp rx=0 tx=0).stop 2024-03-07T07:32:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc56d400640 1 -- 172.21.15.84:0/2309822300 shutdown_connections 2024-03-07T07:32:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc56d400640 1 --2- 172.21.15.84:0/2309822300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568144360 0x7fc56815b410 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc56d400640 1 --2- 172.21.15.84:0/2309822300 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680730e0 0x7fc5680cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc56d400640 1 -- 172.21.15.84:0/2309822300 >> 172.21.15.84:0/2309822300 conn(0x7fc5680704b0 msgr2=0x7fc5680708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc56d400640 1 -- 172.21.15.84:0/2309822300 shutdown_connections 2024-03-07T07:32:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.913+0000 7fc56d400640 1 -- 172.21.15.84:0/2309822300 wait complete. 2024-03-07T07:32:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc56d400640 1 Processor -- start 2024-03-07T07:32:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc56d400640 1 -- start start 2024-03-07T07:32:12.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc56d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5680730e0 0x7fc5681685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:12.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc56d400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568143dd0 0x7fc5681569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:12.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc56d400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc568144360 0x7fc5680adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:12.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc56d400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568165950 con 0x7fc5680730e0 2024-03-07T07:32:12.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc56d400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680cd6e0 con 0x7fc568143dd0 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc56d400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568165ad0 con 0x7fc568144360 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5680730e0 0x7fc5681685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5680730e0 0x7fc5681685b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44510/0 (socket says 172.21.15.84:44510) 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 -- 172.21.15.84:0/4126373504 learned_addr learned my addr 172.21.15.84:0/4126373504 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc55fe00640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568143dd0 0x7fc5681569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc567200640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc568144360 0x7fc5680adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 -- 172.21.15.84:0/4126373504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc568144360 msgr2=0x7fc5680adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc568144360 0x7fc5680adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 -- 172.21.15.84:0/4126373504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568143dd0 msgr2=0x7fc5681569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568143dd0 0x7fc5681569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 -- 172.21.15.84:0/4126373504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568159870 con 0x7fc5680730e0 2024-03-07T07:32:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc566800640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5680730e0 0x7fc5681685b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c420 tx=0x7fc55800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:12.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc55ea00640 1 -- 172.21.15.84:0/4126373504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558017070 con 0x7fc5680730e0 2024-03-07T07:32:12.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc55ea00640 1 -- 172.21.15.84:0/4126373504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558005cf0 con 0x7fc5680730e0 2024-03-07T07:32:12.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.917+0000 7fc55ea00640 1 -- 172.21.15.84:0/4126373504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5580072f0 con 0x7fc5680730e0 2024-03-07T07:32:12.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.921+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc568167510 con 0x7fc5680730e0 2024-03-07T07:32:12.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.921+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568167ad0 con 0x7fc5680730e0 2024-03-07T07:32:12.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.921+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc568062d40 con 0x7fc5680730e0 2024-03-07T07:32:12.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.921+0000 7fc55ea00640 1 -- 172.21.15.84:0/4126373504 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc55801a070 con 0x7fc5680730e0 2024-03-07T07:32:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.921+0000 7fc55ea00640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc544066f60 0x7fc544069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.921+0000 7fc55ea00640 1 -- 172.21.15.84:0/4126373504 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5580844c0 con 0x7fc5680730e0 2024-03-07T07:32:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.921+0000 7fc55fe00640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc544066f60 0x7fc544069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.921+0000 7fc55fe00640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc544066f60 0x7fc544069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc56815b4c0 tx=0x7fc550008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:12.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:12.925+0000 7fc55ea00640 1 -- 172.21.15.84:0/4126373504 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc558055430 con 0x7fc5680730e0 2024-03-07T07:32:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.113+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5681664c0 con 0x7fc5680730e0 2024-03-07T07:32:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.113+0000 7fc55ea00640 1 -- 172.21.15.84:0/4126373504 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4980 (secure 0 0 0) 0x7fc558054d30 con 0x7fc5680730e0 2024-03-07T07:32:13.117 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:13.117 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/2371752160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2371752160},{"type":"v1","addr":"172.21.15.161:6834","nonce":2371752160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/850187244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":850187244},{"type":"v1","addr":"172.21.15.161:6835","nonce":850187244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3878293455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3878293455},{"type":"v1","addr":"172.21.15.84:6836","nonce":3878293455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:32:09.092583+0000","modified":"2024-03-07T07:32:12.103936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2828752085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2828752085},{"type":"v1","addr":"172.21.15.84:6837","nonce":2828752085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4995,"qdb_cluster":[4995]},"id":2}]} 2024-03-07T07:32:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc544066f60 msgr2=0x7fc544069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc544066f60 0x7fc544069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc56815b4c0 tx=0x7fc550008040 comp rx=0 tx=0).stop 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5680730e0 msgr2=0x7fc5681685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5680730e0 0x7fc5681685b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c420 tx=0x7fc55800c8e0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 shutdown_connections 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc544066f60 0x7fc544069420 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc568144360 0x7fc5680adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc568143dd0 0x7fc5681569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 --2- 172.21.15.84:0/4126373504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5680730e0 0x7fc5681685b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 >> 172.21.15.84:0/4126373504 conn(0x7fc5680704b0 msgr2=0x7fc5681423e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:13.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 shutdown_connections 2024-03-07T07:32:13.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.117+0000 7fc56d400640 1 -- 172.21.15.84:0/4126373504 wait complete. 2024-03-07T07:32:13.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:32:13.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.273+0000 7f0895a00640 1 Processor -- start 2024-03-07T07:32:13.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.273+0000 7f0895a00640 1 -- start start 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f0895a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f089015c1f0 0x7f08900b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f0895a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f08900b3a00 0x7f08900aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f0895a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08900b0290 con 0x7f08900cf100 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f0895a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08900b1d40 con 0x7f089015c1f0 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f0895a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08900b0570 con 0x7f08900b3a00 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f088ea00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f089015c1f0 0x7f08900b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f088ea00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f089015c1f0 0x7f08900b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44524/0 (socket says 172.21.15.84:44524) 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f088ea00640 1 -- 172.21.15.84:0/1562344282 learned_addr learned my addr 172.21.15.84:0/1562344282 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:13.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f088f400640 1 --2- 172.21.15.84:0/1562344282 >> v2:172.21.15.161:3300/0 conn(0x7f08900b3a00 0x7f08900aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:13.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f088ea00640 1 -- 172.21.15.84:0/1562344282 >> v2:172.21.15.161:3300/0 conn(0x7f08900b3a00 msgr2=0x7f08900aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:13.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f088ea00640 1 --2- 172.21.15.84:0/1562344282 >> v2:172.21.15.161:3300/0 conn(0x7f08900b3a00 0x7f08900aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f088ea00640 1 -- 172.21.15.84:0/1562344282 >> v1:172.21.15.161:6789/0 conn(0x7f08900cf100 legacy=0x7f08900d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:13.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.277+0000 7f088ea00640 1 -- 172.21.15.84:0/1562344282 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900b0850 con 0x7f089015c1f0 2024-03-07T07:32:13.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f088ea00640 1 --2- 172.21.15.84:0/1562344282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f089015c1f0 0x7f08900b1330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f089008c2a0 tx=0x7f088001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f59d67f28c6353 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:13.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f088d600640 1 -- 172.21.15.84:0/1562344282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800b2070 con 0x7f089015c1f0 2024-03-07T07:32:13.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f088d600640 1 -- 172.21.15.84:0/1562344282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08800a9070 con 0x7f089015c1f0 2024-03-07T07:32:13.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f088d600640 1 -- 172.21.15.84:0/1562344282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800ad880 con 0x7f089015c1f0 2024-03-07T07:32:13.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f0895a00640 1 -- 172.21.15.84:0/1562344282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f089015c1f0 msgr2=0x7f08900b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f0895a00640 1 --2- 172.21.15.84:0/1562344282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f089015c1f0 0x7f08900b1330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f089008c2a0 tx=0x7f088001c450 comp rx=0 tx=0).stop 2024-03-07T07:32:13.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f0895a00640 1 -- 172.21.15.84:0/1562344282 shutdown_connections 2024-03-07T07:32:13.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f0895a00640 1 --2- 172.21.15.84:0/1562344282 >> v2:172.21.15.161:3300/0 conn(0x7f08900b3a00 0x7f08900aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f0895a00640 1 --2- 172.21.15.84:0/1562344282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f089015c1f0 0x7f08900b1330 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f0895a00640 1 -- 172.21.15.84:0/1562344282 >> 172.21.15.84:0/1562344282 conn(0x7f08900b1ed0 msgr2=0x7f08900b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:13.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f0895a00640 1 -- 172.21.15.84:0/1562344282 shutdown_connections 2024-03-07T07:32:13.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.281+0000 7f0895a00640 1 -- 172.21.15.84:0/1562344282 wait complete. 2024-03-07T07:32:13.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 Processor -- start 2024-03-07T07:32:13.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 -- start start 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08900b3a00 0x7f08901f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08900cf100 0x7f0890152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f089015c1f0 0x7f0890152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0890168ce0 con 0x7f08900cf100 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900aff00 con 0x7f08900b3a00 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0890168e60 con 0x7f089015c1f0 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08900cf100 0x7f0890152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08900cf100 0x7f0890152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44534/0 (socket says 172.21.15.84:44534) 2024-03-07T07:32:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 -- 172.21.15.84:0/2199290900 learned_addr learned my addr 172.21.15.84:0/2199290900 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 -- 172.21.15.84:0/2199290900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f089015c1f0 msgr2=0x7f0890152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f089015c1f0 0x7f0890152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 -- 172.21.15.84:0/2199290900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08900b3a00 msgr2=0x7f08901f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08900b3a00 0x7f08901f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 -- 172.21.15.84:0/2199290900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890151350 con 0x7f08900cf100 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f088e000640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08900cf100 0x7f0890152110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c450 tx=0x7f087c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0886a00640 1 -- 172.21.15.84:0/2199290900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c012830 con 0x7f08900cf100 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0886a00640 1 -- 172.21.15.84:0/2199290900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c017070 con 0x7f08900cf100 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0886a00640 1 -- 172.21.15.84:0/2199290900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c012c30 con 0x7f08900cf100 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0890151630 con 0x7f08900cf100 2024-03-07T07:32:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.285+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0890151bf0 con 0x7f08900cf100 2024-03-07T07:32:13.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.289+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0890151df0 con 0x7f08900cf100 2024-03-07T07:32:13.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.289+0000 7f0886a00640 1 -- 172.21.15.84:0/2199290900 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f087c01c460 con 0x7f08900cf100 2024-03-07T07:32:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.289+0000 7f0886a00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0870066f60 0x7f0870069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.289+0000 7f0886a00640 1 -- 172.21.15.84:0/2199290900 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f087c084ea0 con 0x7f08900cf100 2024-03-07T07:32:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.289+0000 7f088ea00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0870066f60 0x7f0870069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.289+0000 7f088ea00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0870066f60 0x7f0870069420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08800af000 tx=0x7f0880008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.293+0000 7f0886a00640 1 -- 172.21.15.84:0/2199290900 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f0890151df0 con 0x7f08900cf100 2024-03-07T07:32:13.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.461+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0890062d40 con 0x7f08900cf100 2024-03-07T07:32:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.461+0000 7f0886a00640 1 -- 172.21.15.84:0/2199290900 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f087c055e10 con 0x7f08900cf100 2024-03-07T07:32:13.464 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:13.464 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":34,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:32:10.712611+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:32:07.581845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-07T07:32:08.085165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:32:13.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0870066f60 msgr2=0x7f0870069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0870066f60 0x7f0870069420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08800af000 tx=0x7f0880008040 comp rx=0 tx=0).stop 2024-03-07T07:32:13.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08900cf100 msgr2=0x7f0890152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08900cf100 0x7f0890152110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c450 tx=0x7f087c00c910 comp rx=0 tx=0).stop 2024-03-07T07:32:13.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 shutdown_connections 2024-03-07T07:32:13.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0870066f60 0x7f0870069420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f089015c1f0 0x7f0890152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08900cf100 0x7f0890152110 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 --2- 172.21.15.84:0/2199290900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08900b3a00 0x7f08901f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 >> 172.21.15.84:0/2199290900 conn(0x7f08900b1ed0 msgr2=0x7f0890071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:13.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 shutdown_connections 2024-03-07T07:32:13.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.465+0000 7f0895a00640 1 -- 172.21.15.84:0/2199290900 wait complete. 2024-03-07T07:32:13.485 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-07T07:32:13.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:32:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.617+0000 7fb5f7600640 1 Processor -- start 2024-03-07T07:32:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.617+0000 7fb5f7600640 1 -- start start 2024-03-07T07:32:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.617+0000 7fb5f7600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5f015c1f0 0x7fb5f00b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.617+0000 7fb5f7600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00b0290 con 0x7fb5f00cf100 2024-03-07T07:32:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.617+0000 7fb5f7600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00b0570 con 0x7fb5f00b3a00 2024-03-07T07:32:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.617+0000 7fb5f7600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f00b1d40 con 0x7fb5f015c1f0 2024-03-07T07:32:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5efe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb5f00cf100 0x7fb5f00d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56770/0 (socket says 172.21.15.84:56770) 2024-03-07T07:32:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5efe00640 1 -- 172.21.15.84:0/2880425445 learned_addr learned my addr 172.21.15.84:0/2880425445 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5f4c00640 1 --2- 172.21.15.84:0/2880425445 >> v2:172.21.15.84:3300/0 conn(0x7fb5f015c1f0 0x7fb5f00b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5f4c00640 1 -- 172.21.15.84:0/2880425445 >> v1:172.21.15.161:6789/0 conn(0x7fb5f00b3a00 legacy=0x7fb5f00aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5f4c00640 1 -- 172.21.15.84:0/2880425445 >> v1:172.21.15.84:6789/0 conn(0x7fb5f00cf100 legacy=0x7fb5f00d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5f4c00640 1 -- 172.21.15.84:0/2880425445 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00b0850 con 0x7fb5f015c1f0 2024-03-07T07:32:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5f4c00640 1 --2- 172.21.15.84:0/2880425445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f015c1f0 0x7fb5f00b1330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40097c0 tx=0x7fb5e401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fb42f4c1e88a53 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5ef400640 1 -- 172.21.15.84:0/2880425445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40b0070 con 0x7fb5f015c1f0 2024-03-07T07:32:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5ef400640 1 -- 172.21.15.84:0/2880425445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e40ab600 con 0x7fb5f015c1f0 2024-03-07T07:32:13.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.621+0000 7fb5ef400640 1 -- 172.21.15.84:0/2880425445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40ab9d0 con 0x7fb5f015c1f0 2024-03-07T07:32:13.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 -- 172.21.15.84:0/2880425445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f015c1f0 msgr2=0x7fb5f00b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 --2- 172.21.15.84:0/2880425445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f015c1f0 0x7fb5f00b1330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40097c0 tx=0x7fb5e401c3d0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 -- 172.21.15.84:0/2880425445 shutdown_connections 2024-03-07T07:32:13.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 --2- 172.21.15.84:0/2880425445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f015c1f0 0x7fb5f00b1330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 -- 172.21.15.84:0/2880425445 >> 172.21.15.84:0/2880425445 conn(0x7fb5f00b1ed0 msgr2=0x7fb5f00b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:13.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 -- 172.21.15.84:0/2880425445 shutdown_connections 2024-03-07T07:32:13.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 -- 172.21.15.84:0/2880425445 wait complete. 2024-03-07T07:32:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 Processor -- start 2024-03-07T07:32:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.625+0000 7fb5f7600640 1 -- start start 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f00b3a00 0x7fb5f015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f00cf100 0x7fb5f0146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5f015c1f0 0x7fb5f0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f016a080 con 0x7fb5f00b3a00 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f0169f00 con 0x7fb5f00cf100 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f016a200 con 0x7fb5f015c1f0 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f00b3a00 0x7fb5f015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f00b3a00 0x7fb5f015b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44560/0 (socket says 172.21.15.84:44560) 2024-03-07T07:32:13.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 -- 172.21.15.84:0/94335887 learned_addr learned my addr 172.21.15.84:0/94335887 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:13.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 -- 172.21.15.84:0/94335887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5f015c1f0 msgr2=0x7fb5f0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5f015c1f0 0x7fb5f0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 -- 172.21.15.84:0/94335887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f00cf100 msgr2=0x7fb5f0146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f00cf100 0x7fb5f0146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 -- 172.21.15.84:0/94335887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0151870 con 0x7fb5f00b3a00 2024-03-07T07:32:13.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f4c00640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f00b3a00 0x7fb5f015b070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40ae040 tx=0x7fb5e401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:13.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5ecc00640 1 -- 172.21.15.84:0/94335887 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40b0050 con 0x7fb5f00b3a00 2024-03-07T07:32:13.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5ecc00640 1 -- 172.21.15.84:0/94335887 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e40bc070 con 0x7fb5f00b3a00 2024-03-07T07:32:13.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5ecc00640 1 -- 172.21.15.84:0/94335887 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40aaa70 con 0x7fb5f00b3a00 2024-03-07T07:32:13.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f0151b50 con 0x7fb5f00b3a00 2024-03-07T07:32:13.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f0152110 con 0x7fb5f00b3a00 2024-03-07T07:32:13.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.629+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f0062d40 con 0x7fb5f00b3a00 2024-03-07T07:32:13.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.633+0000 7fb5ecc00640 1 -- 172.21.15.84:0/94335887 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb5e40aac10 con 0x7fb5f00b3a00 2024-03-07T07:32:13.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.633+0000 7fb5ecc00640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb5d0066f60 0x7fb5d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:13.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.633+0000 7fb5ecc00640 1 -- 172.21.15.84:0/94335887 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5e411fab0 con 0x7fb5f00b3a00 2024-03-07T07:32:13.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.633+0000 7fb5efe00640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb5d0066f60 0x7fb5d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:13.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.633+0000 7fb5efe00640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb5d0066f60 0x7fb5d0069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc000f70 tx=0x7fb5dc007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:13.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.637+0000 7fb5ecc00640 1 -- 172.21.15.84:0/94335887 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb5e4016050 con 0x7fb5f00b3a00 2024-03-07T07:32:13.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.805+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5f01578b0 con 0x7fb5d0066f60 2024-03-07T07:32:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.813+0000 7fb5ecc00640 1 -- 172.21.15.84:0/94335887 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249420 (secure 0 0 0) 0x7fb5f01578b0 con 0x7fb5d0066f60 2024-03-07T07:32:13.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb5d0066f60 msgr2=0x7fb5d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb5d0066f60 0x7fb5d0069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc000f70 tx=0x7fb5dc007a90 comp rx=0 tx=0).stop 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f00b3a00 msgr2=0x7fb5f015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f00b3a00 0x7fb5f015b070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40ae040 tx=0x7fb5e401ac10 comp rx=0 tx=0).stop 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 shutdown_connections 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb5d0066f60 0x7fb5d0069420 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5f015c1f0 0x7fb5f0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f00cf100 0x7fb5f0146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 --2- 172.21.15.84:0/94335887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f00b3a00 0x7fb5f015b070 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 >> 172.21.15.84:0/94335887 conn(0x7fb5f00b1ed0 msgr2=0x7fb5f00cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:13.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 shutdown_connections 2024-03-07T07:32:13.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:13.817+0000 7fb5f7600640 1 -- 172.21.15.84:0/94335887 wait complete. 2024-03-07T07:32:13.842 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-03-07T07:32:12.890816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220056,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754664,"statfs":{"total":773094113280,"available":772868775936,"internally_reserved":0,"allocated":3973120,"data_stored":2239621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.195356"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734464+0000","last_change":"2024-03-07T07:32:09.730012+0000","last_active":"2024-03-07T07:32:09.734464+0000","last_peered":"2024-03-07T07:32:09.734464+0000","last_clean":"2024-03-07T07:32:09.734464+0000","last_became_active":"2024-03-07T07:32:09.729740+0000","last_became_peered":"2024-03-07T07:32:09.729740+0000","last_unstale":"2024-03-07T07:32:09.734464+0000","last_undegraded":"2024-03-07T07:32:09.734464+0000","last_fullsized":"2024-03-07T07:32:09.734464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:27.999230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.713513+0000","last_change":"2024-03-07T07:32:08.713513+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.713513+0000","last_undegraded":"2024-03-07T07:32:08.713513+0000","last_fullsized":"2024-03-07T07:32:08.713513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.748155+0000","last_change":"2024-03-07T07:32:09.741223+0000","last_active":"2024-03-07T07:32:09.748155+0000","last_peered":"2024-03-07T07:32:09.748155+0000","last_clean":"2024-03-07T07:32:09.748155+0000","last_became_active":"2024-03-07T07:32:09.740812+0000","last_became_peered":"2024-03-07T07:32:09.740812+0000","last_unstale":"2024-03-07T07:32:09.748155+0000","last_undegraded":"2024-03-07T07:32:09.748155+0000","last_fullsized":"2024-03-07T07:32:09.748155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:11:31.178552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704337+0000","last_change":"2024-03-07T07:32:08.704337+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704337+0000","last_undegraded":"2024-03-07T07:32:08.704337+0000","last_fullsized":"2024-03-07T07:32:08.704337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.717859+0000","last_change":"2024-03-07T07:32:08.717859+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.717859+0000","last_undegraded":"2024-03-07T07:32:08.717859+0000","last_fullsized":"2024-03-07T07:32:08.717859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711383+0000","last_change":"2024-03-07T07:32:08.711383+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711383+0000","last_undegraded":"2024-03-07T07:32:08.711383+0000","last_fullsized":"2024-03-07T07:32:08.711383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.750652+0000","last_change":"2024-03-07T07:32:09.745334+0000","last_active":"2024-03-07T07:32:09.750652+0000","last_peered":"2024-03-07T07:32:09.750652+0000","last_clean":"2024-03-07T07:32:09.750652+0000","last_became_active":"2024-03-07T07:32:09.745084+0000","last_became_peered":"2024-03-07T07:32:09.745084+0000","last_unstale":"2024-03-07T07:32:09.750652+0000","last_undegraded":"2024-03-07T07:32:09.750652+0000","last_fullsized":"2024-03-07T07:32:09.750652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:12:19.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744785+0000","last_change":"2024-03-07T07:32:09.736538+0000","last_active":"2024-03-07T07:32:09.744785+0000","last_peered":"2024-03-07T07:32:09.744785+0000","last_clean":"2024-03-07T07:32:09.744785+0000","last_became_active":"2024-03-07T07:32:09.736186+0000","last_became_peered":"2024-03-07T07:32:09.736186+0000","last_unstale":"2024-03-07T07:32:09.744785+0000","last_undegraded":"2024-03-07T07:32:09.744785+0000","last_fullsized":"2024-03-07T07:32:09.744785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:18.860889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752779+0000","last_change":"2024-03-07T07:32:09.744105+0000","last_active":"2024-03-07T07:32:09.752779+0000","last_peered":"2024-03-07T07:32:09.752779+0000","last_clean":"2024-03-07T07:32:09.752779+0000","last_became_active":"2024-03-07T07:32:09.743854+0000","last_became_peered":"2024-03-07T07:32:09.743854+0000","last_unstale":"2024-03-07T07:32:09.752779+0000","last_undegraded":"2024-03-07T07:32:09.752779+0000","last_fullsized":"2024-03-07T07:32:09.752779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:10.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704847+0000","last_change":"2024-03-07T07:32:08.704847+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704847+0000","last_undegraded":"2024-03-07T07:32:08.704847+0000","last_fullsized":"2024-03-07T07:32:08.704847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734362+0000","last_change":"2024-03-07T07:32:09.729434+0000","last_active":"2024-03-07T07:32:09.734362+0000","last_peered":"2024-03-07T07:32:09.734362+0000","last_clean":"2024-03-07T07:32:09.734362+0000","last_became_active":"2024-03-07T07:32:09.728932+0000","last_became_peered":"2024-03-07T07:32:09.728932+0000","last_unstale":"2024-03-07T07:32:09.734362+0000","last_undegraded":"2024-03-07T07:32:09.734362+0000","last_fullsized":"2024-03-07T07:32:09.734362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:26:25.930786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752687+0000","last_change":"2024-03-07T07:32:09.742631+0000","last_active":"2024-03-07T07:32:09.752687+0000","last_peered":"2024-03-07T07:32:09.752687+0000","last_clean":"2024-03-07T07:32:09.752687+0000","last_became_active":"2024-03-07T07:32:09.740785+0000","last_became_peered":"2024-03-07T07:32:09.740785+0000","last_unstale":"2024-03-07T07:32:09.752687+0000","last_undegraded":"2024-03-07T07:32:09.752687+0000","last_fullsized":"2024-03-07T07:32:09.752687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:06.625131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.707637+0000","last_change":"2024-03-07T07:32:08.707637+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.707637+0000","last_undegraded":"2024-03-07T07:32:08.707637+0000","last_fullsized":"2024-03-07T07:32:08.707637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703686+0000","last_change":"2024-03-07T07:32:08.703686+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703686+0000","last_undegraded":"2024-03-07T07:32:08.703686+0000","last_fullsized":"2024-03-07T07:32:08.703686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.735720+0000","last_change":"2024-03-07T07:32:09.727701+0000","last_active":"2024-03-07T07:32:09.735720+0000","last_peered":"2024-03-07T07:32:09.735720+0000","last_clean":"2024-03-07T07:32:09.735720+0000","last_became_active":"2024-03-07T07:32:09.727424+0000","last_became_peered":"2024-03-07T07:32:09.727424+0000","last_unstale":"2024-03-07T07:32:09.735720+0000","last_undegraded":"2024-03-07T07:32:09.735720+0000","last_fullsized":"2024-03-07T07:32:09.735720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:15.863540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.740620+0000","last_change":"2024-03-07T07:32:09.732094+0000","last_active":"2024-03-07T07:32:09.740620+0000","last_peered":"2024-03-07T07:32:09.740620+0000","last_clean":"2024-03-07T07:32:09.740620+0000","last_became_active":"2024-03-07T07:32:09.731685+0000","last_became_peered":"2024-03-07T07:32:09.731685+0000","last_unstale":"2024-03-07T07:32:09.740620+0000","last_undegraded":"2024-03-07T07:32:09.740620+0000","last_fullsized":"2024-03-07T07:32:09.740620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:57.484266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737685+0000","last_change":"2024-03-07T07:32:09.733381+0000","last_active":"2024-03-07T07:32:09.737685+0000","last_peered":"2024-03-07T07:32:09.737685+0000","last_clean":"2024-03-07T07:32:09.737685+0000","last_became_active":"2024-03-07T07:32:09.733061+0000","last_became_peered":"2024-03-07T07:32:09.733061+0000","last_unstale":"2024-03-07T07:32:09.737685+0000","last_undegraded":"2024-03-07T07:32:09.737685+0000","last_fullsized":"2024-03-07T07:32:09.737685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:41:20.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.712395+0000","last_change":"2024-03-07T07:32:08.712395+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.712395+0000","last_undegraded":"2024-03-07T07:32:08.712395+0000","last_fullsized":"2024-03-07T07:32:08.712395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.712198+0000","last_change":"2024-03-07T07:32:08.712198+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.712198+0000","last_undegraded":"2024-03-07T07:32:08.712198+0000","last_fullsized":"2024-03-07T07:32:08.712198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708270+0000","last_change":"2024-03-07T07:32:08.708270+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708270+0000","last_undegraded":"2024-03-07T07:32:08.708270+0000","last_fullsized":"2024-03-07T07:32:08.708270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737291+0000","last_change":"2024-03-07T07:32:09.733151+0000","last_active":"2024-03-07T07:32:09.737291+0000","last_peered":"2024-03-07T07:32:09.737291+0000","last_clean":"2024-03-07T07:32:09.737291+0000","last_became_active":"2024-03-07T07:32:09.732916+0000","last_became_peered":"2024-03-07T07:32:09.732916+0000","last_unstale":"2024-03-07T07:32:09.737291+0000","last_undegraded":"2024-03-07T07:32:09.737291+0000","last_fullsized":"2024-03-07T07:32:09.737291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:12:19.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734352+0000","last_change":"2024-03-07T07:32:09.729634+0000","last_active":"2024-03-07T07:32:09.734352+0000","last_peered":"2024-03-07T07:32:09.734352+0000","last_clean":"2024-03-07T07:32:09.734352+0000","last_became_active":"2024-03-07T07:32:09.729365+0000","last_became_peered":"2024-03-07T07:32:09.729365+0000","last_unstale":"2024-03-07T07:32:09.734352+0000","last_undegraded":"2024-03-07T07:32:09.734352+0000","last_fullsized":"2024-03-07T07:32:09.734352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:47.428345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.707282+0000","last_change":"2024-03-07T07:32:08.707282+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.707282+0000","last_undegraded":"2024-03-07T07:32:08.707282+0000","last_fullsized":"2024-03-07T07:32:08.707282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.748885+0000","last_change":"2024-03-07T07:32:09.743716+0000","last_active":"2024-03-07T07:32:09.748885+0000","last_peered":"2024-03-07T07:32:09.748885+0000","last_clean":"2024-03-07T07:32:09.748885+0000","last_became_active":"2024-03-07T07:32:09.743472+0000","last_became_peered":"2024-03-07T07:32:09.743472+0000","last_unstale":"2024-03-07T07:32:09.748885+0000","last_undegraded":"2024-03-07T07:32:09.748885+0000","last_fullsized":"2024-03-07T07:32:09.748885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:22:41.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705258+0000","last_change":"2024-03-07T07:32:08.705258+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705258+0000","last_undegraded":"2024-03-07T07:32:08.705258+0000","last_fullsized":"2024-03-07T07:32:08.705258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704237+0000","last_change":"2024-03-07T07:32:08.704237+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704237+0000","last_undegraded":"2024-03-07T07:32:08.704237+0000","last_fullsized":"2024-03-07T07:32:08.704237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710970+0000","last_change":"2024-03-07T07:32:08.710970+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710970+0000","last_undegraded":"2024-03-07T07:32:08.710970+0000","last_fullsized":"2024-03-07T07:32:08.710970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.746972+0000","last_change":"2024-03-07T07:32:09.737554+0000","last_active":"2024-03-07T07:32:09.746972+0000","last_peered":"2024-03-07T07:32:09.746972+0000","last_clean":"2024-03-07T07:32:09.746972+0000","last_became_active":"2024-03-07T07:32:09.736203+0000","last_became_peered":"2024-03-07T07:32:09.736203+0000","last_unstale":"2024-03-07T07:32:09.746972+0000","last_undegraded":"2024-03-07T07:32:09.746972+0000","last_fullsized":"2024-03-07T07:32:09.746972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:15.863540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737268+0000","last_change":"2024-03-07T07:32:09.732781+0000","last_active":"2024-03-07T07:32:09.737268+0000","last_peered":"2024-03-07T07:32:09.737268+0000","last_clean":"2024-03-07T07:32:09.737268+0000","last_became_active":"2024-03-07T07:32:09.732522+0000","last_became_peered":"2024-03-07T07:32:09.732522+0000","last_unstale":"2024-03-07T07:32:09.737268+0000","last_undegraded":"2024-03-07T07:32:09.737268+0000","last_fullsized":"2024-03-07T07:32:09.737268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:22:41.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737916+0000","last_change":"2024-03-07T07:32:09.733989+0000","last_active":"2024-03-07T07:32:09.737916+0000","last_peered":"2024-03-07T07:32:09.737916+0000","last_clean":"2024-03-07T07:32:09.737916+0000","last_became_active":"2024-03-07T07:32:09.733697+0000","last_became_peered":"2024-03-07T07:32:09.733697+0000","last_unstale":"2024-03-07T07:32:09.737916+0000","last_undegraded":"2024-03-07T07:32:09.737916+0000","last_fullsized":"2024-03-07T07:32:09.737916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:24:54.602616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.745886+0000","last_change":"2024-03-07T07:32:09.737262+0000","last_active":"2024-03-07T07:32:09.745886+0000","last_peered":"2024-03-07T07:32:09.745886+0000","last_clean":"2024-03-07T07:32:09.745886+0000","last_became_active":"2024-03-07T07:32:09.734562+0000","last_became_peered":"2024-03-07T07:32:09.734562+0000","last_unstale":"2024-03-07T07:32:09.745886+0000","last_undegraded":"2024-03-07T07:32:09.745886+0000","last_fullsized":"2024-03-07T07:32:09.745886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:58.156994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.731496+0000","last_change":"2024-03-07T07:32:09.720498+0000","last_active":"2024-03-07T07:32:09.731496+0000","last_peered":"2024-03-07T07:32:09.731496+0000","last_clean":"2024-03-07T07:32:09.731496+0000","last_became_active":"2024-03-07T07:32:09.720213+0000","last_became_peered":"2024-03-07T07:32:09.720213+0000","last_unstale":"2024-03-07T07:32:09.731496+0000","last_undegraded":"2024-03-07T07:32:09.731496+0000","last_fullsized":"2024-03-07T07:32:09.731496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:56.867331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708705+0000","last_change":"2024-03-07T07:32:08.708705+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708705+0000","last_undegraded":"2024-03-07T07:32:08.708705+0000","last_fullsized":"2024-03-07T07:32:08.708705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752414+0000","last_change":"2024-03-07T07:32:08.727746+0000","last_active":"2024-03-07T07:32:09.752414+0000","last_peered":"2024-03-07T07:32:09.752414+0000","last_clean":"2024-03-07T07:32:09.752414+0000","last_became_active":"2024-03-07T07:32:08.726860+0000","last_became_peered":"2024-03-07T07:32:08.726860+0000","last_unstale":"2024-03-07T07:32:09.752414+0000","last_undegraded":"2024-03-07T07:32:09.752414+0000","last_fullsized":"2024-03-07T07:32:09.752414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:41:19.781917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.747653+0000","last_change":"2024-03-07T07:32:09.740174+0000","last_active":"2024-03-07T07:32:09.747653+0000","last_peered":"2024-03-07T07:32:09.747653+0000","last_clean":"2024-03-07T07:32:09.747653+0000","last_became_active":"2024-03-07T07:32:09.739811+0000","last_became_peered":"2024-03-07T07:32:09.739811+0000","last_unstale":"2024-03-07T07:32:09.747653+0000","last_undegraded":"2024-03-07T07:32:09.747653+0000","last_fullsized":"2024-03-07T07:32:09.747653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:57.484266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726508+0000","last_change":"2024-03-07T07:32:08.724895+0000","last_active":"2024-03-07T07:32:08.726508+0000","last_peered":"2024-03-07T07:32:08.726508+0000","last_clean":"2024-03-07T07:32:08.726508+0000","last_became_active":"2024-03-07T07:32:08.724609+0000","last_became_peered":"2024-03-07T07:32:08.724609+0000","last_unstale":"2024-03-07T07:32:08.726508+0000","last_undegraded":"2024-03-07T07:32:08.726508+0000","last_fullsized":"2024-03-07T07:32:08.726508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:35:45.488891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.747809+0000","last_change":"2024-03-07T07:32:09.742029+0000","last_active":"2024-03-07T07:32:09.747809+0000","last_peered":"2024-03-07T07:32:09.747809+0000","last_clean":"2024-03-07T07:32:09.747809+0000","last_became_active":"2024-03-07T07:32:09.741612+0000","last_became_peered":"2024-03-07T07:32:09.741612+0000","last_unstale":"2024-03-07T07:32:09.747809+0000","last_undegraded":"2024-03-07T07:32:09.747809+0000","last_fullsized":"2024-03-07T07:32:09.747809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:04.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730112+0000","last_change":"2024-03-07T07:32:08.728713+0000","last_active":"2024-03-07T07:32:08.730112+0000","last_peered":"2024-03-07T07:32:08.730112+0000","last_clean":"2024-03-07T07:32:08.730112+0000","last_became_active":"2024-03-07T07:32:08.728291+0000","last_became_peered":"2024-03-07T07:32:08.728291+0000","last_unstale":"2024-03-07T07:32:08.730112+0000","last_undegraded":"2024-03-07T07:32:08.730112+0000","last_fullsized":"2024-03-07T07:32:08.730112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:56.220831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705484+0000","last_change":"2024-03-07T07:32:08.705484+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705484+0000","last_undegraded":"2024-03-07T07:32:08.705484+0000","last_fullsized":"2024-03-07T07:32:08.705484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.720810+0000","last_change":"2024-03-07T07:32:08.717295+0000","last_active":"2024-03-07T07:32:08.720810+0000","last_peered":"2024-03-07T07:32:08.720810+0000","last_clean":"2024-03-07T07:32:08.720810+0000","last_became_active":"2024-03-07T07:32:08.715284+0000","last_became_peered":"2024-03-07T07:32:08.715284+0000","last_unstale":"2024-03-07T07:32:08.720810+0000","last_undegraded":"2024-03-07T07:32:08.720810+0000","last_fullsized":"2024-03-07T07:32:08.720810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:36:01.958659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752638+0000","last_change":"2024-03-07T07:32:09.742100+0000","last_active":"2024-03-07T07:32:09.752638+0000","last_peered":"2024-03-07T07:32:09.752638+0000","last_clean":"2024-03-07T07:32:09.752638+0000","last_became_active":"2024-03-07T07:32:09.741769+0000","last_became_peered":"2024-03-07T07:32:09.741769+0000","last_unstale":"2024-03-07T07:32:09.752638+0000","last_undegraded":"2024-03-07T07:32:09.752638+0000","last_fullsized":"2024-03-07T07:32:09.752638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:54:10.883851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752898+0000","last_change":"2024-03-07T07:32:08.724105+0000","last_active":"2024-03-07T07:32:09.752898+0000","last_peered":"2024-03-07T07:32:09.752898+0000","last_clean":"2024-03-07T07:32:09.752898+0000","last_became_active":"2024-03-07T07:32:08.723796+0000","last_became_peered":"2024-03-07T07:32:08.723796+0000","last_unstale":"2024-03-07T07:32:09.752898+0000","last_undegraded":"2024-03-07T07:32:09.752898+0000","last_fullsized":"2024-03-07T07:32:09.752898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:09.647569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744660+0000","last_change":"2024-03-07T07:32:09.736758+0000","last_active":"2024-03-07T07:32:09.744660+0000","last_peered":"2024-03-07T07:32:09.744660+0000","last_clean":"2024-03-07T07:32:09.744660+0000","last_became_active":"2024-03-07T07:32:09.736405+0000","last_became_peered":"2024-03-07T07:32:09.736405+0000","last_unstale":"2024-03-07T07:32:09.744660+0000","last_undegraded":"2024-03-07T07:32:09.744660+0000","last_fullsized":"2024-03-07T07:32:09.744660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:44:21.013212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.750777+0000","last_change":"2024-03-07T07:32:08.725455+0000","last_active":"2024-03-07T07:32:09.750777+0000","last_peered":"2024-03-07T07:32:09.750777+0000","last_clean":"2024-03-07T07:32:09.750777+0000","last_became_active":"2024-03-07T07:32:08.721591+0000","last_became_peered":"2024-03-07T07:32:08.721591+0000","last_unstale":"2024-03-07T07:32:09.750777+0000","last_undegraded":"2024-03-07T07:32:09.750777+0000","last_fullsized":"2024-03-07T07:32:09.750777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:23.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752740+0000","last_change":"2024-03-07T07:32:09.743365+0000","last_active":"2024-03-07T07:32:09.752740+0000","last_peered":"2024-03-07T07:32:09.752740+0000","last_clean":"2024-03-07T07:32:09.752740+0000","last_became_active":"2024-03-07T07:32:09.743117+0000","last_became_peered":"2024-03-07T07:32:09.743117+0000","last_unstale":"2024-03-07T07:32:09.752740+0000","last_undegraded":"2024-03-07T07:32:09.752740+0000","last_fullsized":"2024-03-07T07:32:09.752740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:14.634090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725040+0000","last_change":"2024-03-07T07:32:08.722719+0000","last_active":"2024-03-07T07:32:08.725040+0000","last_peered":"2024-03-07T07:32:08.725040+0000","last_clean":"2024-03-07T07:32:08.725040+0000","last_became_active":"2024-03-07T07:32:08.722402+0000","last_became_peered":"2024-03-07T07:32:08.722402+0000","last_unstale":"2024-03-07T07:32:08.725040+0000","last_undegraded":"2024-03-07T07:32:08.725040+0000","last_fullsized":"2024-03-07T07:32:08.725040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:55:38.571318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703677+0000","last_change":"2024-03-07T07:32:08.703677+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703677+0000","last_undegraded":"2024-03-07T07:32:08.703677+0000","last_fullsized":"2024-03-07T07:32:08.703677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.719065+0000","last_change":"2024-03-07T07:32:08.717797+0000","last_active":"2024-03-07T07:32:09.719065+0000","last_peered":"2024-03-07T07:32:09.719065+0000","last_clean":"2024-03-07T07:32:09.719065+0000","last_became_active":"2024-03-07T07:32:08.717520+0000","last_became_peered":"2024-03-07T07:32:08.717520+0000","last_unstale":"2024-03-07T07:32:09.719065+0000","last_undegraded":"2024-03-07T07:32:09.719065+0000","last_fullsized":"2024-03-07T07:32:09.719065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:02.290184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744182+0000","last_change":"2024-03-07T07:32:09.738676+0000","last_active":"2024-03-07T07:32:09.744182+0000","last_peered":"2024-03-07T07:32:09.744182+0000","last_clean":"2024-03-07T07:32:09.744182+0000","last_became_active":"2024-03-07T07:32:09.738382+0000","last_became_peered":"2024-03-07T07:32:09.738382+0000","last_unstale":"2024-03-07T07:32:09.744182+0000","last_undegraded":"2024-03-07T07:32:09.744182+0000","last_fullsized":"2024-03-07T07:32:09.744182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:40:45.721561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726330+0000","last_change":"2024-03-07T07:32:08.725251+0000","last_active":"2024-03-07T07:32:08.726330+0000","last_peered":"2024-03-07T07:32:08.726330+0000","last_clean":"2024-03-07T07:32:08.726330+0000","last_became_active":"2024-03-07T07:32:08.724921+0000","last_became_peered":"2024-03-07T07:32:08.724921+0000","last_unstale":"2024-03-07T07:32:08.726330+0000","last_undegraded":"2024-03-07T07:32:08.726330+0000","last_fullsized":"2024-03-07T07:32:08.726330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:46.422783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704721+0000","last_change":"2024-03-07T07:32:08.704721+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704721+0000","last_undegraded":"2024-03-07T07:32:08.704721+0000","last_fullsized":"2024-03-07T07:32:08.704721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730748+0000","last_change":"2024-03-07T07:32:08.729316+0000","last_active":"2024-03-07T07:32:08.730748+0000","last_peered":"2024-03-07T07:32:08.730748+0000","last_clean":"2024-03-07T07:32:08.730748+0000","last_became_active":"2024-03-07T07:32:08.729021+0000","last_became_peered":"2024-03-07T07:32:08.729021+0000","last_unstale":"2024-03-07T07:32:08.730748+0000","last_undegraded":"2024-03-07T07:32:08.730748+0000","last_fullsized":"2024-03-07T07:32:08.730748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:17.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703557+0000","last_change":"2024-03-07T07:32:08.703557+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703557+0000","last_undegraded":"2024-03-07T07:32:08.703557+0000","last_fullsized":"2024-03-07T07:32:08.703557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.751068+0000","last_change":"2024-03-07T07:32:08.717596+0000","last_active":"2024-03-07T07:32:09.751068+0000","last_peered":"2024-03-07T07:32:09.751068+0000","last_clean":"2024-03-07T07:32:09.751068+0000","last_became_active":"2024-03-07T07:32:08.716657+0000","last_became_peered":"2024-03-07T07:32:08.716657+0000","last_unstale":"2024-03-07T07:32:09.751068+0000","last_undegraded":"2024-03-07T07:32:09.751068+0000","last_fullsized":"2024-03-07T07:32:09.751068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:17.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734385+0000","last_change":"2024-03-07T07:32:09.729099+0000","last_active":"2024-03-07T07:32:09.734385+0000","last_peered":"2024-03-07T07:32:09.734385+0000","last_clean":"2024-03-07T07:32:09.734385+0000","last_became_active":"2024-03-07T07:32:09.728580+0000","last_became_peered":"2024-03-07T07:32:09.728580+0000","last_unstale":"2024-03-07T07:32:09.734385+0000","last_undegraded":"2024-03-07T07:32:09.734385+0000","last_fullsized":"2024-03-07T07:32:09.734385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:47:58.388381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.723917+0000","last_change":"2024-03-07T07:32:08.719544+0000","last_active":"2024-03-07T07:32:08.723917+0000","last_peered":"2024-03-07T07:32:08.723917+0000","last_clean":"2024-03-07T07:32:08.723917+0000","last_became_active":"2024-03-07T07:32:08.719222+0000","last_became_peered":"2024-03-07T07:32:08.719222+0000","last_unstale":"2024-03-07T07:32:08.723917+0000","last_undegraded":"2024-03-07T07:32:08.723917+0000","last_fullsized":"2024-03-07T07:32:08.723917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:46:42.066266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710818+0000","last_change":"2024-03-07T07:32:08.710818+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710818+0000","last_undegraded":"2024-03-07T07:32:08.710818+0000","last_fullsized":"2024-03-07T07:32:08.710818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752346+0000","last_change":"2024-03-07T07:32:08.714266+0000","last_active":"2024-03-07T07:32:09.752346+0000","last_peered":"2024-03-07T07:32:09.752346+0000","last_clean":"2024-03-07T07:32:09.752346+0000","last_became_active":"2024-03-07T07:32:08.713142+0000","last_became_peered":"2024-03-07T07:32:08.713142+0000","last_unstale":"2024-03-07T07:32:09.752346+0000","last_undegraded":"2024-03-07T07:32:09.752346+0000","last_fullsized":"2024-03-07T07:32:09.752346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:23:53.633589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704312+0000","last_change":"2024-03-07T07:32:08.704312+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704312+0000","last_undegraded":"2024-03-07T07:32:08.704312+0000","last_fullsized":"2024-03-07T07:32:08.704312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.720791+0000","last_change":"2024-03-07T07:32:08.717609+0000","last_active":"2024-03-07T07:32:08.720791+0000","last_peered":"2024-03-07T07:32:08.720791+0000","last_clean":"2024-03-07T07:32:08.720791+0000","last_became_active":"2024-03-07T07:32:08.717250+0000","last_became_peered":"2024-03-07T07:32:08.717250+0000","last_unstale":"2024-03-07T07:32:08.720791+0000","last_undegraded":"2024-03-07T07:32:08.720791+0000","last_fullsized":"2024-03-07T07:32:08.720791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:54.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.754629+0000","last_change":"2024-03-07T07:32:09.747488+0000","last_active":"2024-03-07T07:32:09.754629+0000","last_peered":"2024-03-07T07:32:09.754629+0000","last_clean":"2024-03-07T07:32:09.754629+0000","last_became_active":"2024-03-07T07:32:09.747152+0000","last_became_peered":"2024-03-07T07:32:09.747152+0000","last_unstale":"2024-03-07T07:32:09.754629+0000","last_undegraded":"2024-03-07T07:32:09.754629+0000","last_fullsized":"2024-03-07T07:32:09.754629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:06:31.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.722307+0000","last_change":"2024-03-07T07:32:08.719257+0000","last_active":"2024-03-07T07:32:08.722307+0000","last_peered":"2024-03-07T07:32:08.722307+0000","last_clean":"2024-03-07T07:32:08.722307+0000","last_became_active":"2024-03-07T07:32:08.718947+0000","last_became_peered":"2024-03-07T07:32:08.718947+0000","last_unstale":"2024-03-07T07:32:08.722307+0000","last_undegraded":"2024-03-07T07:32:08.722307+0000","last_fullsized":"2024-03-07T07:32:08.722307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:07:22.327340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734268+0000","last_change":"2024-03-07T07:32:09.727647+0000","last_active":"2024-03-07T07:32:09.734268+0000","last_peered":"2024-03-07T07:32:09.734268+0000","last_clean":"2024-03-07T07:32:09.734268+0000","last_became_active":"2024-03-07T07:32:09.727415+0000","last_became_peered":"2024-03-07T07:32:09.727415+0000","last_unstale":"2024-03-07T07:32:09.734268+0000","last_undegraded":"2024-03-07T07:32:09.734268+0000","last_fullsized":"2024-03-07T07:32:09.734268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:10:50.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725248+0000","last_change":"2024-03-07T07:32:08.722227+0000","last_active":"2024-03-07T07:32:08.725248+0000","last_peered":"2024-03-07T07:32:08.725248+0000","last_clean":"2024-03-07T07:32:08.725248+0000","last_became_active":"2024-03-07T07:32:08.721547+0000","last_became_peered":"2024-03-07T07:32:08.721547+0000","last_unstale":"2024-03-07T07:32:08.725248+0000","last_undegraded":"2024-03-07T07:32:08.725248+0000","last_fullsized":"2024-03-07T07:32:08.725248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:25.671835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.738566+0000","last_change":"2024-03-07T07:32:09.728668+0000","last_active":"2024-03-07T07:32:09.738566+0000","last_peered":"2024-03-07T07:32:09.738566+0000","last_clean":"2024-03-07T07:32:09.738566+0000","last_became_active":"2024-03-07T07:32:09.728355+0000","last_became_peered":"2024-03-07T07:32:09.728355+0000","last_unstale":"2024-03-07T07:32:09.738566+0000","last_undegraded":"2024-03-07T07:32:09.738566+0000","last_fullsized":"2024-03-07T07:32:09.738566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:23:36.667810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730135+0000","last_change":"2024-03-07T07:32:08.729034+0000","last_active":"2024-03-07T07:32:08.730135+0000","last_peered":"2024-03-07T07:32:08.730135+0000","last_clean":"2024-03-07T07:32:08.730135+0000","last_became_active":"2024-03-07T07:32:08.728745+0000","last_became_peered":"2024-03-07T07:32:08.728745+0000","last_unstale":"2024-03-07T07:32:08.730135+0000","last_undegraded":"2024-03-07T07:32:08.730135+0000","last_fullsized":"2024-03-07T07:32:08.730135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:11.184461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744006+0000","last_change":"2024-03-07T07:32:09.735410+0000","last_active":"2024-03-07T07:32:09.744006+0000","last_peered":"2024-03-07T07:32:09.744006+0000","last_clean":"2024-03-07T07:32:09.744006+0000","last_became_active":"2024-03-07T07:32:09.735140+0000","last_became_peered":"2024-03-07T07:32:09.735140+0000","last_unstale":"2024-03-07T07:32:09.744006+0000","last_undegraded":"2024-03-07T07:32:09.744006+0000","last_fullsized":"2024-03-07T07:32:09.744006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:35:37.916914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752220+0000","last_change":"2024-03-07T07:32:08.712845+0000","last_active":"2024-03-07T07:32:09.752220+0000","last_peered":"2024-03-07T07:32:09.752220+0000","last_clean":"2024-03-07T07:32:09.752220+0000","last_became_active":"2024-03-07T07:32:08.712543+0000","last_became_peered":"2024-03-07T07:32:08.712543+0000","last_unstale":"2024-03-07T07:32:09.752220+0000","last_undegraded":"2024-03-07T07:32:09.752220+0000","last_fullsized":"2024-03-07T07:32:09.752220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:43.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.709596+0000","last_change":"2024-03-07T07:32:08.709596+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.709596+0000","last_undegraded":"2024-03-07T07:32:08.709596+0000","last_fullsized":"2024-03-07T07:32:08.709596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.753504+0000","last_change":"2024-03-07T07:32:08.726767+0000","last_active":"2024-03-07T07:32:09.753504+0000","last_peered":"2024-03-07T07:32:09.753504+0000","last_clean":"2024-03-07T07:32:09.753504+0000","last_became_active":"2024-03-07T07:32:08.721780+0000","last_became_peered":"2024-03-07T07:32:08.721780+0000","last_unstale":"2024-03-07T07:32:09.753504+0000","last_undegraded":"2024-03-07T07:32:09.753504+0000","last_fullsized":"2024-03-07T07:32:09.753504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:57.931351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711741+0000","last_change":"2024-03-07T07:32:08.711741+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711741+0000","last_undegraded":"2024-03-07T07:32:08.711741+0000","last_fullsized":"2024-03-07T07:32:08.711741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.721236+0000","last_change":"2024-03-07T07:32:08.724075+0000","last_active":"2024-03-07T07:32:09.721236+0000","last_peered":"2024-03-07T07:32:09.721236+0000","last_clean":"2024-03-07T07:32:09.721236+0000","last_became_active":"2024-03-07T07:32:08.723816+0000","last_became_peered":"2024-03-07T07:32:08.723816+0000","last_unstale":"2024-03-07T07:32:09.721236+0000","last_undegraded":"2024-03-07T07:32:09.721236+0000","last_fullsized":"2024-03-07T07:32:09.721236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:57.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710359+0000","last_change":"2024-03-07T07:32:08.710359+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710359+0000","last_undegraded":"2024-03-07T07:32:08.710359+0000","last_fullsized":"2024-03-07T07:32:08.710359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726274+0000","last_change":"2024-03-07T07:32:08.725250+0000","last_active":"2024-03-07T07:32:08.726274+0000","last_peered":"2024-03-07T07:32:08.726274+0000","last_clean":"2024-03-07T07:32:08.726274+0000","last_became_active":"2024-03-07T07:32:08.724952+0000","last_became_peered":"2024-03-07T07:32:08.724952+0000","last_unstale":"2024-03-07T07:32:08.726274+0000","last_undegraded":"2024-03-07T07:32:08.726274+0000","last_fullsized":"2024-03-07T07:32:08.726274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:14.784463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.717335+0000","last_change":"2024-03-07T07:32:08.717335+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.717335+0000","last_undegraded":"2024-03-07T07:32:08.717335+0000","last_fullsized":"2024-03-07T07:32:08.717335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.717693+0000","last_change":"2024-03-07T07:32:08.722811+0000","last_active":"2024-03-07T07:32:09.717693+0000","last_peered":"2024-03-07T07:32:09.717693+0000","last_clean":"2024-03-07T07:32:09.717693+0000","last_became_active":"2024-03-07T07:32:08.722388+0000","last_became_peered":"2024-03-07T07:32:08.722388+0000","last_unstale":"2024-03-07T07:32:09.717693+0000","last_undegraded":"2024-03-07T07:32:09.717693+0000","last_fullsized":"2024-03-07T07:32:09.717693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:09.210160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708028+0000","last_change":"2024-03-07T07:32:08.708028+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708028+0000","last_undegraded":"2024-03-07T07:32:08.708028+0000","last_fullsized":"2024-03-07T07:32:08.708028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.724976+0000","last_change":"2024-03-07T07:32:08.727283+0000","last_active":"2024-03-07T07:32:09.724976+0000","last_peered":"2024-03-07T07:32:09.724976+0000","last_clean":"2024-03-07T07:32:09.724976+0000","last_became_active":"2024-03-07T07:32:08.727012+0000","last_became_peered":"2024-03-07T07:32:08.727012+0000","last_unstale":"2024-03-07T07:32:09.724976+0000","last_undegraded":"2024-03-07T07:32:09.724976+0000","last_fullsized":"2024-03-07T07:32:09.724976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:11.184461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752754+0000","last_change":"2024-03-07T07:32:09.743462+0000","last_active":"2024-03-07T07:32:09.752754+0000","last_peered":"2024-03-07T07:32:09.752754+0000","last_clean":"2024-03-07T07:32:09.752754+0000","last_became_active":"2024-03-07T07:32:09.743094+0000","last_became_peered":"2024-03-07T07:32:09.743094+0000","last_unstale":"2024-03-07T07:32:09.752754+0000","last_undegraded":"2024-03-07T07:32:09.752754+0000","last_fullsized":"2024-03-07T07:32:09.752754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:24.575003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.715054+0000","last_change":"2024-03-07T07:32:08.723260+0000","last_active":"2024-03-07T07:32:09.715054+0000","last_peered":"2024-03-07T07:32:09.715054+0000","last_clean":"2024-03-07T07:32:09.715054+0000","last_became_active":"2024-03-07T07:32:08.723010+0000","last_became_peered":"2024-03-07T07:32:08.723010+0000","last_unstale":"2024-03-07T07:32:09.715054+0000","last_undegraded":"2024-03-07T07:32:09.715054+0000","last_fullsized":"2024-03-07T07:32:09.715054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:20.834267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711911+0000","last_change":"2024-03-07T07:32:08.711911+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711911+0000","last_undegraded":"2024-03-07T07:32:08.711911+0000","last_fullsized":"2024-03-07T07:32:08.711911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725343+0000","last_change":"2024-03-07T07:32:08.723288+0000","last_active":"2024-03-07T07:32:08.725343+0000","last_peered":"2024-03-07T07:32:08.725343+0000","last_clean":"2024-03-07T07:32:08.725343+0000","last_became_active":"2024-03-07T07:32:08.723011+0000","last_became_peered":"2024-03-07T07:32:08.723011+0000","last_unstale":"2024-03-07T07:32:08.725343+0000","last_undegraded":"2024-03-07T07:32:08.725343+0000","last_fullsized":"2024-03-07T07:32:08.725343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:36:01.958659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734457+0000","last_change":"2024-03-07T07:32:09.732193+0000","last_active":"2024-03-07T07:32:09.734457+0000","last_peered":"2024-03-07T07:32:09.734457+0000","last_clean":"2024-03-07T07:32:09.734457+0000","last_became_active":"2024-03-07T07:32:09.731912+0000","last_became_peered":"2024-03-07T07:32:09.731912+0000","last_unstale":"2024-03-07T07:32:09.734457+0000","last_undegraded":"2024-03-07T07:32:09.734457+0000","last_fullsized":"2024-03-07T07:32:09.734457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:38:38.626228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.729975+0000","last_change":"2024-03-07T07:32:08.728905+0000","last_active":"2024-03-07T07:32:08.729975+0000","last_peered":"2024-03-07T07:32:08.729975+0000","last_clean":"2024-03-07T07:32:08.729975+0000","last_became_active":"2024-03-07T07:32:08.728584+0000","last_became_peered":"2024-03-07T07:32:08.728584+0000","last_unstale":"2024-03-07T07:32:08.729975+0000","last_undegraded":"2024-03-07T07:32:08.729975+0000","last_fullsized":"2024-03-07T07:32:08.729975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:26.993668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711171+0000","last_change":"2024-03-07T07:32:08.711171+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711171+0000","last_undegraded":"2024-03-07T07:32:08.711171+0000","last_fullsized":"2024-03-07T07:32:08.711171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.724600+0000","last_change":"2024-03-07T07:32:08.722707+0000","last_active":"2024-03-07T07:32:08.724600+0000","last_peered":"2024-03-07T07:32:08.724600+0000","last_clean":"2024-03-07T07:32:08.724600+0000","last_became_active":"2024-03-07T07:32:08.721788+0000","last_became_peered":"2024-03-07T07:32:08.721788+0000","last_unstale":"2024-03-07T07:32:08.724600+0000","last_undegraded":"2024-03-07T07:32:08.724600+0000","last_fullsized":"2024-03-07T07:32:08.724600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:55.611551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737253+0000","last_change":"2024-03-07T07:32:09.732507+0000","last_active":"2024-03-07T07:32:09.737253+0000","last_peered":"2024-03-07T07:32:09.737253+0000","last_clean":"2024-03-07T07:32:09.737253+0000","last_became_active":"2024-03-07T07:32:09.732228+0000","last_became_peered":"2024-03-07T07:32:09.732228+0000","last_unstale":"2024-03-07T07:32:09.737253+0000","last_undegraded":"2024-03-07T07:32:09.737253+0000","last_fullsized":"2024-03-07T07:32:09.737253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:04.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.727804+0000","last_change":"2024-03-07T07:32:08.723402+0000","last_active":"2024-03-07T07:32:08.727804+0000","last_peered":"2024-03-07T07:32:08.727804+0000","last_clean":"2024-03-07T07:32:08.727804+0000","last_became_active":"2024-03-07T07:32:08.722984+0000","last_became_peered":"2024-03-07T07:32:08.722984+0000","last_unstale":"2024-03-07T07:32:08.727804+0000","last_undegraded":"2024-03-07T07:32:08.727804+0000","last_fullsized":"2024-03-07T07:32:08.727804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:54.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703006+0000","last_change":"2024-03-07T07:32:08.703006+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703006+0000","last_undegraded":"2024-03-07T07:32:08.703006+0000","last_fullsized":"2024-03-07T07:32:08.703006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.723917+0000","last_change":"2024-03-07T07:32:08.721683+0000","last_active":"2024-03-07T07:32:08.723917+0000","last_peered":"2024-03-07T07:32:08.723917+0000","last_clean":"2024-03-07T07:32:08.723917+0000","last_became_active":"2024-03-07T07:32:08.721226+0000","last_became_peered":"2024-03-07T07:32:08.721226+0000","last_unstale":"2024-03-07T07:32:08.723917+0000","last_undegraded":"2024-03-07T07:32:08.723917+0000","last_fullsized":"2024-03-07T07:32:08.723917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:41:05.054365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705139+0000","last_change":"2024-03-07T07:32:08.705139+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705139+0000","last_undegraded":"2024-03-07T07:32:08.705139+0000","last_fullsized":"2024-03-07T07:32:08.705139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.719575+0000","last_change":"2024-03-07T07:32:08.714980+0000","last_active":"2024-03-07T07:32:09.719575+0000","last_peered":"2024-03-07T07:32:09.719575+0000","last_clean":"2024-03-07T07:32:09.719575+0000","last_became_active":"2024-03-07T07:32:08.714659+0000","last_became_peered":"2024-03-07T07:32:08.714659+0000","last_unstale":"2024-03-07T07:32:09.719575+0000","last_undegraded":"2024-03-07T07:32:09.719575+0000","last_fullsized":"2024-03-07T07:32:09.719575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:14.784463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734491+0000","last_change":"2024-03-07T07:32:09.732846+0000","last_active":"2024-03-07T07:32:09.734491+0000","last_peered":"2024-03-07T07:32:09.734491+0000","last_clean":"2024-03-07T07:32:09.734491+0000","last_became_active":"2024-03-07T07:32:09.731979+0000","last_became_peered":"2024-03-07T07:32:09.731979+0000","last_unstale":"2024-03-07T07:32:09.734491+0000","last_undegraded":"2024-03-07T07:32:09.734491+0000","last_fullsized":"2024-03-07T07:32:09.734491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:39:44.332839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.728312+0000","last_change":"2024-03-07T07:32:08.726960+0000","last_active":"2024-03-07T07:32:08.728312+0000","last_peered":"2024-03-07T07:32:08.728312+0000","last_clean":"2024-03-07T07:32:08.728312+0000","last_became_active":"2024-03-07T07:32:08.726686+0000","last_became_peered":"2024-03-07T07:32:08.726686+0000","last_unstale":"2024-03-07T07:32:08.728312+0000","last_undegraded":"2024-03-07T07:32:08.728312+0000","last_fullsized":"2024-03-07T07:32:08.728312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:34:30.228981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737233+0000","last_change":"2024-03-07T07:32:09.733315+0000","last_active":"2024-03-07T07:32:09.737233+0000","last_peered":"2024-03-07T07:32:09.737233+0000","last_clean":"2024-03-07T07:32:09.737233+0000","last_became_active":"2024-03-07T07:32:09.733052+0000","last_became_peered":"2024-03-07T07:32:09.733052+0000","last_unstale":"2024-03-07T07:32:09.737233+0000","last_undegraded":"2024-03-07T07:32:09.737233+0000","last_fullsized":"2024-03-07T07:32:09.737233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:06:31.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.716459+0000","last_change":"2024-03-07T07:32:08.721617+0000","last_active":"2024-03-07T07:32:09.716459+0000","last_peered":"2024-03-07T07:32:09.716459+0000","last_clean":"2024-03-07T07:32:09.716459+0000","last_became_active":"2024-03-07T07:32:08.721242+0000","last_became_peered":"2024-03-07T07:32:08.721242+0000","last_unstale":"2024-03-07T07:32:09.716459+0000","last_undegraded":"2024-03-07T07:32:09.716459+0000","last_fullsized":"2024-03-07T07:32:09.716459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:41:43.318106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.725441+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:32:09.725441+0000","last_peered":"2024-03-07T07:32:09.725441+0000","last_clean":"2024-03-07T07:32:09.725441+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:32:09.725441+0000","last_undegraded":"2024-03-07T07:32:09.725441+0000","last_fullsized":"2024-03-07T07:32:09.725441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":725008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":718733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:32:13.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:32:14.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.017+0000 7fab25800640 1 Processor -- start 2024-03-07T07:32:14.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.017+0000 7fab25800640 1 -- start start 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab25800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab2015c1f0 0x7fab200704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab25800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab20070a30 0x7fab20160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab25800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2015c670 con 0x7fab2015e010 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab25800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2006e900 con 0x7fab20070a30 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab25800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab20070e80 con 0x7fab2015c1f0 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1ea00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fab2015e010 0x7fab2015f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56772/0 (socket says 172.21.15.84:56772) 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1ea00640 1 -- 172.21.15.84:0/175081303 learned_addr learned my addr 172.21.15.84:0/175081303 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1f400640 1 --2- 172.21.15.84:0/175081303 >> v2:172.21.15.84:3300/0 conn(0x7fab20070a30 0x7fab20160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1e000640 1 --2- 172.21.15.84:0/175081303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab2015c1f0 0x7fab200704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1d600640 1 -- 172.21.15.84:0/175081303 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505400804 0 0) 0x7fab10001120 con 0x7fab2015e010 2024-03-07T07:32:14.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1d600640 1 -- 172.21.15.84:0/175081303 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab04003530 con 0x7fab2015e010 2024-03-07T07:32:14.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1f400640 1 -- 172.21.15.84:0/175081303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab2015c1f0 msgr2=0x7fab200704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:14.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1f400640 1 --2- 172.21.15.84:0/175081303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab2015c1f0 0x7fab200704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1f400640 1 -- 172.21.15.84:0/175081303 >> v1:172.21.15.84:6789/0 conn(0x7fab2015e010 legacy=0x7fab2015f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.021+0000 7fab1f400640 1 -- 172.21.15.84:0/175081303 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2015e3f0 con 0x7fab20070a30 2024-03-07T07:32:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab1f400640 1 --2- 172.21.15.84:0/175081303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab20070a30 0x7fab20160c70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fab18009d90 tx=0x7fab1801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29133ad0b6abb4b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab1d600640 1 -- 172.21.15.84:0/175081303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180b2070 con 0x7fab20070a30 2024-03-07T07:32:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab1d600640 1 -- 172.21.15.84:0/175081303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180a5920 con 0x7fab20070a30 2024-03-07T07:32:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab1d600640 1 -- 172.21.15.84:0/175081303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5cd0 con 0x7fab20070a30 2024-03-07T07:32:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- 172.21.15.84:0/175081303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab20070a30 msgr2=0x7fab20160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 --2- 172.21.15.84:0/175081303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab20070a30 0x7fab20160c70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fab18009d90 tx=0x7fab1801c970 comp rx=0 tx=0).stop 2024-03-07T07:32:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- 172.21.15.84:0/175081303 shutdown_connections 2024-03-07T07:32:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 --2- 172.21.15.84:0/175081303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab20070a30 0x7fab20160c70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 --2- 172.21.15.84:0/175081303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab2015c1f0 0x7fab200704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- 172.21.15.84:0/175081303 >> 172.21.15.84:0/175081303 conn(0x7fab2006b0f0 msgr2=0x7fab2006b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- 172.21.15.84:0/175081303 shutdown_connections 2024-03-07T07:32:14.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- 172.21.15.84:0/175081303 wait complete. 2024-03-07T07:32:14.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 Processor -- start 2024-03-07T07:32:14.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- start start 2024-03-07T07:32:14.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab20070a30 0x7fab201398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2015c1f0 0x7fab20158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab2015e010 0x7fab20154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015f770 con 0x7fab2015e010 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20160470 con 0x7fab2015c1f0 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.025+0000 7fab25800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015f8f0 con 0x7fab20070a30 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab2015e010 0x7fab20154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab2015e010 0x7fab20154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44584/0 (socket says 172.21.15.84:44584) 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 -- 172.21.15.84:0/3978064414 learned_addr learned my addr 172.21.15.84:0/3978064414 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1ea00640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab20070a30 0x7fab201398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1e000640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2015c1f0 0x7fab20158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 -- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab20070a30 msgr2=0x7fab201398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab20070a30 0x7fab201398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 -- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2015c1f0 msgr2=0x7fab20158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2015c1f0 0x7fab20158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 -- 172.21.15.84:0/3978064414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20157270 con 0x7fab2015e010 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1ea00640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab20070a30 0x7fab201398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1e000640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2015c1f0 0x7fab20158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:14.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab1f400640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab2015e010 0x7fab20154e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab1801b020 tx=0x7fab18019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab16a00640 1 -- 172.21.15.84:0/3978064414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180b2050 con 0x7fab2015e010 2024-03-07T07:32:14.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab16a00640 1 -- 172.21.15.84:0/3978064414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180be070 con 0x7fab2015e010 2024-03-07T07:32:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab20157550 con 0x7fab2015e010 2024-03-07T07:32:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab16a00640 1 -- 172.21.15.84:0/3978064414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180ad850 con 0x7fab2015e010 2024-03-07T07:32:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab20157b10 con 0x7fab2015e010 2024-03-07T07:32:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab20062d40 con 0x7fab2015e010 2024-03-07T07:32:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.029+0000 7fab16a00640 1 -- 172.21.15.84:0/3978064414 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fab180ad9f0 con 0x7fab2015e010 2024-03-07T07:32:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.033+0000 7fab16a00640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fab00066f60 0x7fab00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.033+0000 7fab16a00640 1 -- 172.21.15.84:0/3978064414 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab181200d0 con 0x7fab2015e010 2024-03-07T07:32:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.033+0000 7fab1ea00640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fab00066f60 0x7fab00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.033+0000 7fab1ea00640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fab00066f60 0x7fab00069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fab10005890 tx=0x7fab10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.037+0000 7fab16a00640 1 -- 172.21.15.84:0/3978064414 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fab18016560 con 0x7fab2015e010 2024-03-07T07:32:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.185+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab2006b950 con 0x7fab00066f60 2024-03-07T07:32:14.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.193+0000 7fab16a00640 1 -- 172.21.15.84:0/3978064414 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249420 (secure 0 0 0) 0x7fab2006b950 con 0x7fab00066f60 2024-03-07T07:32:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:14.200 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:32:14.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fab00066f60 msgr2=0x7fab00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fab00066f60 0x7fab00069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fab10005890 tx=0x7fab10009040 comp rx=0 tx=0).stop 2024-03-07T07:32:14.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab2015e010 msgr2=0x7fab20154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab2015e010 0x7fab20154e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab1801b020 tx=0x7fab18019710 comp rx=0 tx=0).stop 2024-03-07T07:32:14.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 shutdown_connections 2024-03-07T07:32:14.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fab00066f60 0x7fab00069420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab2015e010 0x7fab20154e70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2015c1f0 0x7fab20158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 --2- 172.21.15.84:0/3978064414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab20070a30 0x7fab201398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 >> 172.21.15.84:0/3978064414 conn(0x7fab2006b0f0 msgr2=0x7fab200b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:14.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 shutdown_connections 2024-03-07T07:32:14.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.197+0000 7fab25800640 1 -- 172.21.15.84:0/3978064414 wait complete. 2024-03-07T07:32:14.218 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-03-07T07:32:12.890816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220056,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754664,"statfs":{"total":773094113280,"available":772868775936,"internally_reserved":0,"allocated":3973120,"data_stored":2239621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.195356"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734464+0000","last_change":"2024-03-07T07:32:09.730012+0000","last_active":"2024-03-07T07:32:09.734464+0000","last_peered":"2024-03-07T07:32:09.734464+0000","last_clean":"2024-03-07T07:32:09.734464+0000","last_became_active":"2024-03-07T07:32:09.729740+0000","last_became_peered":"2024-03-07T07:32:09.729740+0000","last_unstale":"2024-03-07T07:32:09.734464+0000","last_undegraded":"2024-03-07T07:32:09.734464+0000","last_fullsized":"2024-03-07T07:32:09.734464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:27.999230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.713513+0000","last_change":"2024-03-07T07:32:08.713513+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.713513+0000","last_undegraded":"2024-03-07T07:32:08.713513+0000","last_fullsized":"2024-03-07T07:32:08.713513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.748155+0000","last_change":"2024-03-07T07:32:09.741223+0000","last_active":"2024-03-07T07:32:09.748155+0000","last_peered":"2024-03-07T07:32:09.748155+0000","last_clean":"2024-03-07T07:32:09.748155+0000","last_became_active":"2024-03-07T07:32:09.740812+0000","last_became_peered":"2024-03-07T07:32:09.740812+0000","last_unstale":"2024-03-07T07:32:09.748155+0000","last_undegraded":"2024-03-07T07:32:09.748155+0000","last_fullsized":"2024-03-07T07:32:09.748155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:11:31.178552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704337+0000","last_change":"2024-03-07T07:32:08.704337+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704337+0000","last_undegraded":"2024-03-07T07:32:08.704337+0000","last_fullsized":"2024-03-07T07:32:08.704337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.717859+0000","last_change":"2024-03-07T07:32:08.717859+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.717859+0000","last_undegraded":"2024-03-07T07:32:08.717859+0000","last_fullsized":"2024-03-07T07:32:08.717859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711383+0000","last_change":"2024-03-07T07:32:08.711383+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711383+0000","last_undegraded":"2024-03-07T07:32:08.711383+0000","last_fullsized":"2024-03-07T07:32:08.711383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.750652+0000","last_change":"2024-03-07T07:32:09.745334+0000","last_active":"2024-03-07T07:32:09.750652+0000","last_peered":"2024-03-07T07:32:09.750652+0000","last_clean":"2024-03-07T07:32:09.750652+0000","last_became_active":"2024-03-07T07:32:09.745084+0000","last_became_peered":"2024-03-07T07:32:09.745084+0000","last_unstale":"2024-03-07T07:32:09.750652+0000","last_undegraded":"2024-03-07T07:32:09.750652+0000","last_fullsized":"2024-03-07T07:32:09.750652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:12:19.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744785+0000","last_change":"2024-03-07T07:32:09.736538+0000","last_active":"2024-03-07T07:32:09.744785+0000","last_peered":"2024-03-07T07:32:09.744785+0000","last_clean":"2024-03-07T07:32:09.744785+0000","last_became_active":"2024-03-07T07:32:09.736186+0000","last_became_peered":"2024-03-07T07:32:09.736186+0000","last_unstale":"2024-03-07T07:32:09.744785+0000","last_undegraded":"2024-03-07T07:32:09.744785+0000","last_fullsized":"2024-03-07T07:32:09.744785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:18.860889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752779+0000","last_change":"2024-03-07T07:32:09.744105+0000","last_active":"2024-03-07T07:32:09.752779+0000","last_peered":"2024-03-07T07:32:09.752779+0000","last_clean":"2024-03-07T07:32:09.752779+0000","last_became_active":"2024-03-07T07:32:09.743854+0000","last_became_peered":"2024-03-07T07:32:09.743854+0000","last_unstale":"2024-03-07T07:32:09.752779+0000","last_undegraded":"2024-03-07T07:32:09.752779+0000","last_fullsized":"2024-03-07T07:32:09.752779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:10.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704847+0000","last_change":"2024-03-07T07:32:08.704847+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704847+0000","last_undegraded":"2024-03-07T07:32:08.704847+0000","last_fullsized":"2024-03-07T07:32:08.704847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734362+0000","last_change":"2024-03-07T07:32:09.729434+0000","last_active":"2024-03-07T07:32:09.734362+0000","last_peered":"2024-03-07T07:32:09.734362+0000","last_clean":"2024-03-07T07:32:09.734362+0000","last_became_active":"2024-03-07T07:32:09.728932+0000","last_became_peered":"2024-03-07T07:32:09.728932+0000","last_unstale":"2024-03-07T07:32:09.734362+0000","last_undegraded":"2024-03-07T07:32:09.734362+0000","last_fullsized":"2024-03-07T07:32:09.734362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:26:25.930786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752687+0000","last_change":"2024-03-07T07:32:09.742631+0000","last_active":"2024-03-07T07:32:09.752687+0000","last_peered":"2024-03-07T07:32:09.752687+0000","last_clean":"2024-03-07T07:32:09.752687+0000","last_became_active":"2024-03-07T07:32:09.740785+0000","last_became_peered":"2024-03-07T07:32:09.740785+0000","last_unstale":"2024-03-07T07:32:09.752687+0000","last_undegraded":"2024-03-07T07:32:09.752687+0000","last_fullsized":"2024-03-07T07:32:09.752687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:06.625131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.707637+0000","last_change":"2024-03-07T07:32:08.707637+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.707637+0000","last_undegraded":"2024-03-07T07:32:08.707637+0000","last_fullsized":"2024-03-07T07:32:08.707637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703686+0000","last_change":"2024-03-07T07:32:08.703686+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703686+0000","last_undegraded":"2024-03-07T07:32:08.703686+0000","last_fullsized":"2024-03-07T07:32:08.703686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.735720+0000","last_change":"2024-03-07T07:32:09.727701+0000","last_active":"2024-03-07T07:32:09.735720+0000","last_peered":"2024-03-07T07:32:09.735720+0000","last_clean":"2024-03-07T07:32:09.735720+0000","last_became_active":"2024-03-07T07:32:09.727424+0000","last_became_peered":"2024-03-07T07:32:09.727424+0000","last_unstale":"2024-03-07T07:32:09.735720+0000","last_undegraded":"2024-03-07T07:32:09.735720+0000","last_fullsized":"2024-03-07T07:32:09.735720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:15.863540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.740620+0000","last_change":"2024-03-07T07:32:09.732094+0000","last_active":"2024-03-07T07:32:09.740620+0000","last_peered":"2024-03-07T07:32:09.740620+0000","last_clean":"2024-03-07T07:32:09.740620+0000","last_became_active":"2024-03-07T07:32:09.731685+0000","last_became_peered":"2024-03-07T07:32:09.731685+0000","last_unstale":"2024-03-07T07:32:09.740620+0000","last_undegraded":"2024-03-07T07:32:09.740620+0000","last_fullsized":"2024-03-07T07:32:09.740620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:57.484266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737685+0000","last_change":"2024-03-07T07:32:09.733381+0000","last_active":"2024-03-07T07:32:09.737685+0000","last_peered":"2024-03-07T07:32:09.737685+0000","last_clean":"2024-03-07T07:32:09.737685+0000","last_became_active":"2024-03-07T07:32:09.733061+0000","last_became_peered":"2024-03-07T07:32:09.733061+0000","last_unstale":"2024-03-07T07:32:09.737685+0000","last_undegraded":"2024-03-07T07:32:09.737685+0000","last_fullsized":"2024-03-07T07:32:09.737685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:41:20.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.712395+0000","last_change":"2024-03-07T07:32:08.712395+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.712395+0000","last_undegraded":"2024-03-07T07:32:08.712395+0000","last_fullsized":"2024-03-07T07:32:08.712395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.712198+0000","last_change":"2024-03-07T07:32:08.712198+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.712198+0000","last_undegraded":"2024-03-07T07:32:08.712198+0000","last_fullsized":"2024-03-07T07:32:08.712198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708270+0000","last_change":"2024-03-07T07:32:08.708270+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708270+0000","last_undegraded":"2024-03-07T07:32:08.708270+0000","last_fullsized":"2024-03-07T07:32:08.708270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737291+0000","last_change":"2024-03-07T07:32:09.733151+0000","last_active":"2024-03-07T07:32:09.737291+0000","last_peered":"2024-03-07T07:32:09.737291+0000","last_clean":"2024-03-07T07:32:09.737291+0000","last_became_active":"2024-03-07T07:32:09.732916+0000","last_became_peered":"2024-03-07T07:32:09.732916+0000","last_unstale":"2024-03-07T07:32:09.737291+0000","last_undegraded":"2024-03-07T07:32:09.737291+0000","last_fullsized":"2024-03-07T07:32:09.737291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:12:19.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734352+0000","last_change":"2024-03-07T07:32:09.729634+0000","last_active":"2024-03-07T07:32:09.734352+0000","last_peered":"2024-03-07T07:32:09.734352+0000","last_clean":"2024-03-07T07:32:09.734352+0000","last_became_active":"2024-03-07T07:32:09.729365+0000","last_became_peered":"2024-03-07T07:32:09.729365+0000","last_unstale":"2024-03-07T07:32:09.734352+0000","last_undegraded":"2024-03-07T07:32:09.734352+0000","last_fullsized":"2024-03-07T07:32:09.734352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:47.428345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.707282+0000","last_change":"2024-03-07T07:32:08.707282+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.707282+0000","last_undegraded":"2024-03-07T07:32:08.707282+0000","last_fullsized":"2024-03-07T07:32:08.707282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.748885+0000","last_change":"2024-03-07T07:32:09.743716+0000","last_active":"2024-03-07T07:32:09.748885+0000","last_peered":"2024-03-07T07:32:09.748885+0000","last_clean":"2024-03-07T07:32:09.748885+0000","last_became_active":"2024-03-07T07:32:09.743472+0000","last_became_peered":"2024-03-07T07:32:09.743472+0000","last_unstale":"2024-03-07T07:32:09.748885+0000","last_undegraded":"2024-03-07T07:32:09.748885+0000","last_fullsized":"2024-03-07T07:32:09.748885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:22:41.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705258+0000","last_change":"2024-03-07T07:32:08.705258+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705258+0000","last_undegraded":"2024-03-07T07:32:08.705258+0000","last_fullsized":"2024-03-07T07:32:08.705258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704237+0000","last_change":"2024-03-07T07:32:08.704237+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704237+0000","last_undegraded":"2024-03-07T07:32:08.704237+0000","last_fullsized":"2024-03-07T07:32:08.704237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710970+0000","last_change":"2024-03-07T07:32:08.710970+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710970+0000","last_undegraded":"2024-03-07T07:32:08.710970+0000","last_fullsized":"2024-03-07T07:32:08.710970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.746972+0000","last_change":"2024-03-07T07:32:09.737554+0000","last_active":"2024-03-07T07:32:09.746972+0000","last_peered":"2024-03-07T07:32:09.746972+0000","last_clean":"2024-03-07T07:32:09.746972+0000","last_became_active":"2024-03-07T07:32:09.736203+0000","last_became_peered":"2024-03-07T07:32:09.736203+0000","last_unstale":"2024-03-07T07:32:09.746972+0000","last_undegraded":"2024-03-07T07:32:09.746972+0000","last_fullsized":"2024-03-07T07:32:09.746972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:15.863540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737268+0000","last_change":"2024-03-07T07:32:09.732781+0000","last_active":"2024-03-07T07:32:09.737268+0000","last_peered":"2024-03-07T07:32:09.737268+0000","last_clean":"2024-03-07T07:32:09.737268+0000","last_became_active":"2024-03-07T07:32:09.732522+0000","last_became_peered":"2024-03-07T07:32:09.732522+0000","last_unstale":"2024-03-07T07:32:09.737268+0000","last_undegraded":"2024-03-07T07:32:09.737268+0000","last_fullsized":"2024-03-07T07:32:09.737268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:22:41.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737916+0000","last_change":"2024-03-07T07:32:09.733989+0000","last_active":"2024-03-07T07:32:09.737916+0000","last_peered":"2024-03-07T07:32:09.737916+0000","last_clean":"2024-03-07T07:32:09.737916+0000","last_became_active":"2024-03-07T07:32:09.733697+0000","last_became_peered":"2024-03-07T07:32:09.733697+0000","last_unstale":"2024-03-07T07:32:09.737916+0000","last_undegraded":"2024-03-07T07:32:09.737916+0000","last_fullsized":"2024-03-07T07:32:09.737916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:24:54.602616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.745886+0000","last_change":"2024-03-07T07:32:09.737262+0000","last_active":"2024-03-07T07:32:09.745886+0000","last_peered":"2024-03-07T07:32:09.745886+0000","last_clean":"2024-03-07T07:32:09.745886+0000","last_became_active":"2024-03-07T07:32:09.734562+0000","last_became_peered":"2024-03-07T07:32:09.734562+0000","last_unstale":"2024-03-07T07:32:09.745886+0000","last_undegraded":"2024-03-07T07:32:09.745886+0000","last_fullsized":"2024-03-07T07:32:09.745886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:58.156994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.731496+0000","last_change":"2024-03-07T07:32:09.720498+0000","last_active":"2024-03-07T07:32:09.731496+0000","last_peered":"2024-03-07T07:32:09.731496+0000","last_clean":"2024-03-07T07:32:09.731496+0000","last_became_active":"2024-03-07T07:32:09.720213+0000","last_became_peered":"2024-03-07T07:32:09.720213+0000","last_unstale":"2024-03-07T07:32:09.731496+0000","last_undegraded":"2024-03-07T07:32:09.731496+0000","last_fullsized":"2024-03-07T07:32:09.731496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:56.867331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708705+0000","last_change":"2024-03-07T07:32:08.708705+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708705+0000","last_undegraded":"2024-03-07T07:32:08.708705+0000","last_fullsized":"2024-03-07T07:32:08.708705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752414+0000","last_change":"2024-03-07T07:32:08.727746+0000","last_active":"2024-03-07T07:32:09.752414+0000","last_peered":"2024-03-07T07:32:09.752414+0000","last_clean":"2024-03-07T07:32:09.752414+0000","last_became_active":"2024-03-07T07:32:08.726860+0000","last_became_peered":"2024-03-07T07:32:08.726860+0000","last_unstale":"2024-03-07T07:32:09.752414+0000","last_undegraded":"2024-03-07T07:32:09.752414+0000","last_fullsized":"2024-03-07T07:32:09.752414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:41:19.781917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.747653+0000","last_change":"2024-03-07T07:32:09.740174+0000","last_active":"2024-03-07T07:32:09.747653+0000","last_peered":"2024-03-07T07:32:09.747653+0000","last_clean":"2024-03-07T07:32:09.747653+0000","last_became_active":"2024-03-07T07:32:09.739811+0000","last_became_peered":"2024-03-07T07:32:09.739811+0000","last_unstale":"2024-03-07T07:32:09.747653+0000","last_undegraded":"2024-03-07T07:32:09.747653+0000","last_fullsized":"2024-03-07T07:32:09.747653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:57.484266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726508+0000","last_change":"2024-03-07T07:32:08.724895+0000","last_active":"2024-03-07T07:32:08.726508+0000","last_peered":"2024-03-07T07:32:08.726508+0000","last_clean":"2024-03-07T07:32:08.726508+0000","last_became_active":"2024-03-07T07:32:08.724609+0000","last_became_peered":"2024-03-07T07:32:08.724609+0000","last_unstale":"2024-03-07T07:32:08.726508+0000","last_undegraded":"2024-03-07T07:32:08.726508+0000","last_fullsized":"2024-03-07T07:32:08.726508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:35:45.488891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.747809+0000","last_change":"2024-03-07T07:32:09.742029+0000","last_active":"2024-03-07T07:32:09.747809+0000","last_peered":"2024-03-07T07:32:09.747809+0000","last_clean":"2024-03-07T07:32:09.747809+0000","last_became_active":"2024-03-07T07:32:09.741612+0000","last_became_peered":"2024-03-07T07:32:09.741612+0000","last_unstale":"2024-03-07T07:32:09.747809+0000","last_undegraded":"2024-03-07T07:32:09.747809+0000","last_fullsized":"2024-03-07T07:32:09.747809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:04.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730112+0000","last_change":"2024-03-07T07:32:08.728713+0000","last_active":"2024-03-07T07:32:08.730112+0000","last_peered":"2024-03-07T07:32:08.730112+0000","last_clean":"2024-03-07T07:32:08.730112+0000","last_became_active":"2024-03-07T07:32:08.728291+0000","last_became_peered":"2024-03-07T07:32:08.728291+0000","last_unstale":"2024-03-07T07:32:08.730112+0000","last_undegraded":"2024-03-07T07:32:08.730112+0000","last_fullsized":"2024-03-07T07:32:08.730112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:56.220831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705484+0000","last_change":"2024-03-07T07:32:08.705484+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705484+0000","last_undegraded":"2024-03-07T07:32:08.705484+0000","last_fullsized":"2024-03-07T07:32:08.705484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.720810+0000","last_change":"2024-03-07T07:32:08.717295+0000","last_active":"2024-03-07T07:32:08.720810+0000","last_peered":"2024-03-07T07:32:08.720810+0000","last_clean":"2024-03-07T07:32:08.720810+0000","last_became_active":"2024-03-07T07:32:08.715284+0000","last_became_peered":"2024-03-07T07:32:08.715284+0000","last_unstale":"2024-03-07T07:32:08.720810+0000","last_undegraded":"2024-03-07T07:32:08.720810+0000","last_fullsized":"2024-03-07T07:32:08.720810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:36:01.958659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752638+0000","last_change":"2024-03-07T07:32:09.742100+0000","last_active":"2024-03-07T07:32:09.752638+0000","last_peered":"2024-03-07T07:32:09.752638+0000","last_clean":"2024-03-07T07:32:09.752638+0000","last_became_active":"2024-03-07T07:32:09.741769+0000","last_became_peered":"2024-03-07T07:32:09.741769+0000","last_unstale":"2024-03-07T07:32:09.752638+0000","last_undegraded":"2024-03-07T07:32:09.752638+0000","last_fullsized":"2024-03-07T07:32:09.752638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:54:10.883851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752898+0000","last_change":"2024-03-07T07:32:08.724105+0000","last_active":"2024-03-07T07:32:09.752898+0000","last_peered":"2024-03-07T07:32:09.752898+0000","last_clean":"2024-03-07T07:32:09.752898+0000","last_became_active":"2024-03-07T07:32:08.723796+0000","last_became_peered":"2024-03-07T07:32:08.723796+0000","last_unstale":"2024-03-07T07:32:09.752898+0000","last_undegraded":"2024-03-07T07:32:09.752898+0000","last_fullsized":"2024-03-07T07:32:09.752898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:09.647569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744660+0000","last_change":"2024-03-07T07:32:09.736758+0000","last_active":"2024-03-07T07:32:09.744660+0000","last_peered":"2024-03-07T07:32:09.744660+0000","last_clean":"2024-03-07T07:32:09.744660+0000","last_became_active":"2024-03-07T07:32:09.736405+0000","last_became_peered":"2024-03-07T07:32:09.736405+0000","last_unstale":"2024-03-07T07:32:09.744660+0000","last_undegraded":"2024-03-07T07:32:09.744660+0000","last_fullsized":"2024-03-07T07:32:09.744660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:44:21.013212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.750777+0000","last_change":"2024-03-07T07:32:08.725455+0000","last_active":"2024-03-07T07:32:09.750777+0000","last_peered":"2024-03-07T07:32:09.750777+0000","last_clean":"2024-03-07T07:32:09.750777+0000","last_became_active":"2024-03-07T07:32:08.721591+0000","last_became_peered":"2024-03-07T07:32:08.721591+0000","last_unstale":"2024-03-07T07:32:09.750777+0000","last_undegraded":"2024-03-07T07:32:09.750777+0000","last_fullsized":"2024-03-07T07:32:09.750777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:23.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752740+0000","last_change":"2024-03-07T07:32:09.743365+0000","last_active":"2024-03-07T07:32:09.752740+0000","last_peered":"2024-03-07T07:32:09.752740+0000","last_clean":"2024-03-07T07:32:09.752740+0000","last_became_active":"2024-03-07T07:32:09.743117+0000","last_became_peered":"2024-03-07T07:32:09.743117+0000","last_unstale":"2024-03-07T07:32:09.752740+0000","last_undegraded":"2024-03-07T07:32:09.752740+0000","last_fullsized":"2024-03-07T07:32:09.752740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:14.634090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725040+0000","last_change":"2024-03-07T07:32:08.722719+0000","last_active":"2024-03-07T07:32:08.725040+0000","last_peered":"2024-03-07T07:32:08.725040+0000","last_clean":"2024-03-07T07:32:08.725040+0000","last_became_active":"2024-03-07T07:32:08.722402+0000","last_became_peered":"2024-03-07T07:32:08.722402+0000","last_unstale":"2024-03-07T07:32:08.725040+0000","last_undegraded":"2024-03-07T07:32:08.725040+0000","last_fullsized":"2024-03-07T07:32:08.725040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:55:38.571318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703677+0000","last_change":"2024-03-07T07:32:08.703677+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703677+0000","last_undegraded":"2024-03-07T07:32:08.703677+0000","last_fullsized":"2024-03-07T07:32:08.703677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.719065+0000","last_change":"2024-03-07T07:32:08.717797+0000","last_active":"2024-03-07T07:32:09.719065+0000","last_peered":"2024-03-07T07:32:09.719065+0000","last_clean":"2024-03-07T07:32:09.719065+0000","last_became_active":"2024-03-07T07:32:08.717520+0000","last_became_peered":"2024-03-07T07:32:08.717520+0000","last_unstale":"2024-03-07T07:32:09.719065+0000","last_undegraded":"2024-03-07T07:32:09.719065+0000","last_fullsized":"2024-03-07T07:32:09.719065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:02.290184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744182+0000","last_change":"2024-03-07T07:32:09.738676+0000","last_active":"2024-03-07T07:32:09.744182+0000","last_peered":"2024-03-07T07:32:09.744182+0000","last_clean":"2024-03-07T07:32:09.744182+0000","last_became_active":"2024-03-07T07:32:09.738382+0000","last_became_peered":"2024-03-07T07:32:09.738382+0000","last_unstale":"2024-03-07T07:32:09.744182+0000","last_undegraded":"2024-03-07T07:32:09.744182+0000","last_fullsized":"2024-03-07T07:32:09.744182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:40:45.721561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726330+0000","last_change":"2024-03-07T07:32:08.725251+0000","last_active":"2024-03-07T07:32:08.726330+0000","last_peered":"2024-03-07T07:32:08.726330+0000","last_clean":"2024-03-07T07:32:08.726330+0000","last_became_active":"2024-03-07T07:32:08.724921+0000","last_became_peered":"2024-03-07T07:32:08.724921+0000","last_unstale":"2024-03-07T07:32:08.726330+0000","last_undegraded":"2024-03-07T07:32:08.726330+0000","last_fullsized":"2024-03-07T07:32:08.726330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:46.422783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704721+0000","last_change":"2024-03-07T07:32:08.704721+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704721+0000","last_undegraded":"2024-03-07T07:32:08.704721+0000","last_fullsized":"2024-03-07T07:32:08.704721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730748+0000","last_change":"2024-03-07T07:32:08.729316+0000","last_active":"2024-03-07T07:32:08.730748+0000","last_peered":"2024-03-07T07:32:08.730748+0000","last_clean":"2024-03-07T07:32:08.730748+0000","last_became_active":"2024-03-07T07:32:08.729021+0000","last_became_peered":"2024-03-07T07:32:08.729021+0000","last_unstale":"2024-03-07T07:32:08.730748+0000","last_undegraded":"2024-03-07T07:32:08.730748+0000","last_fullsized":"2024-03-07T07:32:08.730748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:17.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703557+0000","last_change":"2024-03-07T07:32:08.703557+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703557+0000","last_undegraded":"2024-03-07T07:32:08.703557+0000","last_fullsized":"2024-03-07T07:32:08.703557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.751068+0000","last_change":"2024-03-07T07:32:08.717596+0000","last_active":"2024-03-07T07:32:09.751068+0000","last_peered":"2024-03-07T07:32:09.751068+0000","last_clean":"2024-03-07T07:32:09.751068+0000","last_became_active":"2024-03-07T07:32:08.716657+0000","last_became_peered":"2024-03-07T07:32:08.716657+0000","last_unstale":"2024-03-07T07:32:09.751068+0000","last_undegraded":"2024-03-07T07:32:09.751068+0000","last_fullsized":"2024-03-07T07:32:09.751068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:17.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734385+0000","last_change":"2024-03-07T07:32:09.729099+0000","last_active":"2024-03-07T07:32:09.734385+0000","last_peered":"2024-03-07T07:32:09.734385+0000","last_clean":"2024-03-07T07:32:09.734385+0000","last_became_active":"2024-03-07T07:32:09.728580+0000","last_became_peered":"2024-03-07T07:32:09.728580+0000","last_unstale":"2024-03-07T07:32:09.734385+0000","last_undegraded":"2024-03-07T07:32:09.734385+0000","last_fullsized":"2024-03-07T07:32:09.734385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:47:58.388381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.723917+0000","last_change":"2024-03-07T07:32:08.719544+0000","last_active":"2024-03-07T07:32:08.723917+0000","last_peered":"2024-03-07T07:32:08.723917+0000","last_clean":"2024-03-07T07:32:08.723917+0000","last_became_active":"2024-03-07T07:32:08.719222+0000","last_became_peered":"2024-03-07T07:32:08.719222+0000","last_unstale":"2024-03-07T07:32:08.723917+0000","last_undegraded":"2024-03-07T07:32:08.723917+0000","last_fullsized":"2024-03-07T07:32:08.723917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:46:42.066266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710818+0000","last_change":"2024-03-07T07:32:08.710818+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710818+0000","last_undegraded":"2024-03-07T07:32:08.710818+0000","last_fullsized":"2024-03-07T07:32:08.710818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752346+0000","last_change":"2024-03-07T07:32:08.714266+0000","last_active":"2024-03-07T07:32:09.752346+0000","last_peered":"2024-03-07T07:32:09.752346+0000","last_clean":"2024-03-07T07:32:09.752346+0000","last_became_active":"2024-03-07T07:32:08.713142+0000","last_became_peered":"2024-03-07T07:32:08.713142+0000","last_unstale":"2024-03-07T07:32:09.752346+0000","last_undegraded":"2024-03-07T07:32:09.752346+0000","last_fullsized":"2024-03-07T07:32:09.752346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:23:53.633589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704312+0000","last_change":"2024-03-07T07:32:08.704312+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704312+0000","last_undegraded":"2024-03-07T07:32:08.704312+0000","last_fullsized":"2024-03-07T07:32:08.704312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.720791+0000","last_change":"2024-03-07T07:32:08.717609+0000","last_active":"2024-03-07T07:32:08.720791+0000","last_peered":"2024-03-07T07:32:08.720791+0000","last_clean":"2024-03-07T07:32:08.720791+0000","last_became_active":"2024-03-07T07:32:08.717250+0000","last_became_peered":"2024-03-07T07:32:08.717250+0000","last_unstale":"2024-03-07T07:32:08.720791+0000","last_undegraded":"2024-03-07T07:32:08.720791+0000","last_fullsized":"2024-03-07T07:32:08.720791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:54.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.754629+0000","last_change":"2024-03-07T07:32:09.747488+0000","last_active":"2024-03-07T07:32:09.754629+0000","last_peered":"2024-03-07T07:32:09.754629+0000","last_clean":"2024-03-07T07:32:09.754629+0000","last_became_active":"2024-03-07T07:32:09.747152+0000","last_became_peered":"2024-03-07T07:32:09.747152+0000","last_unstale":"2024-03-07T07:32:09.754629+0000","last_undegraded":"2024-03-07T07:32:09.754629+0000","last_fullsized":"2024-03-07T07:32:09.754629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:06:31.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.722307+0000","last_change":"2024-03-07T07:32:08.719257+0000","last_active":"2024-03-07T07:32:08.722307+0000","last_peered":"2024-03-07T07:32:08.722307+0000","last_clean":"2024-03-07T07:32:08.722307+0000","last_became_active":"2024-03-07T07:32:08.718947+0000","last_became_peered":"2024-03-07T07:32:08.718947+0000","last_unstale":"2024-03-07T07:32:08.722307+0000","last_undegraded":"2024-03-07T07:32:08.722307+0000","last_fullsized":"2024-03-07T07:32:08.722307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:07:22.327340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734268+0000","last_change":"2024-03-07T07:32:09.727647+0000","last_active":"2024-03-07T07:32:09.734268+0000","last_peered":"2024-03-07T07:32:09.734268+0000","last_clean":"2024-03-07T07:32:09.734268+0000","last_became_active":"2024-03-07T07:32:09.727415+0000","last_became_peered":"2024-03-07T07:32:09.727415+0000","last_unstale":"2024-03-07T07:32:09.734268+0000","last_undegraded":"2024-03-07T07:32:09.734268+0000","last_fullsized":"2024-03-07T07:32:09.734268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:10:50.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725248+0000","last_change":"2024-03-07T07:32:08.722227+0000","last_active":"2024-03-07T07:32:08.725248+0000","last_peered":"2024-03-07T07:32:08.725248+0000","last_clean":"2024-03-07T07:32:08.725248+0000","last_became_active":"2024-03-07T07:32:08.721547+0000","last_became_peered":"2024-03-07T07:32:08.721547+0000","last_unstale":"2024-03-07T07:32:08.725248+0000","last_undegraded":"2024-03-07T07:32:08.725248+0000","last_fullsized":"2024-03-07T07:32:08.725248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:25.671835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.738566+0000","last_change":"2024-03-07T07:32:09.728668+0000","last_active":"2024-03-07T07:32:09.738566+0000","last_peered":"2024-03-07T07:32:09.738566+0000","last_clean":"2024-03-07T07:32:09.738566+0000","last_became_active":"2024-03-07T07:32:09.728355+0000","last_became_peered":"2024-03-07T07:32:09.728355+0000","last_unstale":"2024-03-07T07:32:09.738566+0000","last_undegraded":"2024-03-07T07:32:09.738566+0000","last_fullsized":"2024-03-07T07:32:09.738566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:23:36.667810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730135+0000","last_change":"2024-03-07T07:32:08.729034+0000","last_active":"2024-03-07T07:32:08.730135+0000","last_peered":"2024-03-07T07:32:08.730135+0000","last_clean":"2024-03-07T07:32:08.730135+0000","last_became_active":"2024-03-07T07:32:08.728745+0000","last_became_peered":"2024-03-07T07:32:08.728745+0000","last_unstale":"2024-03-07T07:32:08.730135+0000","last_undegraded":"2024-03-07T07:32:08.730135+0000","last_fullsized":"2024-03-07T07:32:08.730135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:11.184461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744006+0000","last_change":"2024-03-07T07:32:09.735410+0000","last_active":"2024-03-07T07:32:09.744006+0000","last_peered":"2024-03-07T07:32:09.744006+0000","last_clean":"2024-03-07T07:32:09.744006+0000","last_became_active":"2024-03-07T07:32:09.735140+0000","last_became_peered":"2024-03-07T07:32:09.735140+0000","last_unstale":"2024-03-07T07:32:09.744006+0000","last_undegraded":"2024-03-07T07:32:09.744006+0000","last_fullsized":"2024-03-07T07:32:09.744006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:35:37.916914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752220+0000","last_change":"2024-03-07T07:32:08.712845+0000","last_active":"2024-03-07T07:32:09.752220+0000","last_peered":"2024-03-07T07:32:09.752220+0000","last_clean":"2024-03-07T07:32:09.752220+0000","last_became_active":"2024-03-07T07:32:08.712543+0000","last_became_peered":"2024-03-07T07:32:08.712543+0000","last_unstale":"2024-03-07T07:32:09.752220+0000","last_undegraded":"2024-03-07T07:32:09.752220+0000","last_fullsized":"2024-03-07T07:32:09.752220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:43.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.709596+0000","last_change":"2024-03-07T07:32:08.709596+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.709596+0000","last_undegraded":"2024-03-07T07:32:08.709596+0000","last_fullsized":"2024-03-07T07:32:08.709596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.753504+0000","last_change":"2024-03-07T07:32:08.726767+0000","last_active":"2024-03-07T07:32:09.753504+0000","last_peered":"2024-03-07T07:32:09.753504+0000","last_clean":"2024-03-07T07:32:09.753504+0000","last_became_active":"2024-03-07T07:32:08.721780+0000","last_became_peered":"2024-03-07T07:32:08.721780+0000","last_unstale":"2024-03-07T07:32:09.753504+0000","last_undegraded":"2024-03-07T07:32:09.753504+0000","last_fullsized":"2024-03-07T07:32:09.753504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:57.931351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711741+0000","last_change":"2024-03-07T07:32:08.711741+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711741+0000","last_undegraded":"2024-03-07T07:32:08.711741+0000","last_fullsized":"2024-03-07T07:32:08.711741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.721236+0000","last_change":"2024-03-07T07:32:08.724075+0000","last_active":"2024-03-07T07:32:09.721236+0000","last_peered":"2024-03-07T07:32:09.721236+0000","last_clean":"2024-03-07T07:32:09.721236+0000","last_became_active":"2024-03-07T07:32:08.723816+0000","last_became_peered":"2024-03-07T07:32:08.723816+0000","last_unstale":"2024-03-07T07:32:09.721236+0000","last_undegraded":"2024-03-07T07:32:09.721236+0000","last_fullsized":"2024-03-07T07:32:09.721236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:57.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710359+0000","last_change":"2024-03-07T07:32:08.710359+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710359+0000","last_undegraded":"2024-03-07T07:32:08.710359+0000","last_fullsized":"2024-03-07T07:32:08.710359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726274+0000","last_change":"2024-03-07T07:32:08.725250+0000","last_active":"2024-03-07T07:32:08.726274+0000","last_peered":"2024-03-07T07:32:08.726274+0000","last_clean":"2024-03-07T07:32:08.726274+0000","last_became_active":"2024-03-07T07:32:08.724952+0000","last_became_peered":"2024-03-07T07:32:08.724952+0000","last_unstale":"2024-03-07T07:32:08.726274+0000","last_undegraded":"2024-03-07T07:32:08.726274+0000","last_fullsized":"2024-03-07T07:32:08.726274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:14.784463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.717335+0000","last_change":"2024-03-07T07:32:08.717335+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.717335+0000","last_undegraded":"2024-03-07T07:32:08.717335+0000","last_fullsized":"2024-03-07T07:32:08.717335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.717693+0000","last_change":"2024-03-07T07:32:08.722811+0000","last_active":"2024-03-07T07:32:09.717693+0000","last_peered":"2024-03-07T07:32:09.717693+0000","last_clean":"2024-03-07T07:32:09.717693+0000","last_became_active":"2024-03-07T07:32:08.722388+0000","last_became_peered":"2024-03-07T07:32:08.722388+0000","last_unstale":"2024-03-07T07:32:09.717693+0000","last_undegraded":"2024-03-07T07:32:09.717693+0000","last_fullsized":"2024-03-07T07:32:09.717693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:09.210160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708028+0000","last_change":"2024-03-07T07:32:08.708028+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708028+0000","last_undegraded":"2024-03-07T07:32:08.708028+0000","last_fullsized":"2024-03-07T07:32:08.708028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.724976+0000","last_change":"2024-03-07T07:32:08.727283+0000","last_active":"2024-03-07T07:32:09.724976+0000","last_peered":"2024-03-07T07:32:09.724976+0000","last_clean":"2024-03-07T07:32:09.724976+0000","last_became_active":"2024-03-07T07:32:08.727012+0000","last_became_peered":"2024-03-07T07:32:08.727012+0000","last_unstale":"2024-03-07T07:32:09.724976+0000","last_undegraded":"2024-03-07T07:32:09.724976+0000","last_fullsized":"2024-03-07T07:32:09.724976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:11.184461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752754+0000","last_change":"2024-03-07T07:32:09.743462+0000","last_active":"2024-03-07T07:32:09.752754+0000","last_peered":"2024-03-07T07:32:09.752754+0000","last_clean":"2024-03-07T07:32:09.752754+0000","last_became_active":"2024-03-07T07:32:09.743094+0000","last_became_peered":"2024-03-07T07:32:09.743094+0000","last_unstale":"2024-03-07T07:32:09.752754+0000","last_undegraded":"2024-03-07T07:32:09.752754+0000","last_fullsized":"2024-03-07T07:32:09.752754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:24.575003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.715054+0000","last_change":"2024-03-07T07:32:08.723260+0000","last_active":"2024-03-07T07:32:09.715054+0000","last_peered":"2024-03-07T07:32:09.715054+0000","last_clean":"2024-03-07T07:32:09.715054+0000","last_became_active":"2024-03-07T07:32:08.723010+0000","last_became_peered":"2024-03-07T07:32:08.723010+0000","last_unstale":"2024-03-07T07:32:09.715054+0000","last_undegraded":"2024-03-07T07:32:09.715054+0000","last_fullsized":"2024-03-07T07:32:09.715054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:20.834267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711911+0000","last_change":"2024-03-07T07:32:08.711911+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711911+0000","last_undegraded":"2024-03-07T07:32:08.711911+0000","last_fullsized":"2024-03-07T07:32:08.711911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725343+0000","last_change":"2024-03-07T07:32:08.723288+0000","last_active":"2024-03-07T07:32:08.725343+0000","last_peered":"2024-03-07T07:32:08.725343+0000","last_clean":"2024-03-07T07:32:08.725343+0000","last_became_active":"2024-03-07T07:32:08.723011+0000","last_became_peered":"2024-03-07T07:32:08.723011+0000","last_unstale":"2024-03-07T07:32:08.725343+0000","last_undegraded":"2024-03-07T07:32:08.725343+0000","last_fullsized":"2024-03-07T07:32:08.725343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:36:01.958659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734457+0000","last_change":"2024-03-07T07:32:09.732193+0000","last_active":"2024-03-07T07:32:09.734457+0000","last_peered":"2024-03-07T07:32:09.734457+0000","last_clean":"2024-03-07T07:32:09.734457+0000","last_became_active":"2024-03-07T07:32:09.731912+0000","last_became_peered":"2024-03-07T07:32:09.731912+0000","last_unstale":"2024-03-07T07:32:09.734457+0000","last_undegraded":"2024-03-07T07:32:09.734457+0000","last_fullsized":"2024-03-07T07:32:09.734457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:38:38.626228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.729975+0000","last_change":"2024-03-07T07:32:08.728905+0000","last_active":"2024-03-07T07:32:08.729975+0000","last_peered":"2024-03-07T07:32:08.729975+0000","last_clean":"2024-03-07T07:32:08.729975+0000","last_became_active":"2024-03-07T07:32:08.728584+0000","last_became_peered":"2024-03-07T07:32:08.728584+0000","last_unstale":"2024-03-07T07:32:08.729975+0000","last_undegraded":"2024-03-07T07:32:08.729975+0000","last_fullsized":"2024-03-07T07:32:08.729975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:26.993668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711171+0000","last_change":"2024-03-07T07:32:08.711171+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711171+0000","last_undegraded":"2024-03-07T07:32:08.711171+0000","last_fullsized":"2024-03-07T07:32:08.711171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.724600+0000","last_change":"2024-03-07T07:32:08.722707+0000","last_active":"2024-03-07T07:32:08.724600+0000","last_peered":"2024-03-07T07:32:08.724600+0000","last_clean":"2024-03-07T07:32:08.724600+0000","last_became_active":"2024-03-07T07:32:08.721788+0000","last_became_peered":"2024-03-07T07:32:08.721788+0000","last_unstale":"2024-03-07T07:32:08.724600+0000","last_undegraded":"2024-03-07T07:32:08.724600+0000","last_fullsized":"2024-03-07T07:32:08.724600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:55.611551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737253+0000","last_change":"2024-03-07T07:32:09.732507+0000","last_active":"2024-03-07T07:32:09.737253+0000","last_peered":"2024-03-07T07:32:09.737253+0000","last_clean":"2024-03-07T07:32:09.737253+0000","last_became_active":"2024-03-07T07:32:09.732228+0000","last_became_peered":"2024-03-07T07:32:09.732228+0000","last_unstale":"2024-03-07T07:32:09.737253+0000","last_undegraded":"2024-03-07T07:32:09.737253+0000","last_fullsized":"2024-03-07T07:32:09.737253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:04.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.727804+0000","last_change":"2024-03-07T07:32:08.723402+0000","last_active":"2024-03-07T07:32:08.727804+0000","last_peered":"2024-03-07T07:32:08.727804+0000","last_clean":"2024-03-07T07:32:08.727804+0000","last_became_active":"2024-03-07T07:32:08.722984+0000","last_became_peered":"2024-03-07T07:32:08.722984+0000","last_unstale":"2024-03-07T07:32:08.727804+0000","last_undegraded":"2024-03-07T07:32:08.727804+0000","last_fullsized":"2024-03-07T07:32:08.727804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:54.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703006+0000","last_change":"2024-03-07T07:32:08.703006+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703006+0000","last_undegraded":"2024-03-07T07:32:08.703006+0000","last_fullsized":"2024-03-07T07:32:08.703006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.723917+0000","last_change":"2024-03-07T07:32:08.721683+0000","last_active":"2024-03-07T07:32:08.723917+0000","last_peered":"2024-03-07T07:32:08.723917+0000","last_clean":"2024-03-07T07:32:08.723917+0000","last_became_active":"2024-03-07T07:32:08.721226+0000","last_became_peered":"2024-03-07T07:32:08.721226+0000","last_unstale":"2024-03-07T07:32:08.723917+0000","last_undegraded":"2024-03-07T07:32:08.723917+0000","last_fullsized":"2024-03-07T07:32:08.723917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:41:05.054365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705139+0000","last_change":"2024-03-07T07:32:08.705139+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705139+0000","last_undegraded":"2024-03-07T07:32:08.705139+0000","last_fullsized":"2024-03-07T07:32:08.705139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.719575+0000","last_change":"2024-03-07T07:32:08.714980+0000","last_active":"2024-03-07T07:32:09.719575+0000","last_peered":"2024-03-07T07:32:09.719575+0000","last_clean":"2024-03-07T07:32:09.719575+0000","last_became_active":"2024-03-07T07:32:08.714659+0000","last_became_peered":"2024-03-07T07:32:08.714659+0000","last_unstale":"2024-03-07T07:32:09.719575+0000","last_undegraded":"2024-03-07T07:32:09.719575+0000","last_fullsized":"2024-03-07T07:32:09.719575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:14.784463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734491+0000","last_change":"2024-03-07T07:32:09.732846+0000","last_active":"2024-03-07T07:32:09.734491+0000","last_peered":"2024-03-07T07:32:09.734491+0000","last_clean":"2024-03-07T07:32:09.734491+0000","last_became_active":"2024-03-07T07:32:09.731979+0000","last_became_peered":"2024-03-07T07:32:09.731979+0000","last_unstale":"2024-03-07T07:32:09.734491+0000","last_undegraded":"2024-03-07T07:32:09.734491+0000","last_fullsized":"2024-03-07T07:32:09.734491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:39:44.332839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.728312+0000","last_change":"2024-03-07T07:32:08.726960+0000","last_active":"2024-03-07T07:32:08.728312+0000","last_peered":"2024-03-07T07:32:08.728312+0000","last_clean":"2024-03-07T07:32:08.728312+0000","last_became_active":"2024-03-07T07:32:08.726686+0000","last_became_peered":"2024-03-07T07:32:08.726686+0000","last_unstale":"2024-03-07T07:32:08.728312+0000","last_undegraded":"2024-03-07T07:32:08.728312+0000","last_fullsized":"2024-03-07T07:32:08.728312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:34:30.228981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737233+0000","last_change":"2024-03-07T07:32:09.733315+0000","last_active":"2024-03-07T07:32:09.737233+0000","last_peered":"2024-03-07T07:32:09.737233+0000","last_clean":"2024-03-07T07:32:09.737233+0000","last_became_active":"2024-03-07T07:32:09.733052+0000","last_became_peered":"2024-03-07T07:32:09.733052+0000","last_unstale":"2024-03-07T07:32:09.737233+0000","last_undegraded":"2024-03-07T07:32:09.737233+0000","last_fullsized":"2024-03-07T07:32:09.737233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:06:31.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.716459+0000","last_change":"2024-03-07T07:32:08.721617+0000","last_active":"2024-03-07T07:32:09.716459+0000","last_peered":"2024-03-07T07:32:09.716459+0000","last_clean":"2024-03-07T07:32:09.716459+0000","last_became_active":"2024-03-07T07:32:08.721242+0000","last_became_peered":"2024-03-07T07:32:08.721242+0000","last_unstale":"2024-03-07T07:32:09.716459+0000","last_undegraded":"2024-03-07T07:32:09.716459+0000","last_fullsized":"2024-03-07T07:32:09.716459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:41:43.318106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.725441+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:32:09.725441+0000","last_peered":"2024-03-07T07:32:09.725441+0000","last_clean":"2024-03-07T07:32:09.725441+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:32:09.725441+0000","last_undegraded":"2024-03-07T07:32:09.725441+0000","last_fullsized":"2024-03-07T07:32:09.725441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":725008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":718733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:32:14.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:32:14.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.393+0000 7fddada00640 1 Processor -- start 2024-03-07T07:32:14.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.393+0000 7fddada00640 1 -- start start 2024-03-07T07:32:14.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fddada00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdda815c1f0 0x7fdda80b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fddada00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80cf100 0x7fdda80d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fddada00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda80b0290 con 0x7fdda80b3a00 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fddada00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda80b1d40 con 0x7fdda815c1f0 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fddada00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda80b0570 con 0x7fdda80cf100 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda7400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdda80b3a00 0x7fdda815c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56788/0 (socket says 172.21.15.84:56788) 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda7400640 1 -- 172.21.15.84:0/2283445997 learned_addr learned my addr 172.21.15.84:0/2283445997 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda6a00640 1 --2- 172.21.15.84:0/2283445997 >> v2:172.21.15.84:3300/0 conn(0x7fdda815c1f0 0x7fdda80b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda6000640 1 --2- 172.21.15.84:0/2283445997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80cf100 0x7fdda80d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda6a00640 1 -- 172.21.15.84:0/2283445997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80cf100 msgr2=0x7fdda80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda6a00640 1 --2- 172.21.15.84:0/2283445997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80cf100 0x7fdda80d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda6a00640 1 -- 172.21.15.84:0/2283445997 >> v1:172.21.15.84:6789/0 conn(0x7fdda80b3a00 legacy=0x7fdda815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda6a00640 1 -- 172.21.15.84:0/2283445997 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80b0850 con 0x7fdda815c1f0 2024-03-07T07:32:14.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda5600640 1 -- 172.21.15.84:0/2283445997 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609104217 0 0) 0x7fdda80b0290 con 0x7fdda80b3a00 2024-03-07T07:32:14.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda6000640 1 --2- 172.21.15.84:0/2283445997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80cf100 0x7fdda80d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:14.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda6a00640 1 --2- 172.21.15.84:0/2283445997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda815c1f0 0x7fdda80b1330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdd980097c0 tx=0x7fdd9801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356bc3bd9651475f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda5600640 1 -- 172.21.15.84:0/2283445997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd980b0070 con 0x7fdda815c1f0 2024-03-07T07:32:14.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda5600640 1 -- 172.21.15.84:0/2283445997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd980ab600 con 0x7fdda815c1f0 2024-03-07T07:32:14.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.397+0000 7fdda5600640 1 -- 172.21.15.84:0/2283445997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd980ab9d0 con 0x7fdda815c1f0 2024-03-07T07:32:14.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- 172.21.15.84:0/2283445997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda815c1f0 msgr2=0x7fdda80b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 --2- 172.21.15.84:0/2283445997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda815c1f0 0x7fdda80b1330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdd980097c0 tx=0x7fdd9801c410 comp rx=0 tx=0).stop 2024-03-07T07:32:14.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- 172.21.15.84:0/2283445997 shutdown_connections 2024-03-07T07:32:14.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 --2- 172.21.15.84:0/2283445997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80cf100 0x7fdda80d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 --2- 172.21.15.84:0/2283445997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda815c1f0 0x7fdda80b1330 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- 172.21.15.84:0/2283445997 >> 172.21.15.84:0/2283445997 conn(0x7fdda80b1ed0 msgr2=0x7fdda80b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:14.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- 172.21.15.84:0/2283445997 shutdown_connections 2024-03-07T07:32:14.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- 172.21.15.84:0/2283445997 wait complete. 2024-03-07T07:32:14.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 Processor -- start 2024-03-07T07:32:14.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- start start 2024-03-07T07:32:14.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda80b3a00 0x7fdda8071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda80cf100 0x7fdda80cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda815c1f0 0x7fdda80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8168e60 con 0x7fdda80b3a00 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8168ce0 con 0x7fdda80cf100 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fddada00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8168fe0 con 0x7fdda815c1f0 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fdda6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda80b3a00 0x7fdda8071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fdda6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda80b3a00 0x7fdda8071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44590/0 (socket says 172.21.15.84:44590) 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fdda6a00640 1 -- 172.21.15.84:0/2123660810 learned_addr learned my addr 172.21.15.84:0/2123660810 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fdda6a00640 1 -- 172.21.15.84:0/2123660810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda815c1f0 msgr2=0x7fdda80cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fdda6a00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda815c1f0 0x7fdda80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fdda6a00640 1 -- 172.21.15.84:0/2123660810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda80cf100 msgr2=0x7fdda80cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fdda6a00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda80cf100 0x7fdda80cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.401+0000 7fdda6a00640 1 -- 172.21.15.84:0/2123660810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8071b40 con 0x7fdda80b3a00 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdda6a00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda80b3a00 0x7fdda8071600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd980ae040 tx=0x7fdd9801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdd9ea00640 1 -- 172.21.15.84:0/2123660810 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd980b0050 con 0x7fdda80b3a00 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdd9ea00640 1 -- 172.21.15.84:0/2123660810 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd980bc070 con 0x7fdda80b3a00 2024-03-07T07:32:14.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdd9ea00640 1 -- 172.21.15.84:0/2123660810 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd980b5850 con 0x7fdda80b3a00 2024-03-07T07:32:14.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda81f7090 con 0x7fdda80b3a00 2024-03-07T07:32:14.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda81f7650 con 0x7fdda80b3a00 2024-03-07T07:32:14.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda8062d40 con 0x7fdda80b3a00 2024-03-07T07:32:14.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdd9ea00640 1 -- 172.21.15.84:0/2123660810 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fdd980b59f0 con 0x7fdda80b3a00 2024-03-07T07:32:14.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdd9ea00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdd9ea00640 1 -- 172.21.15.84:0/2123660810 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd9811f6f0 con 0x7fdda80b3a00 2024-03-07T07:32:14.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdda6000640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.405+0000 7fdda6000640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdd94006f10 tx=0x7fdd94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.409+0000 7fdd9ea00640 1 -- 172.21.15.84:0/2123660810 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fdd98016090 con 0x7fdda80b3a00 2024-03-07T07:32:14.538 INFO:tasks.ceph.mds.c.smithi084.stderr:2024-03-07T07:32:14.537+0000 7f46ecc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T07:32:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.589+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdda80d0da0 con 0x7fdd88066f60 2024-03-07T07:32:14.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.597+0000 7fdd9ea00640 1 -- 172.21.15.84:0/2123660810 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249420 (secure 0 0 0) 0x7fdda80d0da0 con 0x7fdd88066f60 2024-03-07T07:32:14.600 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:14.601 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 msgr2=0x7fdd88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdd94006f10 tx=0x7fdd94008040 comp rx=0 tx=0).stop 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda80b3a00 msgr2=0x7fdda8071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda80b3a00 0x7fdda8071600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd980ae040 tx=0x7fdd9801ac50 comp rx=0 tx=0).stop 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 shutdown_connections 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd88066f60 0x7fdd88069420 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda815c1f0 0x7fdda80cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda80cf100 0x7fdda80cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 --2- 172.21.15.84:0/2123660810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda80b3a00 0x7fdda8071600 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 >> 172.21.15.84:0/2123660810 conn(0x7fdda80b1ed0 msgr2=0x7fdda8154950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 shutdown_connections 2024-03-07T07:32:14.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.601+0000 7fddada00640 1 -- 172.21.15.84:0/2123660810 wait complete. 2024-03-07T07:32:14.620 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-03-07T07:32:12.890816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220056,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754664,"statfs":{"total":773094113280,"available":772868775936,"internally_reserved":0,"allocated":3973120,"data_stored":2239621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.195356"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734464+0000","last_change":"2024-03-07T07:32:09.730012+0000","last_active":"2024-03-07T07:32:09.734464+0000","last_peered":"2024-03-07T07:32:09.734464+0000","last_clean":"2024-03-07T07:32:09.734464+0000","last_became_active":"2024-03-07T07:32:09.729740+0000","last_became_peered":"2024-03-07T07:32:09.729740+0000","last_unstale":"2024-03-07T07:32:09.734464+0000","last_undegraded":"2024-03-07T07:32:09.734464+0000","last_fullsized":"2024-03-07T07:32:09.734464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:27.999230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.713513+0000","last_change":"2024-03-07T07:32:08.713513+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.713513+0000","last_undegraded":"2024-03-07T07:32:08.713513+0000","last_fullsized":"2024-03-07T07:32:08.713513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.748155+0000","last_change":"2024-03-07T07:32:09.741223+0000","last_active":"2024-03-07T07:32:09.748155+0000","last_peered":"2024-03-07T07:32:09.748155+0000","last_clean":"2024-03-07T07:32:09.748155+0000","last_became_active":"2024-03-07T07:32:09.740812+0000","last_became_peered":"2024-03-07T07:32:09.740812+0000","last_unstale":"2024-03-07T07:32:09.748155+0000","last_undegraded":"2024-03-07T07:32:09.748155+0000","last_fullsized":"2024-03-07T07:32:09.748155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:11:31.178552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704337+0000","last_change":"2024-03-07T07:32:08.704337+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704337+0000","last_undegraded":"2024-03-07T07:32:08.704337+0000","last_fullsized":"2024-03-07T07:32:08.704337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.717859+0000","last_change":"2024-03-07T07:32:08.717859+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.717859+0000","last_undegraded":"2024-03-07T07:32:08.717859+0000","last_fullsized":"2024-03-07T07:32:08.717859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711383+0000","last_change":"2024-03-07T07:32:08.711383+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711383+0000","last_undegraded":"2024-03-07T07:32:08.711383+0000","last_fullsized":"2024-03-07T07:32:08.711383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.750652+0000","last_change":"2024-03-07T07:32:09.745334+0000","last_active":"2024-03-07T07:32:09.750652+0000","last_peered":"2024-03-07T07:32:09.750652+0000","last_clean":"2024-03-07T07:32:09.750652+0000","last_became_active":"2024-03-07T07:32:09.745084+0000","last_became_peered":"2024-03-07T07:32:09.745084+0000","last_unstale":"2024-03-07T07:32:09.750652+0000","last_undegraded":"2024-03-07T07:32:09.750652+0000","last_fullsized":"2024-03-07T07:32:09.750652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:12:19.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744785+0000","last_change":"2024-03-07T07:32:09.736538+0000","last_active":"2024-03-07T07:32:09.744785+0000","last_peered":"2024-03-07T07:32:09.744785+0000","last_clean":"2024-03-07T07:32:09.744785+0000","last_became_active":"2024-03-07T07:32:09.736186+0000","last_became_peered":"2024-03-07T07:32:09.736186+0000","last_unstale":"2024-03-07T07:32:09.744785+0000","last_undegraded":"2024-03-07T07:32:09.744785+0000","last_fullsized":"2024-03-07T07:32:09.744785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:18.860889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752779+0000","last_change":"2024-03-07T07:32:09.744105+0000","last_active":"2024-03-07T07:32:09.752779+0000","last_peered":"2024-03-07T07:32:09.752779+0000","last_clean":"2024-03-07T07:32:09.752779+0000","last_became_active":"2024-03-07T07:32:09.743854+0000","last_became_peered":"2024-03-07T07:32:09.743854+0000","last_unstale":"2024-03-07T07:32:09.752779+0000","last_undegraded":"2024-03-07T07:32:09.752779+0000","last_fullsized":"2024-03-07T07:32:09.752779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:10.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704847+0000","last_change":"2024-03-07T07:32:08.704847+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704847+0000","last_undegraded":"2024-03-07T07:32:08.704847+0000","last_fullsized":"2024-03-07T07:32:08.704847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734362+0000","last_change":"2024-03-07T07:32:09.729434+0000","last_active":"2024-03-07T07:32:09.734362+0000","last_peered":"2024-03-07T07:32:09.734362+0000","last_clean":"2024-03-07T07:32:09.734362+0000","last_became_active":"2024-03-07T07:32:09.728932+0000","last_became_peered":"2024-03-07T07:32:09.728932+0000","last_unstale":"2024-03-07T07:32:09.734362+0000","last_undegraded":"2024-03-07T07:32:09.734362+0000","last_fullsized":"2024-03-07T07:32:09.734362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:26:25.930786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752687+0000","last_change":"2024-03-07T07:32:09.742631+0000","last_active":"2024-03-07T07:32:09.752687+0000","last_peered":"2024-03-07T07:32:09.752687+0000","last_clean":"2024-03-07T07:32:09.752687+0000","last_became_active":"2024-03-07T07:32:09.740785+0000","last_became_peered":"2024-03-07T07:32:09.740785+0000","last_unstale":"2024-03-07T07:32:09.752687+0000","last_undegraded":"2024-03-07T07:32:09.752687+0000","last_fullsized":"2024-03-07T07:32:09.752687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:06.625131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.707637+0000","last_change":"2024-03-07T07:32:08.707637+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.707637+0000","last_undegraded":"2024-03-07T07:32:08.707637+0000","last_fullsized":"2024-03-07T07:32:08.707637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703686+0000","last_change":"2024-03-07T07:32:08.703686+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703686+0000","last_undegraded":"2024-03-07T07:32:08.703686+0000","last_fullsized":"2024-03-07T07:32:08.703686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.735720+0000","last_change":"2024-03-07T07:32:09.727701+0000","last_active":"2024-03-07T07:32:09.735720+0000","last_peered":"2024-03-07T07:32:09.735720+0000","last_clean":"2024-03-07T07:32:09.735720+0000","last_became_active":"2024-03-07T07:32:09.727424+0000","last_became_peered":"2024-03-07T07:32:09.727424+0000","last_unstale":"2024-03-07T07:32:09.735720+0000","last_undegraded":"2024-03-07T07:32:09.735720+0000","last_fullsized":"2024-03-07T07:32:09.735720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:15.863540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.740620+0000","last_change":"2024-03-07T07:32:09.732094+0000","last_active":"2024-03-07T07:32:09.740620+0000","last_peered":"2024-03-07T07:32:09.740620+0000","last_clean":"2024-03-07T07:32:09.740620+0000","last_became_active":"2024-03-07T07:32:09.731685+0000","last_became_peered":"2024-03-07T07:32:09.731685+0000","last_unstale":"2024-03-07T07:32:09.740620+0000","last_undegraded":"2024-03-07T07:32:09.740620+0000","last_fullsized":"2024-03-07T07:32:09.740620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:57.484266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737685+0000","last_change":"2024-03-07T07:32:09.733381+0000","last_active":"2024-03-07T07:32:09.737685+0000","last_peered":"2024-03-07T07:32:09.737685+0000","last_clean":"2024-03-07T07:32:09.737685+0000","last_became_active":"2024-03-07T07:32:09.733061+0000","last_became_peered":"2024-03-07T07:32:09.733061+0000","last_unstale":"2024-03-07T07:32:09.737685+0000","last_undegraded":"2024-03-07T07:32:09.737685+0000","last_fullsized":"2024-03-07T07:32:09.737685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:41:20.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.712395+0000","last_change":"2024-03-07T07:32:08.712395+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.712395+0000","last_undegraded":"2024-03-07T07:32:08.712395+0000","last_fullsized":"2024-03-07T07:32:08.712395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.712198+0000","last_change":"2024-03-07T07:32:08.712198+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.712198+0000","last_undegraded":"2024-03-07T07:32:08.712198+0000","last_fullsized":"2024-03-07T07:32:08.712198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708270+0000","last_change":"2024-03-07T07:32:08.708270+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708270+0000","last_undegraded":"2024-03-07T07:32:08.708270+0000","last_fullsized":"2024-03-07T07:32:08.708270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737291+0000","last_change":"2024-03-07T07:32:09.733151+0000","last_active":"2024-03-07T07:32:09.737291+0000","last_peered":"2024-03-07T07:32:09.737291+0000","last_clean":"2024-03-07T07:32:09.737291+0000","last_became_active":"2024-03-07T07:32:09.732916+0000","last_became_peered":"2024-03-07T07:32:09.732916+0000","last_unstale":"2024-03-07T07:32:09.737291+0000","last_undegraded":"2024-03-07T07:32:09.737291+0000","last_fullsized":"2024-03-07T07:32:09.737291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:12:19.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734352+0000","last_change":"2024-03-07T07:32:09.729634+0000","last_active":"2024-03-07T07:32:09.734352+0000","last_peered":"2024-03-07T07:32:09.734352+0000","last_clean":"2024-03-07T07:32:09.734352+0000","last_became_active":"2024-03-07T07:32:09.729365+0000","last_became_peered":"2024-03-07T07:32:09.729365+0000","last_unstale":"2024-03-07T07:32:09.734352+0000","last_undegraded":"2024-03-07T07:32:09.734352+0000","last_fullsized":"2024-03-07T07:32:09.734352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:47.428345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.707282+0000","last_change":"2024-03-07T07:32:08.707282+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.707282+0000","last_undegraded":"2024-03-07T07:32:08.707282+0000","last_fullsized":"2024-03-07T07:32:08.707282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.748885+0000","last_change":"2024-03-07T07:32:09.743716+0000","last_active":"2024-03-07T07:32:09.748885+0000","last_peered":"2024-03-07T07:32:09.748885+0000","last_clean":"2024-03-07T07:32:09.748885+0000","last_became_active":"2024-03-07T07:32:09.743472+0000","last_became_peered":"2024-03-07T07:32:09.743472+0000","last_unstale":"2024-03-07T07:32:09.748885+0000","last_undegraded":"2024-03-07T07:32:09.748885+0000","last_fullsized":"2024-03-07T07:32:09.748885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:22:41.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705258+0000","last_change":"2024-03-07T07:32:08.705258+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705258+0000","last_undegraded":"2024-03-07T07:32:08.705258+0000","last_fullsized":"2024-03-07T07:32:08.705258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704237+0000","last_change":"2024-03-07T07:32:08.704237+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704237+0000","last_undegraded":"2024-03-07T07:32:08.704237+0000","last_fullsized":"2024-03-07T07:32:08.704237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710970+0000","last_change":"2024-03-07T07:32:08.710970+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710970+0000","last_undegraded":"2024-03-07T07:32:08.710970+0000","last_fullsized":"2024-03-07T07:32:08.710970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.746972+0000","last_change":"2024-03-07T07:32:09.737554+0000","last_active":"2024-03-07T07:32:09.746972+0000","last_peered":"2024-03-07T07:32:09.746972+0000","last_clean":"2024-03-07T07:32:09.746972+0000","last_became_active":"2024-03-07T07:32:09.736203+0000","last_became_peered":"2024-03-07T07:32:09.736203+0000","last_unstale":"2024-03-07T07:32:09.746972+0000","last_undegraded":"2024-03-07T07:32:09.746972+0000","last_fullsized":"2024-03-07T07:32:09.746972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:15.863540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737268+0000","last_change":"2024-03-07T07:32:09.732781+0000","last_active":"2024-03-07T07:32:09.737268+0000","last_peered":"2024-03-07T07:32:09.737268+0000","last_clean":"2024-03-07T07:32:09.737268+0000","last_became_active":"2024-03-07T07:32:09.732522+0000","last_became_peered":"2024-03-07T07:32:09.732522+0000","last_unstale":"2024-03-07T07:32:09.737268+0000","last_undegraded":"2024-03-07T07:32:09.737268+0000","last_fullsized":"2024-03-07T07:32:09.737268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:22:41.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737916+0000","last_change":"2024-03-07T07:32:09.733989+0000","last_active":"2024-03-07T07:32:09.737916+0000","last_peered":"2024-03-07T07:32:09.737916+0000","last_clean":"2024-03-07T07:32:09.737916+0000","last_became_active":"2024-03-07T07:32:09.733697+0000","last_became_peered":"2024-03-07T07:32:09.733697+0000","last_unstale":"2024-03-07T07:32:09.737916+0000","last_undegraded":"2024-03-07T07:32:09.737916+0000","last_fullsized":"2024-03-07T07:32:09.737916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:24:54.602616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.745886+0000","last_change":"2024-03-07T07:32:09.737262+0000","last_active":"2024-03-07T07:32:09.745886+0000","last_peered":"2024-03-07T07:32:09.745886+0000","last_clean":"2024-03-07T07:32:09.745886+0000","last_became_active":"2024-03-07T07:32:09.734562+0000","last_became_peered":"2024-03-07T07:32:09.734562+0000","last_unstale":"2024-03-07T07:32:09.745886+0000","last_undegraded":"2024-03-07T07:32:09.745886+0000","last_fullsized":"2024-03-07T07:32:09.745886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:58.156994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.731496+0000","last_change":"2024-03-07T07:32:09.720498+0000","last_active":"2024-03-07T07:32:09.731496+0000","last_peered":"2024-03-07T07:32:09.731496+0000","last_clean":"2024-03-07T07:32:09.731496+0000","last_became_active":"2024-03-07T07:32:09.720213+0000","last_became_peered":"2024-03-07T07:32:09.720213+0000","last_unstale":"2024-03-07T07:32:09.731496+0000","last_undegraded":"2024-03-07T07:32:09.731496+0000","last_fullsized":"2024-03-07T07:32:09.731496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:56.867331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708705+0000","last_change":"2024-03-07T07:32:08.708705+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708705+0000","last_undegraded":"2024-03-07T07:32:08.708705+0000","last_fullsized":"2024-03-07T07:32:08.708705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752414+0000","last_change":"2024-03-07T07:32:08.727746+0000","last_active":"2024-03-07T07:32:09.752414+0000","last_peered":"2024-03-07T07:32:09.752414+0000","last_clean":"2024-03-07T07:32:09.752414+0000","last_became_active":"2024-03-07T07:32:08.726860+0000","last_became_peered":"2024-03-07T07:32:08.726860+0000","last_unstale":"2024-03-07T07:32:09.752414+0000","last_undegraded":"2024-03-07T07:32:09.752414+0000","last_fullsized":"2024-03-07T07:32:09.752414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:41:19.781917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.747653+0000","last_change":"2024-03-07T07:32:09.740174+0000","last_active":"2024-03-07T07:32:09.747653+0000","last_peered":"2024-03-07T07:32:09.747653+0000","last_clean":"2024-03-07T07:32:09.747653+0000","last_became_active":"2024-03-07T07:32:09.739811+0000","last_became_peered":"2024-03-07T07:32:09.739811+0000","last_unstale":"2024-03-07T07:32:09.747653+0000","last_undegraded":"2024-03-07T07:32:09.747653+0000","last_fullsized":"2024-03-07T07:32:09.747653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:57.484266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726508+0000","last_change":"2024-03-07T07:32:08.724895+0000","last_active":"2024-03-07T07:32:08.726508+0000","last_peered":"2024-03-07T07:32:08.726508+0000","last_clean":"2024-03-07T07:32:08.726508+0000","last_became_active":"2024-03-07T07:32:08.724609+0000","last_became_peered":"2024-03-07T07:32:08.724609+0000","last_unstale":"2024-03-07T07:32:08.726508+0000","last_undegraded":"2024-03-07T07:32:08.726508+0000","last_fullsized":"2024-03-07T07:32:08.726508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:35:45.488891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.747809+0000","last_change":"2024-03-07T07:32:09.742029+0000","last_active":"2024-03-07T07:32:09.747809+0000","last_peered":"2024-03-07T07:32:09.747809+0000","last_clean":"2024-03-07T07:32:09.747809+0000","last_became_active":"2024-03-07T07:32:09.741612+0000","last_became_peered":"2024-03-07T07:32:09.741612+0000","last_unstale":"2024-03-07T07:32:09.747809+0000","last_undegraded":"2024-03-07T07:32:09.747809+0000","last_fullsized":"2024-03-07T07:32:09.747809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:04.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730112+0000","last_change":"2024-03-07T07:32:08.728713+0000","last_active":"2024-03-07T07:32:08.730112+0000","last_peered":"2024-03-07T07:32:08.730112+0000","last_clean":"2024-03-07T07:32:08.730112+0000","last_became_active":"2024-03-07T07:32:08.728291+0000","last_became_peered":"2024-03-07T07:32:08.728291+0000","last_unstale":"2024-03-07T07:32:08.730112+0000","last_undegraded":"2024-03-07T07:32:08.730112+0000","last_fullsized":"2024-03-07T07:32:08.730112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:23:56.220831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705484+0000","last_change":"2024-03-07T07:32:08.705484+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705484+0000","last_undegraded":"2024-03-07T07:32:08.705484+0000","last_fullsized":"2024-03-07T07:32:08.705484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.720810+0000","last_change":"2024-03-07T07:32:08.717295+0000","last_active":"2024-03-07T07:32:08.720810+0000","last_peered":"2024-03-07T07:32:08.720810+0000","last_clean":"2024-03-07T07:32:08.720810+0000","last_became_active":"2024-03-07T07:32:08.715284+0000","last_became_peered":"2024-03-07T07:32:08.715284+0000","last_unstale":"2024-03-07T07:32:08.720810+0000","last_undegraded":"2024-03-07T07:32:08.720810+0000","last_fullsized":"2024-03-07T07:32:08.720810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:36:01.958659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752638+0000","last_change":"2024-03-07T07:32:09.742100+0000","last_active":"2024-03-07T07:32:09.752638+0000","last_peered":"2024-03-07T07:32:09.752638+0000","last_clean":"2024-03-07T07:32:09.752638+0000","last_became_active":"2024-03-07T07:32:09.741769+0000","last_became_peered":"2024-03-07T07:32:09.741769+0000","last_unstale":"2024-03-07T07:32:09.752638+0000","last_undegraded":"2024-03-07T07:32:09.752638+0000","last_fullsized":"2024-03-07T07:32:09.752638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:54:10.883851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752898+0000","last_change":"2024-03-07T07:32:08.724105+0000","last_active":"2024-03-07T07:32:09.752898+0000","last_peered":"2024-03-07T07:32:09.752898+0000","last_clean":"2024-03-07T07:32:09.752898+0000","last_became_active":"2024-03-07T07:32:08.723796+0000","last_became_peered":"2024-03-07T07:32:08.723796+0000","last_unstale":"2024-03-07T07:32:09.752898+0000","last_undegraded":"2024-03-07T07:32:09.752898+0000","last_fullsized":"2024-03-07T07:32:09.752898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:09.647569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744660+0000","last_change":"2024-03-07T07:32:09.736758+0000","last_active":"2024-03-07T07:32:09.744660+0000","last_peered":"2024-03-07T07:32:09.744660+0000","last_clean":"2024-03-07T07:32:09.744660+0000","last_became_active":"2024-03-07T07:32:09.736405+0000","last_became_peered":"2024-03-07T07:32:09.736405+0000","last_unstale":"2024-03-07T07:32:09.744660+0000","last_undegraded":"2024-03-07T07:32:09.744660+0000","last_fullsized":"2024-03-07T07:32:09.744660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:44:21.013212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.750777+0000","last_change":"2024-03-07T07:32:08.725455+0000","last_active":"2024-03-07T07:32:09.750777+0000","last_peered":"2024-03-07T07:32:09.750777+0000","last_clean":"2024-03-07T07:32:09.750777+0000","last_became_active":"2024-03-07T07:32:08.721591+0000","last_became_peered":"2024-03-07T07:32:08.721591+0000","last_unstale":"2024-03-07T07:32:09.750777+0000","last_undegraded":"2024-03-07T07:32:09.750777+0000","last_fullsized":"2024-03-07T07:32:09.750777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:23.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752740+0000","last_change":"2024-03-07T07:32:09.743365+0000","last_active":"2024-03-07T07:32:09.752740+0000","last_peered":"2024-03-07T07:32:09.752740+0000","last_clean":"2024-03-07T07:32:09.752740+0000","last_became_active":"2024-03-07T07:32:09.743117+0000","last_became_peered":"2024-03-07T07:32:09.743117+0000","last_unstale":"2024-03-07T07:32:09.752740+0000","last_undegraded":"2024-03-07T07:32:09.752740+0000","last_fullsized":"2024-03-07T07:32:09.752740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:14.634090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725040+0000","last_change":"2024-03-07T07:32:08.722719+0000","last_active":"2024-03-07T07:32:08.725040+0000","last_peered":"2024-03-07T07:32:08.725040+0000","last_clean":"2024-03-07T07:32:08.725040+0000","last_became_active":"2024-03-07T07:32:08.722402+0000","last_became_peered":"2024-03-07T07:32:08.722402+0000","last_unstale":"2024-03-07T07:32:08.725040+0000","last_undegraded":"2024-03-07T07:32:08.725040+0000","last_fullsized":"2024-03-07T07:32:08.725040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:55:38.571318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703677+0000","last_change":"2024-03-07T07:32:08.703677+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703677+0000","last_undegraded":"2024-03-07T07:32:08.703677+0000","last_fullsized":"2024-03-07T07:32:08.703677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.719065+0000","last_change":"2024-03-07T07:32:08.717797+0000","last_active":"2024-03-07T07:32:09.719065+0000","last_peered":"2024-03-07T07:32:09.719065+0000","last_clean":"2024-03-07T07:32:09.719065+0000","last_became_active":"2024-03-07T07:32:08.717520+0000","last_became_peered":"2024-03-07T07:32:08.717520+0000","last_unstale":"2024-03-07T07:32:09.719065+0000","last_undegraded":"2024-03-07T07:32:09.719065+0000","last_fullsized":"2024-03-07T07:32:09.719065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:02.290184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744182+0000","last_change":"2024-03-07T07:32:09.738676+0000","last_active":"2024-03-07T07:32:09.744182+0000","last_peered":"2024-03-07T07:32:09.744182+0000","last_clean":"2024-03-07T07:32:09.744182+0000","last_became_active":"2024-03-07T07:32:09.738382+0000","last_became_peered":"2024-03-07T07:32:09.738382+0000","last_unstale":"2024-03-07T07:32:09.744182+0000","last_undegraded":"2024-03-07T07:32:09.744182+0000","last_fullsized":"2024-03-07T07:32:09.744182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:40:45.721561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726330+0000","last_change":"2024-03-07T07:32:08.725251+0000","last_active":"2024-03-07T07:32:08.726330+0000","last_peered":"2024-03-07T07:32:08.726330+0000","last_clean":"2024-03-07T07:32:08.726330+0000","last_became_active":"2024-03-07T07:32:08.724921+0000","last_became_peered":"2024-03-07T07:32:08.724921+0000","last_unstale":"2024-03-07T07:32:08.726330+0000","last_undegraded":"2024-03-07T07:32:08.726330+0000","last_fullsized":"2024-03-07T07:32:08.726330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:46.422783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704721+0000","last_change":"2024-03-07T07:32:08.704721+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704721+0000","last_undegraded":"2024-03-07T07:32:08.704721+0000","last_fullsized":"2024-03-07T07:32:08.704721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730748+0000","last_change":"2024-03-07T07:32:08.729316+0000","last_active":"2024-03-07T07:32:08.730748+0000","last_peered":"2024-03-07T07:32:08.730748+0000","last_clean":"2024-03-07T07:32:08.730748+0000","last_became_active":"2024-03-07T07:32:08.729021+0000","last_became_peered":"2024-03-07T07:32:08.729021+0000","last_unstale":"2024-03-07T07:32:08.730748+0000","last_undegraded":"2024-03-07T07:32:08.730748+0000","last_fullsized":"2024-03-07T07:32:08.730748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:17.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703557+0000","last_change":"2024-03-07T07:32:08.703557+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703557+0000","last_undegraded":"2024-03-07T07:32:08.703557+0000","last_fullsized":"2024-03-07T07:32:08.703557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.751068+0000","last_change":"2024-03-07T07:32:08.717596+0000","last_active":"2024-03-07T07:32:09.751068+0000","last_peered":"2024-03-07T07:32:09.751068+0000","last_clean":"2024-03-07T07:32:09.751068+0000","last_became_active":"2024-03-07T07:32:08.716657+0000","last_became_peered":"2024-03-07T07:32:08.716657+0000","last_unstale":"2024-03-07T07:32:09.751068+0000","last_undegraded":"2024-03-07T07:32:09.751068+0000","last_fullsized":"2024-03-07T07:32:09.751068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:17.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734385+0000","last_change":"2024-03-07T07:32:09.729099+0000","last_active":"2024-03-07T07:32:09.734385+0000","last_peered":"2024-03-07T07:32:09.734385+0000","last_clean":"2024-03-07T07:32:09.734385+0000","last_became_active":"2024-03-07T07:32:09.728580+0000","last_became_peered":"2024-03-07T07:32:09.728580+0000","last_unstale":"2024-03-07T07:32:09.734385+0000","last_undegraded":"2024-03-07T07:32:09.734385+0000","last_fullsized":"2024-03-07T07:32:09.734385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:47:58.388381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.723917+0000","last_change":"2024-03-07T07:32:08.719544+0000","last_active":"2024-03-07T07:32:08.723917+0000","last_peered":"2024-03-07T07:32:08.723917+0000","last_clean":"2024-03-07T07:32:08.723917+0000","last_became_active":"2024-03-07T07:32:08.719222+0000","last_became_peered":"2024-03-07T07:32:08.719222+0000","last_unstale":"2024-03-07T07:32:08.723917+0000","last_undegraded":"2024-03-07T07:32:08.723917+0000","last_fullsized":"2024-03-07T07:32:08.723917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:46:42.066266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710818+0000","last_change":"2024-03-07T07:32:08.710818+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710818+0000","last_undegraded":"2024-03-07T07:32:08.710818+0000","last_fullsized":"2024-03-07T07:32:08.710818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752346+0000","last_change":"2024-03-07T07:32:08.714266+0000","last_active":"2024-03-07T07:32:09.752346+0000","last_peered":"2024-03-07T07:32:09.752346+0000","last_clean":"2024-03-07T07:32:09.752346+0000","last_became_active":"2024-03-07T07:32:08.713142+0000","last_became_peered":"2024-03-07T07:32:08.713142+0000","last_unstale":"2024-03-07T07:32:09.752346+0000","last_undegraded":"2024-03-07T07:32:09.752346+0000","last_fullsized":"2024-03-07T07:32:09.752346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:23:53.633589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.704312+0000","last_change":"2024-03-07T07:32:08.704312+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.704312+0000","last_undegraded":"2024-03-07T07:32:08.704312+0000","last_fullsized":"2024-03-07T07:32:08.704312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.720791+0000","last_change":"2024-03-07T07:32:08.717609+0000","last_active":"2024-03-07T07:32:08.720791+0000","last_peered":"2024-03-07T07:32:08.720791+0000","last_clean":"2024-03-07T07:32:08.720791+0000","last_became_active":"2024-03-07T07:32:08.717250+0000","last_became_peered":"2024-03-07T07:32:08.717250+0000","last_unstale":"2024-03-07T07:32:08.720791+0000","last_undegraded":"2024-03-07T07:32:08.720791+0000","last_fullsized":"2024-03-07T07:32:08.720791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:54.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.754629+0000","last_change":"2024-03-07T07:32:09.747488+0000","last_active":"2024-03-07T07:32:09.754629+0000","last_peered":"2024-03-07T07:32:09.754629+0000","last_clean":"2024-03-07T07:32:09.754629+0000","last_became_active":"2024-03-07T07:32:09.747152+0000","last_became_peered":"2024-03-07T07:32:09.747152+0000","last_unstale":"2024-03-07T07:32:09.754629+0000","last_undegraded":"2024-03-07T07:32:09.754629+0000","last_fullsized":"2024-03-07T07:32:09.754629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:06:31.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.722307+0000","last_change":"2024-03-07T07:32:08.719257+0000","last_active":"2024-03-07T07:32:08.722307+0000","last_peered":"2024-03-07T07:32:08.722307+0000","last_clean":"2024-03-07T07:32:08.722307+0000","last_became_active":"2024-03-07T07:32:08.718947+0000","last_became_peered":"2024-03-07T07:32:08.718947+0000","last_unstale":"2024-03-07T07:32:08.722307+0000","last_undegraded":"2024-03-07T07:32:08.722307+0000","last_fullsized":"2024-03-07T07:32:08.722307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:07:22.327340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734268+0000","last_change":"2024-03-07T07:32:09.727647+0000","last_active":"2024-03-07T07:32:09.734268+0000","last_peered":"2024-03-07T07:32:09.734268+0000","last_clean":"2024-03-07T07:32:09.734268+0000","last_became_active":"2024-03-07T07:32:09.727415+0000","last_became_peered":"2024-03-07T07:32:09.727415+0000","last_unstale":"2024-03-07T07:32:09.734268+0000","last_undegraded":"2024-03-07T07:32:09.734268+0000","last_fullsized":"2024-03-07T07:32:09.734268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:10:50.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725248+0000","last_change":"2024-03-07T07:32:08.722227+0000","last_active":"2024-03-07T07:32:08.725248+0000","last_peered":"2024-03-07T07:32:08.725248+0000","last_clean":"2024-03-07T07:32:08.725248+0000","last_became_active":"2024-03-07T07:32:08.721547+0000","last_became_peered":"2024-03-07T07:32:08.721547+0000","last_unstale":"2024-03-07T07:32:08.725248+0000","last_undegraded":"2024-03-07T07:32:08.725248+0000","last_fullsized":"2024-03-07T07:32:08.725248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:25.671835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.738566+0000","last_change":"2024-03-07T07:32:09.728668+0000","last_active":"2024-03-07T07:32:09.738566+0000","last_peered":"2024-03-07T07:32:09.738566+0000","last_clean":"2024-03-07T07:32:09.738566+0000","last_became_active":"2024-03-07T07:32:09.728355+0000","last_became_peered":"2024-03-07T07:32:09.728355+0000","last_unstale":"2024-03-07T07:32:09.738566+0000","last_undegraded":"2024-03-07T07:32:09.738566+0000","last_fullsized":"2024-03-07T07:32:09.738566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:23:36.667810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.730135+0000","last_change":"2024-03-07T07:32:08.729034+0000","last_active":"2024-03-07T07:32:08.730135+0000","last_peered":"2024-03-07T07:32:08.730135+0000","last_clean":"2024-03-07T07:32:08.730135+0000","last_became_active":"2024-03-07T07:32:08.728745+0000","last_became_peered":"2024-03-07T07:32:08.728745+0000","last_unstale":"2024-03-07T07:32:08.730135+0000","last_undegraded":"2024-03-07T07:32:08.730135+0000","last_fullsized":"2024-03-07T07:32:08.730135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:11.184461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744006+0000","last_change":"2024-03-07T07:32:09.735410+0000","last_active":"2024-03-07T07:32:09.744006+0000","last_peered":"2024-03-07T07:32:09.744006+0000","last_clean":"2024-03-07T07:32:09.744006+0000","last_became_active":"2024-03-07T07:32:09.735140+0000","last_became_peered":"2024-03-07T07:32:09.735140+0000","last_unstale":"2024-03-07T07:32:09.744006+0000","last_undegraded":"2024-03-07T07:32:09.744006+0000","last_fullsized":"2024-03-07T07:32:09.744006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:35:37.916914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752220+0000","last_change":"2024-03-07T07:32:08.712845+0000","last_active":"2024-03-07T07:32:09.752220+0000","last_peered":"2024-03-07T07:32:09.752220+0000","last_clean":"2024-03-07T07:32:09.752220+0000","last_became_active":"2024-03-07T07:32:08.712543+0000","last_became_peered":"2024-03-07T07:32:08.712543+0000","last_unstale":"2024-03-07T07:32:09.752220+0000","last_undegraded":"2024-03-07T07:32:09.752220+0000","last_fullsized":"2024-03-07T07:32:09.752220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:43.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.709596+0000","last_change":"2024-03-07T07:32:08.709596+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.709596+0000","last_undegraded":"2024-03-07T07:32:08.709596+0000","last_fullsized":"2024-03-07T07:32:08.709596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.753504+0000","last_change":"2024-03-07T07:32:08.726767+0000","last_active":"2024-03-07T07:32:09.753504+0000","last_peered":"2024-03-07T07:32:09.753504+0000","last_clean":"2024-03-07T07:32:09.753504+0000","last_became_active":"2024-03-07T07:32:08.721780+0000","last_became_peered":"2024-03-07T07:32:08.721780+0000","last_unstale":"2024-03-07T07:32:09.753504+0000","last_undegraded":"2024-03-07T07:32:09.753504+0000","last_fullsized":"2024-03-07T07:32:09.753504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:57.931351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711741+0000","last_change":"2024-03-07T07:32:08.711741+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711741+0000","last_undegraded":"2024-03-07T07:32:08.711741+0000","last_fullsized":"2024-03-07T07:32:08.711741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.721236+0000","last_change":"2024-03-07T07:32:08.724075+0000","last_active":"2024-03-07T07:32:09.721236+0000","last_peered":"2024-03-07T07:32:09.721236+0000","last_clean":"2024-03-07T07:32:09.721236+0000","last_became_active":"2024-03-07T07:32:08.723816+0000","last_became_peered":"2024-03-07T07:32:08.723816+0000","last_unstale":"2024-03-07T07:32:09.721236+0000","last_undegraded":"2024-03-07T07:32:09.721236+0000","last_fullsized":"2024-03-07T07:32:09.721236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:57.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.710359+0000","last_change":"2024-03-07T07:32:08.710359+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.710359+0000","last_undegraded":"2024-03-07T07:32:08.710359+0000","last_fullsized":"2024-03-07T07:32:08.710359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.726274+0000","last_change":"2024-03-07T07:32:08.725250+0000","last_active":"2024-03-07T07:32:08.726274+0000","last_peered":"2024-03-07T07:32:08.726274+0000","last_clean":"2024-03-07T07:32:08.726274+0000","last_became_active":"2024-03-07T07:32:08.724952+0000","last_became_peered":"2024-03-07T07:32:08.724952+0000","last_unstale":"2024-03-07T07:32:08.726274+0000","last_undegraded":"2024-03-07T07:32:08.726274+0000","last_fullsized":"2024-03-07T07:32:08.726274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:14.784463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.717335+0000","last_change":"2024-03-07T07:32:08.717335+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.717335+0000","last_undegraded":"2024-03-07T07:32:08.717335+0000","last_fullsized":"2024-03-07T07:32:08.717335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.717693+0000","last_change":"2024-03-07T07:32:08.722811+0000","last_active":"2024-03-07T07:32:09.717693+0000","last_peered":"2024-03-07T07:32:09.717693+0000","last_clean":"2024-03-07T07:32:09.717693+0000","last_became_active":"2024-03-07T07:32:08.722388+0000","last_became_peered":"2024-03-07T07:32:08.722388+0000","last_unstale":"2024-03-07T07:32:09.717693+0000","last_undegraded":"2024-03-07T07:32:09.717693+0000","last_fullsized":"2024-03-07T07:32:09.717693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:09.210160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.708028+0000","last_change":"2024-03-07T07:32:08.708028+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.708028+0000","last_undegraded":"2024-03-07T07:32:08.708028+0000","last_fullsized":"2024-03-07T07:32:08.708028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.724976+0000","last_change":"2024-03-07T07:32:08.727283+0000","last_active":"2024-03-07T07:32:09.724976+0000","last_peered":"2024-03-07T07:32:09.724976+0000","last_clean":"2024-03-07T07:32:09.724976+0000","last_became_active":"2024-03-07T07:32:08.727012+0000","last_became_peered":"2024-03-07T07:32:08.727012+0000","last_unstale":"2024-03-07T07:32:09.724976+0000","last_undegraded":"2024-03-07T07:32:09.724976+0000","last_fullsized":"2024-03-07T07:32:09.724976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:11.184461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752754+0000","last_change":"2024-03-07T07:32:09.743462+0000","last_active":"2024-03-07T07:32:09.752754+0000","last_peered":"2024-03-07T07:32:09.752754+0000","last_clean":"2024-03-07T07:32:09.752754+0000","last_became_active":"2024-03-07T07:32:09.743094+0000","last_became_peered":"2024-03-07T07:32:09.743094+0000","last_unstale":"2024-03-07T07:32:09.752754+0000","last_undegraded":"2024-03-07T07:32:09.752754+0000","last_fullsized":"2024-03-07T07:32:09.752754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:24.575003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.715054+0000","last_change":"2024-03-07T07:32:08.723260+0000","last_active":"2024-03-07T07:32:09.715054+0000","last_peered":"2024-03-07T07:32:09.715054+0000","last_clean":"2024-03-07T07:32:09.715054+0000","last_became_active":"2024-03-07T07:32:08.723010+0000","last_became_peered":"2024-03-07T07:32:08.723010+0000","last_unstale":"2024-03-07T07:32:09.715054+0000","last_undegraded":"2024-03-07T07:32:09.715054+0000","last_fullsized":"2024-03-07T07:32:09.715054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:20.834267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711911+0000","last_change":"2024-03-07T07:32:08.711911+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711911+0000","last_undegraded":"2024-03-07T07:32:08.711911+0000","last_fullsized":"2024-03-07T07:32:08.711911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.725343+0000","last_change":"2024-03-07T07:32:08.723288+0000","last_active":"2024-03-07T07:32:08.725343+0000","last_peered":"2024-03-07T07:32:08.725343+0000","last_clean":"2024-03-07T07:32:08.725343+0000","last_became_active":"2024-03-07T07:32:08.723011+0000","last_became_peered":"2024-03-07T07:32:08.723011+0000","last_unstale":"2024-03-07T07:32:08.725343+0000","last_undegraded":"2024-03-07T07:32:08.725343+0000","last_fullsized":"2024-03-07T07:32:08.725343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:36:01.958659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734457+0000","last_change":"2024-03-07T07:32:09.732193+0000","last_active":"2024-03-07T07:32:09.734457+0000","last_peered":"2024-03-07T07:32:09.734457+0000","last_clean":"2024-03-07T07:32:09.734457+0000","last_became_active":"2024-03-07T07:32:09.731912+0000","last_became_peered":"2024-03-07T07:32:09.731912+0000","last_unstale":"2024-03-07T07:32:09.734457+0000","last_undegraded":"2024-03-07T07:32:09.734457+0000","last_fullsized":"2024-03-07T07:32:09.734457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:38:38.626228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.729975+0000","last_change":"2024-03-07T07:32:08.728905+0000","last_active":"2024-03-07T07:32:08.729975+0000","last_peered":"2024-03-07T07:32:08.729975+0000","last_clean":"2024-03-07T07:32:08.729975+0000","last_became_active":"2024-03-07T07:32:08.728584+0000","last_became_peered":"2024-03-07T07:32:08.728584+0000","last_unstale":"2024-03-07T07:32:08.729975+0000","last_undegraded":"2024-03-07T07:32:08.729975+0000","last_fullsized":"2024-03-07T07:32:08.729975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:26.993668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.711171+0000","last_change":"2024-03-07T07:32:08.711171+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.711171+0000","last_undegraded":"2024-03-07T07:32:08.711171+0000","last_fullsized":"2024-03-07T07:32:08.711171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.724600+0000","last_change":"2024-03-07T07:32:08.722707+0000","last_active":"2024-03-07T07:32:08.724600+0000","last_peered":"2024-03-07T07:32:08.724600+0000","last_clean":"2024-03-07T07:32:08.724600+0000","last_became_active":"2024-03-07T07:32:08.721788+0000","last_became_peered":"2024-03-07T07:32:08.721788+0000","last_unstale":"2024-03-07T07:32:08.724600+0000","last_undegraded":"2024-03-07T07:32:08.724600+0000","last_fullsized":"2024-03-07T07:32:08.724600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:55.611551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737253+0000","last_change":"2024-03-07T07:32:09.732507+0000","last_active":"2024-03-07T07:32:09.737253+0000","last_peered":"2024-03-07T07:32:09.737253+0000","last_clean":"2024-03-07T07:32:09.737253+0000","last_became_active":"2024-03-07T07:32:09.732228+0000","last_became_peered":"2024-03-07T07:32:09.732228+0000","last_unstale":"2024-03-07T07:32:09.737253+0000","last_undegraded":"2024-03-07T07:32:09.737253+0000","last_fullsized":"2024-03-07T07:32:09.737253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:04.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.727804+0000","last_change":"2024-03-07T07:32:08.723402+0000","last_active":"2024-03-07T07:32:08.727804+0000","last_peered":"2024-03-07T07:32:08.727804+0000","last_clean":"2024-03-07T07:32:08.727804+0000","last_became_active":"2024-03-07T07:32:08.722984+0000","last_became_peered":"2024-03-07T07:32:08.722984+0000","last_unstale":"2024-03-07T07:32:08.727804+0000","last_undegraded":"2024-03-07T07:32:08.727804+0000","last_fullsized":"2024-03-07T07:32:08.727804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:54.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.703006+0000","last_change":"2024-03-07T07:32:08.703006+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.703006+0000","last_undegraded":"2024-03-07T07:32:08.703006+0000","last_fullsized":"2024-03-07T07:32:08.703006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.723917+0000","last_change":"2024-03-07T07:32:08.721683+0000","last_active":"2024-03-07T07:32:08.723917+0000","last_peered":"2024-03-07T07:32:08.723917+0000","last_clean":"2024-03-07T07:32:08.723917+0000","last_became_active":"2024-03-07T07:32:08.721226+0000","last_became_peered":"2024-03-07T07:32:08.721226+0000","last_unstale":"2024-03-07T07:32:08.723917+0000","last_undegraded":"2024-03-07T07:32:08.723917+0000","last_fullsized":"2024-03-07T07:32:08.723917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:41:05.054365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-07T07:32:08.705139+0000","last_change":"2024-03-07T07:32:08.705139+0000","last_active":"2024-03-07T07:32:08.694693+0000","last_peered":"2024-03-07T07:32:08.694693+0000","last_clean":"2024-03-07T07:32:08.694693+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-07T07:32:08.705139+0000","last_undegraded":"2024-03-07T07:32:08.705139+0000","last_fullsized":"2024-03-07T07:32:08.705139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.719575+0000","last_change":"2024-03-07T07:32:08.714980+0000","last_active":"2024-03-07T07:32:09.719575+0000","last_peered":"2024-03-07T07:32:09.719575+0000","last_clean":"2024-03-07T07:32:09.719575+0000","last_became_active":"2024-03-07T07:32:08.714659+0000","last_became_peered":"2024-03-07T07:32:08.714659+0000","last_unstale":"2024-03-07T07:32:09.719575+0000","last_undegraded":"2024-03-07T07:32:09.719575+0000","last_fullsized":"2024-03-07T07:32:09.719575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:14.784463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734491+0000","last_change":"2024-03-07T07:32:09.732846+0000","last_active":"2024-03-07T07:32:09.734491+0000","last_peered":"2024-03-07T07:32:09.734491+0000","last_clean":"2024-03-07T07:32:09.734491+0000","last_became_active":"2024-03-07T07:32:09.731979+0000","last_became_peered":"2024-03-07T07:32:09.731979+0000","last_unstale":"2024-03-07T07:32:09.734491+0000","last_undegraded":"2024-03-07T07:32:09.734491+0000","last_fullsized":"2024-03-07T07:32:09.734491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:39:44.332839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-07T07:32:08.728312+0000","last_change":"2024-03-07T07:32:08.726960+0000","last_active":"2024-03-07T07:32:08.728312+0000","last_peered":"2024-03-07T07:32:08.728312+0000","last_clean":"2024-03-07T07:32:08.728312+0000","last_became_active":"2024-03-07T07:32:08.726686+0000","last_became_peered":"2024-03-07T07:32:08.726686+0000","last_unstale":"2024-03-07T07:32:08.728312+0000","last_undegraded":"2024-03-07T07:32:08.728312+0000","last_fullsized":"2024-03-07T07:32:08.728312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:34:30.228981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737233+0000","last_change":"2024-03-07T07:32:09.733315+0000","last_active":"2024-03-07T07:32:09.737233+0000","last_peered":"2024-03-07T07:32:09.737233+0000","last_clean":"2024-03-07T07:32:09.737233+0000","last_became_active":"2024-03-07T07:32:09.733052+0000","last_became_peered":"2024-03-07T07:32:09.733052+0000","last_unstale":"2024-03-07T07:32:09.737233+0000","last_undegraded":"2024-03-07T07:32:09.737233+0000","last_fullsized":"2024-03-07T07:32:09.737233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:06:31.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.716459+0000","last_change":"2024-03-07T07:32:08.721617+0000","last_active":"2024-03-07T07:32:09.716459+0000","last_peered":"2024-03-07T07:32:09.716459+0000","last_clean":"2024-03-07T07:32:09.716459+0000","last_became_active":"2024-03-07T07:32:08.721242+0000","last_became_peered":"2024-03-07T07:32:08.721242+0000","last_unstale":"2024-03-07T07:32:09.716459+0000","last_undegraded":"2024-03-07T07:32:09.716459+0000","last_fullsized":"2024-03-07T07:32:09.716459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:41:43.318106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.725441+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:32:09.725441+0000","last_peered":"2024-03-07T07:32:09.725441+0000","last_clean":"2024-03-07T07:32:09.725441+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:32:09.725441+0000","last_undegraded":"2024-03-07T07:32:09.725441+0000","last_fullsized":"2024-03-07T07:32:09.725441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":725008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":718733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:32:14.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-03-07T07:32:14.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.713513+0000', 'last_change': '2024-03-07T07:32:08.713513+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.713513+0000', 'last_undegraded': '2024-03-07T07:32:08.713513+0000', 'last_fullsized': '2024-03-07T07:32:08.713513+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:32:14.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-03-07T07:32:14.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.704337+0000', 'last_change': '2024-03-07T07:32:08.704337+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.704337+0000', 'last_undegraded': '2024-03-07T07:32:08.704337+0000', 'last_fullsized': '2024-03-07T07:32:08.704337+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.717859+0000', 'last_change': '2024-03-07T07:32:08.717859+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.717859+0000', 'last_undegraded': '2024-03-07T07:32:08.717859+0000', 'last_fullsized': '2024-03-07T07:32:08.717859+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.711383+0000', 'last_change': '2024-03-07T07:32:08.711383+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.711383+0000', 'last_undegraded': '2024-03-07T07:32:08.711383+0000', 'last_fullsized': '2024-03-07T07:32:08.711383+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.704847+0000', 'last_change': '2024-03-07T07:32:08.704847+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.704847+0000', 'last_undegraded': '2024-03-07T07:32:08.704847+0000', 'last_fullsized': '2024-03-07T07:32:08.704847+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.707637+0000', 'last_change': '2024-03-07T07:32:08.707637+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.707637+0000', 'last_undegraded': '2024-03-07T07:32:08.707637+0000', 'last_fullsized': '2024-03-07T07:32:08.707637+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.703686+0000', 'last_change': '2024-03-07T07:32:08.703686+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.703686+0000', 'last_undegraded': '2024-03-07T07:32:08.703686+0000', 'last_fullsized': '2024-03-07T07:32:08.703686+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-03-07T07:32:14.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.712395+0000', 'last_change': '2024-03-07T07:32:08.712395+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.712395+0000', 'last_undegraded': '2024-03-07T07:32:08.712395+0000', 'last_fullsized': '2024-03-07T07:32:08.712395+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.712198+0000', 'last_change': '2024-03-07T07:32:08.712198+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.712198+0000', 'last_undegraded': '2024-03-07T07:32:08.712198+0000', 'last_fullsized': '2024-03-07T07:32:08.712198+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.708270+0000', 'last_change': '2024-03-07T07:32:08.708270+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.708270+0000', 'last_undegraded': '2024-03-07T07:32:08.708270+0000', 'last_fullsized': '2024-03-07T07:32:08.708270+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.707282+0000', 'last_change': '2024-03-07T07:32:08.707282+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.707282+0000', 'last_undegraded': '2024-03-07T07:32:08.707282+0000', 'last_fullsized': '2024-03-07T07:32:08.707282+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.705258+0000', 'last_change': '2024-03-07T07:32:08.705258+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.705258+0000', 'last_undegraded': '2024-03-07T07:32:08.705258+0000', 'last_fullsized': '2024-03-07T07:32:08.705258+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.704237+0000', 'last_change': '2024-03-07T07:32:08.704237+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.704237+0000', 'last_undegraded': '2024-03-07T07:32:08.704237+0000', 'last_fullsized': '2024-03-07T07:32:08.704237+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-03-07T07:32:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.710970+0000', 'last_change': '2024-03-07T07:32:08.710970+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.710970+0000', 'last_undegraded': '2024-03-07T07:32:08.710970+0000', 'last_fullsized': '2024-03-07T07:32:08.710970+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.708705+0000', 'last_change': '2024-03-07T07:32:08.708705+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.708705+0000', 'last_undegraded': '2024-03-07T07:32:08.708705+0000', 'last_fullsized': '2024-03-07T07:32:08.708705+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.705484+0000', 'last_change': '2024-03-07T07:32:08.705484+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.705484+0000', 'last_undegraded': '2024-03-07T07:32:08.705484+0000', 'last_fullsized': '2024-03-07T07:32:08.705484+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.703677+0000', 'last_change': '2024-03-07T07:32:08.703677+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.703677+0000', 'last_undegraded': '2024-03-07T07:32:08.703677+0000', 'last_fullsized': '2024-03-07T07:32:08.703677+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.704721+0000', 'last_change': '2024-03-07T07:32:08.704721+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.704721+0000', 'last_undegraded': '2024-03-07T07:32:08.704721+0000', 'last_fullsized': '2024-03-07T07:32:08.704721+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-03-07T07:32:14.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.703557+0000', 'last_change': '2024-03-07T07:32:08.703557+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.703557+0000', 'last_undegraded': '2024-03-07T07:32:08.703557+0000', 'last_fullsized': '2024-03-07T07:32:08.703557+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.710818+0000', 'last_change': '2024-03-07T07:32:08.710818+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.710818+0000', 'last_undegraded': '2024-03-07T07:32:08.710818+0000', 'last_fullsized': '2024-03-07T07:32:08.710818+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.704312+0000', 'last_change': '2024-03-07T07:32:08.704312+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.704312+0000', 'last_undegraded': '2024-03-07T07:32:08.704312+0000', 'last_fullsized': '2024-03-07T07:32:08.704312+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.709596+0000', 'last_change': '2024-03-07T07:32:08.709596+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.709596+0000', 'last_undegraded': '2024-03-07T07:32:08.709596+0000', 'last_fullsized': '2024-03-07T07:32:08.709596+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.711741+0000', 'last_change': '2024-03-07T07:32:08.711741+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.711741+0000', 'last_undegraded': '2024-03-07T07:32:08.711741+0000', 'last_fullsized': '2024-03-07T07:32:08.711741+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.710359+0000', 'last_change': '2024-03-07T07:32:08.710359+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.710359+0000', 'last_undegraded': '2024-03-07T07:32:08.710359+0000', 'last_fullsized': '2024-03-07T07:32:08.710359+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-03-07T07:32:14.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.717335+0000', 'last_change': '2024-03-07T07:32:08.717335+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.717335+0000', 'last_undegraded': '2024-03-07T07:32:08.717335+0000', 'last_fullsized': '2024-03-07T07:32:08.717335+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.708028+0000', 'last_change': '2024-03-07T07:32:08.708028+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.708028+0000', 'last_undegraded': '2024-03-07T07:32:08.708028+0000', 'last_fullsized': '2024-03-07T07:32:08.708028+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.711911+0000', 'last_change': '2024-03-07T07:32:08.711911+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.711911+0000', 'last_undegraded': '2024-03-07T07:32:08.711911+0000', 'last_fullsized': '2024-03-07T07:32:08.711911+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.711171+0000', 'last_change': '2024-03-07T07:32:08.711171+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.711171+0000', 'last_undegraded': '2024-03-07T07:32:08.711171+0000', 'last_fullsized': '2024-03-07T07:32:08.711171+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.703006+0000', 'last_change': '2024-03-07T07:32:08.703006+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.703006+0000', 'last_undegraded': '2024-03-07T07:32:08.703006+0000', 'last_fullsized': '2024-03-07T07:32:08.703006+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-03-07T07:32:14.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-07T07:32:08.705139+0000', 'last_change': '2024-03-07T07:32:08.705139+0000', 'last_active': '2024-03-07T07:32:08.694693+0000', 'last_peered': '2024-03-07T07:32:08.694693+0000', 'last_clean': '2024-03-07T07:32:08.694693+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-07T07:32:08.705139+0000', 'last_undegraded': '2024-03-07T07:32:08.705139+0000', 'last_fullsized': '2024-03-07T07:32:08.705139+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'last_clean_scrub_stamp': '2024-03-07T07:32:08.694693+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-07T07:32:14.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-07T07:32:14.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.797+0000 7f07d9800640 1 Processor -- start 2024-03-07T07:32:14.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.797+0000 7f07d9800640 1 -- start start 2024-03-07T07:32:14.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.797+0000 7f07d9800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07d4143dd0 0x7f07d40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.797+0000 7f07d9800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4144360 0x7f07d40729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d9800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d40cc880 con 0x7f07d41448b0 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d9800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d41441b0 con 0x7f07d4143dd0 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d9800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40cf050 con 0x7f07d4144360 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d2a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07d4143dd0 0x7f07d40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d3400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f07d41448b0 0x7f07d415b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56800/0 (socket says 172.21.15.84:56800) 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d3400640 1 -- 172.21.15.84:0/1909155510 learned_addr learned my addr 172.21.15.84:0/1909155510 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07cbe00640 1 --2- 172.21.15.84:0/1909155510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4144360 0x7f07d40729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d2a00640 1 -- 172.21.15.84:0/1909155510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4144360 msgr2=0x7f07d40729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d2a00640 1 --2- 172.21.15.84:0/1909155510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4144360 0x7f07d40729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d2a00640 1 -- 172.21.15.84:0/1909155510 >> v1:172.21.15.84:6789/0 conn(0x7f07d41448b0 legacy=0x7f07d415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d2a00640 1 -- 172.21.15.84:0/1909155510 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40ccb60 con 0x7f07d4143dd0 2024-03-07T07:32:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07cbe00640 1 --2- 172.21.15.84:0/1909155510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4144360 0x7f07d40729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d2000640 1 -- 172.21.15.84:0/1909155510 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98661219 0 0) 0x7f07d40cc880 con 0x7f07d41448b0 2024-03-07T07:32:14.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d2a00640 1 --2- 172.21.15.84:0/1909155510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4143dd0 0x7f07d40cdc00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07c40097f0 tx=0x7f07c401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60724bd45e165c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.801+0000 7f07d2000640 1 -- 172.21.15.84:0/1909155510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c40aa5f0 con 0x7f07d4143dd0 2024-03-07T07:32:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d2000640 1 -- 172.21.15.84:0/1909155510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c40af070 con 0x7f07d4143dd0 2024-03-07T07:32:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d2000640 1 -- 172.21.15.84:0/1909155510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c40aa9b0 con 0x7f07d4143dd0 2024-03-07T07:32:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- 172.21.15.84:0/1909155510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4143dd0 msgr2=0x7f07d40cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 --2- 172.21.15.84:0/1909155510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4143dd0 0x7f07d40cdc00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07c40097f0 tx=0x7f07c401c470 comp rx=0 tx=0).stop 2024-03-07T07:32:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- 172.21.15.84:0/1909155510 shutdown_connections 2024-03-07T07:32:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 --2- 172.21.15.84:0/1909155510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4144360 0x7f07d40729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 --2- 172.21.15.84:0/1909155510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4143dd0 0x7f07d40cdc00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- 172.21.15.84:0/1909155510 >> 172.21.15.84:0/1909155510 conn(0x7f07d40704b0 msgr2=0x7f07d40708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- 172.21.15.84:0/1909155510 shutdown_connections 2024-03-07T07:32:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- 172.21.15.84:0/1909155510 wait complete. 2024-03-07T07:32:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 Processor -- start 2024-03-07T07:32:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- start start 2024-03-07T07:32:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4143dd0 0x7f07d41fa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4144360 0x7f07d41417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d41448b0 0x7f07d413c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40cd6e0 con 0x7f07d4144360 2024-03-07T07:32:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d4073320 con 0x7f07d41448b0 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07d9800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d415bf30 con 0x7f07d4143dd0 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4144360 0x7f07d41417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4144360 0x7f07d41417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44612/0 (socket says 172.21.15.84:44612) 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.805+0000 7f07cbe00640 1 -- 172.21.15.84:0/3742553621 learned_addr learned my addr 172.21.15.84:0/3742553621 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07d2a00640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4143dd0 0x7f07d41fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07d3400640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d41448b0 0x7f07d413c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07cbe00640 1 -- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4143dd0 msgr2=0x7f07d41fa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07cbe00640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4143dd0 0x7f07d41fa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07cbe00640 1 -- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d41448b0 msgr2=0x7f07d413c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07cbe00640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d41448b0 0x7f07d413c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07cbe00640 1 -- 172.21.15.84:0/3742553621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d4141d20 con 0x7f07d4144360 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07d2a00640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4143dd0 0x7f07d41fa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:14.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07d3400640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d41448b0 0x7f07d413c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:14.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07cbe00640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4144360 0x7f07d41417e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00e810 tx=0x7f07bc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07caa00640 1 -- 172.21.15.84:0/3742553621 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc017070 con 0x7f07d4144360 2024-03-07T07:32:14.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07caa00640 1 -- 172.21.15.84:0/3742553621 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc00c8d0 con 0x7f07d4144360 2024-03-07T07:32:14.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07caa00640 1 -- 172.21.15.84:0/3742553621 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00f040 con 0x7f07d4144360 2024-03-07T07:32:14.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d40c30c0 con 0x7f07d4144360 2024-03-07T07:32:14.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d40c3680 con 0x7f07d4144360 2024-03-07T07:32:14.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d4062d40 con 0x7f07d4144360 2024-03-07T07:32:14.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.809+0000 7f07caa00640 1 -- 172.21.15.84:0/3742553621 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f07bc01a070 con 0x7f07d4144360 2024-03-07T07:32:14.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.813+0000 7f07caa00640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f90 0x7f07b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:14.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.813+0000 7f07caa00640 1 -- 172.21.15.84:0/3742553621 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07bc0850d0 con 0x7f07d4144360 2024-03-07T07:32:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.813+0000 7f07d2a00640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f90 0x7f07b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:14.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.813+0000 7f07d2a00640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f90 0x7f07b0069450 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f07c40ae000 tx=0x7f07c40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:14.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:14.813+0000 7f07caa00640 1 -- 172.21.15.84:0/3742553621 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f07bc0560c0 con 0x7f07d4144360 2024-03-07T07:32:15.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.025+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f07d415b1f0 con 0x7f07d4144360 2024-03-07T07:32:15.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07caa00640 1 -- 172.21.15.84:0/3742553621 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1646 (secure 0 0 0) 0x7f07bc0559c0 con 0x7f07d4144360 2024-03-07T07:32:15.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:15.029 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":87,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1709796659,"num_in_osds":8,"osd_in_since":1709796650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":67},{"state_name":"creating+peering","count":30}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":591144,"bytes_used":225337344,"bytes_avail":772868775936,"bytes_total":773094113280,"inactive_pgs_ratio":0.30927833914756775,"write_bytes_sec":1970,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4995}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-03-07T07:32:00.889210+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-07T07:32:15.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f90 msgr2=0x7f07b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:15.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f90 0x7f07b0069450 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f07c40ae000 tx=0x7f07c40a7000 comp rx=0 tx=0).stop 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4144360 msgr2=0x7f07d41417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4144360 0x7f07d41417e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00e810 tx=0x7f07bc00ecd0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 shutdown_connections 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f90 0x7f07b0069450 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d41448b0 0x7f07d413c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d4144360 0x7f07d41417e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 --2- 172.21.15.84:0/3742553621 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d4143dd0 0x7f07d41fa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 >> 172.21.15.84:0/3742553621 conn(0x7f07d40704b0 msgr2=0x7f07d413d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 shutdown_connections 2024-03-07T07:32:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.029+0000 7f07d9800640 1 -- 172.21.15.84:0/3742553621 wait complete. 2024-03-07T07:32:15.050 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-07T07:32:15.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:32:15.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc7200640 1 Processor -- start 2024-03-07T07:32:15.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc7200640 1 -- start start 2024-03-07T07:32:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc7200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1bc015bdc0 0x7f1bc006ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc7200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 0x7f1bc006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc7200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1bc00aa660 0x7f1bc00aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc7200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc015ca80 con 0x7f1bc015bdc0 2024-03-07T07:32:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc7200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc015c1a0 con 0x7f1bc00aa660 2024-03-07T07:32:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc7200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00ab240 con 0x7f1bc015cf10 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1bc015bdc0 0x7f1bc006ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1bc015bdc0 0x7f1bc006ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44628/0 (socket says 172.21.15.84:44628) 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5e00640 1 -- 172.21.15.84:0/464013899 learned_addr learned my addr 172.21.15.84:0/464013899 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5400640 1 --2- 172.21.15.84:0/464013899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 0x7f1bc006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc6800640 1 --2- 172.21.15.84:0/464013899 >> v2:172.21.15.161:3300/0 conn(0x7f1bc00aa660 0x7f1bc00aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5e00640 1 -- 172.21.15.84:0/464013899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 msgr2=0x7f1bc006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5e00640 1 --2- 172.21.15.84:0/464013899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 0x7f1bc006bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5e00640 1 -- 172.21.15.84:0/464013899 >> v2:172.21.15.161:3300/0 conn(0x7f1bc00aa660 msgr2=0x7f1bc00aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5e00640 1 --2- 172.21.15.84:0/464013899 >> v2:172.21.15.161:3300/0 conn(0x7f1bc00aa660 0x7f1bc00aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc5e00640 1 -- 172.21.15.84:0/464013899 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc015c430 con 0x7f1bc015bdc0 2024-03-07T07:32:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.185+0000 7f1bc6800640 1 --2- 172.21.15.84:0/464013899 >> v2:172.21.15.161:3300/0 conn(0x7f1bc00aa660 0x7f1bc00aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc5e00640 1 --2- 172.21.15.84:0/464013899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc006ba70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00d09b0 tx=0x7f1bb401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f477fd5013d037 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc4a00640 1 -- 172.21.15.84:0/464013899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40b0070 con 0x7f1bc015bdc0 2024-03-07T07:32:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc4a00640 1 -- 172.21.15.84:0/464013899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb40ab600 con 0x7f1bc015bdc0 2024-03-07T07:32:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc4a00640 1 -- 172.21.15.84:0/464013899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40ab9d0 con 0x7f1bc015bdc0 2024-03-07T07:32:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 -- 172.21.15.84:0/464013899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 msgr2=0x7f1bc006ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 --2- 172.21.15.84:0/464013899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc006ba70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00d09b0 tx=0x7f1bb401c520 comp rx=0 tx=0).stop 2024-03-07T07:32:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 -- 172.21.15.84:0/464013899 shutdown_connections 2024-03-07T07:32:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 --2- 172.21.15.84:0/464013899 >> v2:172.21.15.161:3300/0 conn(0x7f1bc00aa660 0x7f1bc00aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 --2- 172.21.15.84:0/464013899 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 0x7f1bc006bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 --2- 172.21.15.84:0/464013899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc006ba70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 -- 172.21.15.84:0/464013899 >> 172.21.15.84:0/464013899 conn(0x7f1bc006f2b0 msgr2=0x7f1bc006f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 -- 172.21.15.84:0/464013899 shutdown_connections 2024-03-07T07:32:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.189+0000 7f1bc7200640 1 -- 172.21.15.84:0/464013899 wait complete. 2024-03-07T07:32:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 Processor -- start 2024-03-07T07:32:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 -- start start 2024-03-07T07:32:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc00aa660 0x7f1bc0159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc0140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 0x7f1bc01f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00a9fe0 con 0x7f1bc015bdc0 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00a9e60 con 0x7f1bc00aa660 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00aa160 con 0x7f1bc015cf10 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc0140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc0140590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44634/0 (socket says 172.21.15.84:44634) 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc00aa660 0x7f1bc0159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 -- 172.21.15.84:0/168350052 learned_addr learned my addr 172.21.15.84:0/168350052 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc6800640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 0x7f1bc01f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 -- 172.21.15.84:0/168350052 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 msgr2=0x7f1bc01f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 0x7f1bc01f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 -- 172.21.15.84:0/168350052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc00aa660 msgr2=0x7f1bc0159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc00aa660 0x7f1bc0159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 -- 172.21.15.84:0/168350052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0156ca0 con 0x7f1bc015bdc0 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc5400640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc0140590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000e840 tx=0x7f1bb000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bba000640 1 -- 172.21.15.84:0/168350052 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0017070 con 0x7f1bc015bdc0 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bba000640 1 -- 172.21.15.84:0/168350052 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb000ee90 con 0x7f1bc015bdc0 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bba000640 1 -- 172.21.15.84:0/168350052 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000cb60 con 0x7f1bc015bdc0 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc0157230 con 0x7f1bc015bdc0 2024-03-07T07:32:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc01577f0 con 0x7f1bc015bdc0 2024-03-07T07:32:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.193+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc0062d40 con 0x7f1bc015bdc0 2024-03-07T07:32:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.197+0000 7f1bba000640 1 -- 172.21.15.84:0/168350052 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f1bb001a070 con 0x7f1bc015bdc0 2024-03-07T07:32:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.197+0000 7f1bba000640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ba4066f60 0x7f1ba4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.197+0000 7f1bba000640 1 -- 172.21.15.84:0/168350052 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bb0084dc0 con 0x7f1bc015bdc0 2024-03-07T07:32:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.197+0000 7f1bc5e00640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ba4066f60 0x7f1ba4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.197+0000 7f1bc5e00640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ba4066f60 0x7f1ba4069420 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ad000 tx=0x7f1bb40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:15.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.201+0000 7f1bba000640 1 -- 172.21.15.84:0/168350052 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f1bb0055780 con 0x7f1bc015bdc0 2024-03-07T07:32:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.353+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bc00b1cd0 con 0x7f1ba4066f60 2024-03-07T07:32:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.361+0000 7f1bba000640 1 -- 172.21.15.84:0/168350052 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251919 (secure 0 0 0) 0x7f1bc00b1cd0 con 0x7f1ba4066f60 2024-03-07T07:32:15.366 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ba4066f60 msgr2=0x7f1ba4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ba4066f60 0x7f1ba4069420 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ad000 tx=0x7f1bb40a6000 comp rx=0 tx=0).stop 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 msgr2=0x7f1bc0140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc0140590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000e840 tx=0x7f1bb000ec40 comp rx=0 tx=0).stop 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 shutdown_connections 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f1ba4066f60 0x7f1ba4069420 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1bc015cf10 0x7f1bc01f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc015bdc0 0x7f1bc0140590 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 --2- 172.21.15.84:0/168350052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc00aa660 0x7f1bc0159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 >> 172.21.15.84:0/168350052 conn(0x7f1bc006f2b0 msgr2=0x7f1bc015ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 shutdown_connections 2024-03-07T07:32:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:15.365+0000 7f1bc7200640 1 -- 172.21.15.84:0/168350052 wait complete. 2024-03-07T07:32:15.386 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-07T07:32:14.891113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220252,"kb_used_data":4060,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754468,"statfs":{"total":773094113280,"available":772868575232,"internally_reserved":0,"allocated":4157440,"data_stored":2320871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.192029"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734464+0000","last_change":"2024-03-07T07:32:09.730012+0000","last_active":"2024-03-07T07:32:09.734464+0000","last_peered":"2024-03-07T07:32:09.734464+0000","last_clean":"2024-03-07T07:32:09.734464+0000","last_became_active":"2024-03-07T07:32:09.729740+0000","last_became_peered":"2024-03-07T07:32:09.729740+0000","last_unstale":"2024-03-07T07:32:09.734464+0000","last_undegraded":"2024-03-07T07:32:09.734464+0000","last_fullsized":"2024-03-07T07:32:09.734464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:27.999230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738205+0000","last_change":"2024-03-07T07:32:09.751991+0000","last_active":"2024-03-07T07:32:10.738205+0000","last_peered":"2024-03-07T07:32:10.738205+0000","last_clean":"2024-03-07T07:32:10.738205+0000","last_became_active":"2024-03-07T07:32:09.751560+0000","last_became_peered":"2024-03-07T07:32:09.751560+0000","last_unstale":"2024-03-07T07:32:10.738205+0000","last_undegraded":"2024-03-07T07:32:10.738205+0000","last_fullsized":"2024-03-07T07:32:10.738205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:18.598342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.748155+0000","last_change":"2024-03-07T07:32:09.741223+0000","last_active":"2024-03-07T07:32:09.748155+0000","last_peered":"2024-03-07T07:32:09.748155+0000","last_clean":"2024-03-07T07:32:09.748155+0000","last_became_active":"2024-03-07T07:32:09.740812+0000","last_became_peered":"2024-03-07T07:32:09.740812+0000","last_unstale":"2024-03-07T07:32:09.748155+0000","last_undegraded":"2024-03-07T07:32:09.748155+0000","last_fullsized":"2024-03-07T07:32:09.748155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:11:31.178552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720842+0000","last_change":"2024-03-07T07:32:09.731679+0000","last_active":"2024-03-07T07:32:10.720842+0000","last_peered":"2024-03-07T07:32:10.720842+0000","last_clean":"2024-03-07T07:32:10.720842+0000","last_became_active":"2024-03-07T07:32:09.730404+0000","last_became_peered":"2024-03-07T07:32:09.730404+0000","last_unstale":"2024-03-07T07:32:10.720842+0000","last_undegraded":"2024-03-07T07:32:10.720842+0000","last_fullsized":"2024-03-07T07:32:10.720842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:46.835153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.737860+0000","last_change":"2024-03-07T07:32:09.738081+0000","last_active":"2024-03-07T07:32:10.737860+0000","last_peered":"2024-03-07T07:32:10.737860+0000","last_clean":"2024-03-07T07:32:10.737860+0000","last_became_active":"2024-03-07T07:32:09.737682+0000","last_became_peered":"2024-03-07T07:32:09.737682+0000","last_unstale":"2024-03-07T07:32:10.737860+0000","last_undegraded":"2024-03-07T07:32:10.737860+0000","last_fullsized":"2024-03-07T07:32:10.737860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:53:15.103011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741030+0000","last_change":"2024-03-07T07:32:09.736939+0000","last_active":"2024-03-07T07:32:10.741030+0000","last_peered":"2024-03-07T07:32:10.741030+0000","last_clean":"2024-03-07T07:32:10.741030+0000","last_became_active":"2024-03-07T07:32:09.736639+0000","last_became_peered":"2024-03-07T07:32:09.736639+0000","last_unstale":"2024-03-07T07:32:10.741030+0000","last_undegraded":"2024-03-07T07:32:10.741030+0000","last_fullsized":"2024-03-07T07:32:10.741030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:15.790026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.750652+0000","last_change":"2024-03-07T07:32:09.745334+0000","last_active":"2024-03-07T07:32:09.750652+0000","last_peered":"2024-03-07T07:32:09.750652+0000","last_clean":"2024-03-07T07:32:09.750652+0000","last_became_active":"2024-03-07T07:32:09.745084+0000","last_became_peered":"2024-03-07T07:32:09.745084+0000","last_unstale":"2024-03-07T07:32:09.750652+0000","last_undegraded":"2024-03-07T07:32:09.750652+0000","last_fullsized":"2024-03-07T07:32:09.750652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:12:19.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744785+0000","last_change":"2024-03-07T07:32:09.736538+0000","last_active":"2024-03-07T07:32:09.744785+0000","last_peered":"2024-03-07T07:32:09.744785+0000","last_clean":"2024-03-07T07:32:09.744785+0000","last_became_active":"2024-03-07T07:32:09.736186+0000","last_became_peered":"2024-03-07T07:32:09.736186+0000","last_unstale":"2024-03-07T07:32:09.744785+0000","last_undegraded":"2024-03-07T07:32:09.744785+0000","last_fullsized":"2024-03-07T07:32:09.744785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:18.860889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752779+0000","last_change":"2024-03-07T07:32:09.744105+0000","last_active":"2024-03-07T07:32:09.752779+0000","last_peered":"2024-03-07T07:32:09.752779+0000","last_clean":"2024-03-07T07:32:09.752779+0000","last_became_active":"2024-03-07T07:32:09.743854+0000","last_became_peered":"2024-03-07T07:32:09.743854+0000","last_unstale":"2024-03-07T07:32:09.752779+0000","last_undegraded":"2024-03-07T07:32:09.752779+0000","last_fullsized":"2024-03-07T07:32:09.752779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:10.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720705+0000","last_change":"2024-03-07T07:32:09.741258+0000","last_active":"2024-03-07T07:32:10.720705+0000","last_peered":"2024-03-07T07:32:10.720705+0000","last_clean":"2024-03-07T07:32:10.720705+0000","last_became_active":"2024-03-07T07:32:09.740973+0000","last_became_peered":"2024-03-07T07:32:09.740973+0000","last_unstale":"2024-03-07T07:32:10.720705+0000","last_undegraded":"2024-03-07T07:32:10.720705+0000","last_fullsized":"2024-03-07T07:32:10.720705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:42:04.100114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734362+0000","last_change":"2024-03-07T07:32:09.729434+0000","last_active":"2024-03-07T07:32:09.734362+0000","last_peered":"2024-03-07T07:32:09.734362+0000","last_clean":"2024-03-07T07:32:09.734362+0000","last_became_active":"2024-03-07T07:32:09.728932+0000","last_became_peered":"2024-03-07T07:32:09.728932+0000","last_unstale":"2024-03-07T07:32:09.734362+0000","last_undegraded":"2024-03-07T07:32:09.734362+0000","last_fullsized":"2024-03-07T07:32:09.734362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:26:25.930786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752687+0000","last_change":"2024-03-07T07:32:09.742631+0000","last_active":"2024-03-07T07:32:09.752687+0000","last_peered":"2024-03-07T07:32:09.752687+0000","last_clean":"2024-03-07T07:32:09.752687+0000","last_became_active":"2024-03-07T07:32:09.740785+0000","last_became_peered":"2024-03-07T07:32:09.740785+0000","last_unstale":"2024-03-07T07:32:09.752687+0000","last_undegraded":"2024-03-07T07:32:09.752687+0000","last_fullsized":"2024-03-07T07:32:09.752687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:06.625131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954828+0000","last_change":"2024-03-07T07:32:09.735005+0000","last_active":"2024-03-07T07:32:10.954828+0000","last_peered":"2024-03-07T07:32:10.954828+0000","last_clean":"2024-03-07T07:32:10.954828+0000","last_became_active":"2024-03-07T07:32:09.734422+0000","last_became_peered":"2024-03-07T07:32:09.734422+0000","last_unstale":"2024-03-07T07:32:10.954828+0000","last_undegraded":"2024-03-07T07:32:10.954828+0000","last_fullsized":"2024-03-07T07:32:10.954828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:28:50.769300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720794+0000","last_change":"2024-03-07T07:32:09.741208+0000","last_active":"2024-03-07T07:32:10.720794+0000","last_peered":"2024-03-07T07:32:10.720794+0000","last_clean":"2024-03-07T07:32:10.720794+0000","last_became_active":"2024-03-07T07:32:09.740919+0000","last_became_peered":"2024-03-07T07:32:09.740919+0000","last_unstale":"2024-03-07T07:32:10.720794+0000","last_undegraded":"2024-03-07T07:32:10.720794+0000","last_fullsized":"2024-03-07T07:32:10.720794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:40:21.118189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.735720+0000","last_change":"2024-03-07T07:32:09.727701+0000","last_active":"2024-03-07T07:32:09.735720+0000","last_peered":"2024-03-07T07:32:09.735720+0000","last_clean":"2024-03-07T07:32:09.735720+0000","last_became_active":"2024-03-07T07:32:09.727424+0000","last_became_peered":"2024-03-07T07:32:09.727424+0000","last_unstale":"2024-03-07T07:32:09.735720+0000","last_undegraded":"2024-03-07T07:32:09.735720+0000","last_fullsized":"2024-03-07T07:32:09.735720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:15.863540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.740620+0000","last_change":"2024-03-07T07:32:09.732094+0000","last_active":"2024-03-07T07:32:09.740620+0000","last_peered":"2024-03-07T07:32:09.740620+0000","last_clean":"2024-03-07T07:32:09.740620+0000","last_became_active":"2024-03-07T07:32:09.731685+0000","last_became_peered":"2024-03-07T07:32:09.731685+0000","last_unstale":"2024-03-07T07:32:09.740620+0000","last_undegraded":"2024-03-07T07:32:09.740620+0000","last_fullsized":"2024-03-07T07:32:09.740620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:57.484266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737685+0000","last_change":"2024-03-07T07:32:09.733381+0000","last_active":"2024-03-07T07:32:09.737685+0000","last_peered":"2024-03-07T07:32:09.737685+0000","last_clean":"2024-03-07T07:32:09.737685+0000","last_became_active":"2024-03-07T07:32:09.733061+0000","last_became_peered":"2024-03-07T07:32:09.733061+0000","last_unstale":"2024-03-07T07:32:09.737685+0000","last_undegraded":"2024-03-07T07:32:09.737685+0000","last_fullsized":"2024-03-07T07:32:09.737685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:41:20.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741422+0000","last_change":"2024-03-07T07:32:09.737756+0000","last_active":"2024-03-07T07:32:10.741422+0000","last_peered":"2024-03-07T07:32:10.741422+0000","last_clean":"2024-03-07T07:32:10.741422+0000","last_became_active":"2024-03-07T07:32:09.737480+0000","last_became_peered":"2024-03-07T07:32:09.737480+0000","last_unstale":"2024-03-07T07:32:10.741422+0000","last_undegraded":"2024-03-07T07:32:10.741422+0000","last_fullsized":"2024-03-07T07:32:10.741422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:44:21.013212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741300+0000","last_change":"2024-03-07T07:32:09.748535+0000","last_active":"2024-03-07T07:32:10.741300+0000","last_peered":"2024-03-07T07:32:10.741300+0000","last_clean":"2024-03-07T07:32:10.741300+0000","last_became_active":"2024-03-07T07:32:09.748275+0000","last_became_peered":"2024-03-07T07:32:09.748275+0000","last_unstale":"2024-03-07T07:32:10.741300+0000","last_undegraded":"2024-03-07T07:32:10.741300+0000","last_fullsized":"2024-03-07T07:32:10.741300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:47.428345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954828+0000","last_change":"2024-03-07T07:32:09.737919+0000","last_active":"2024-03-07T07:32:10.954828+0000","last_peered":"2024-03-07T07:32:10.954828+0000","last_clean":"2024-03-07T07:32:10.954828+0000","last_became_active":"2024-03-07T07:32:09.737568+0000","last_became_peered":"2024-03-07T07:32:09.737568+0000","last_unstale":"2024-03-07T07:32:10.954828+0000","last_undegraded":"2024-03-07T07:32:10.954828+0000","last_fullsized":"2024-03-07T07:32:10.954828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:13:20.079214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737291+0000","last_change":"2024-03-07T07:32:09.733151+0000","last_active":"2024-03-07T07:32:09.737291+0000","last_peered":"2024-03-07T07:32:09.737291+0000","last_clean":"2024-03-07T07:32:09.737291+0000","last_became_active":"2024-03-07T07:32:09.732916+0000","last_became_peered":"2024-03-07T07:32:09.732916+0000","last_unstale":"2024-03-07T07:32:09.737291+0000","last_undegraded":"2024-03-07T07:32:09.737291+0000","last_fullsized":"2024-03-07T07:32:09.737291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:12:19.645585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734352+0000","last_change":"2024-03-07T07:32:09.729634+0000","last_active":"2024-03-07T07:32:09.734352+0000","last_peered":"2024-03-07T07:32:09.734352+0000","last_clean":"2024-03-07T07:32:09.734352+0000","last_became_active":"2024-03-07T07:32:09.729365+0000","last_became_peered":"2024-03-07T07:32:09.729365+0000","last_unstale":"2024-03-07T07:32:09.734352+0000","last_undegraded":"2024-03-07T07:32:09.734352+0000","last_fullsized":"2024-03-07T07:32:09.734352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:47.428345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954563+0000","last_change":"2024-03-07T07:32:09.749518+0000","last_active":"2024-03-07T07:32:10.954563+0000","last_peered":"2024-03-07T07:32:10.954563+0000","last_clean":"2024-03-07T07:32:10.954563+0000","last_became_active":"2024-03-07T07:32:09.749193+0000","last_became_peered":"2024-03-07T07:32:09.749193+0000","last_unstale":"2024-03-07T07:32:10.954563+0000","last_undegraded":"2024-03-07T07:32:10.954563+0000","last_fullsized":"2024-03-07T07:32:10.954563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:43:57.558786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.748885+0000","last_change":"2024-03-07T07:32:09.743716+0000","last_active":"2024-03-07T07:32:09.748885+0000","last_peered":"2024-03-07T07:32:09.748885+0000","last_clean":"2024-03-07T07:32:09.748885+0000","last_became_active":"2024-03-07T07:32:09.743472+0000","last_became_peered":"2024-03-07T07:32:09.743472+0000","last_unstale":"2024-03-07T07:32:09.748885+0000","last_undegraded":"2024-03-07T07:32:09.748885+0000","last_fullsized":"2024-03-07T07:32:09.748885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:22:41.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720912+0000","last_change":"2024-03-07T07:32:09.729570+0000","last_active":"2024-03-07T07:32:10.720912+0000","last_peered":"2024-03-07T07:32:10.720912+0000","last_clean":"2024-03-07T07:32:10.720912+0000","last_became_active":"2024-03-07T07:32:09.729298+0000","last_became_peered":"2024-03-07T07:32:09.729298+0000","last_unstale":"2024-03-07T07:32:10.720912+0000","last_undegraded":"2024-03-07T07:32:10.720912+0000","last_fullsized":"2024-03-07T07:32:10.720912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:49:36.169423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720812+0000","last_change":"2024-03-07T07:32:09.745412+0000","last_active":"2024-03-07T07:32:10.720812+0000","last_peered":"2024-03-07T07:32:10.720812+0000","last_clean":"2024-03-07T07:32:10.720812+0000","last_became_active":"2024-03-07T07:32:09.745165+0000","last_became_peered":"2024-03-07T07:32:09.745165+0000","last_unstale":"2024-03-07T07:32:10.720812+0000","last_undegraded":"2024-03-07T07:32:10.720812+0000","last_fullsized":"2024-03-07T07:32:10.720812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:35.756378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738227+0000","last_change":"2024-03-07T07:32:09.735870+0000","last_active":"2024-03-07T07:32:10.738227+0000","last_peered":"2024-03-07T07:32:10.738227+0000","last_clean":"2024-03-07T07:32:10.738227+0000","last_became_active":"2024-03-07T07:32:09.735573+0000","last_became_peered":"2024-03-07T07:32:09.735573+0000","last_unstale":"2024-03-07T07:32:10.738227+0000","last_undegraded":"2024-03-07T07:32:10.738227+0000","last_fullsized":"2024-03-07T07:32:10.738227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:58.936914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.746972+0000","last_change":"2024-03-07T07:32:09.737554+0000","last_active":"2024-03-07T07:32:09.746972+0000","last_peered":"2024-03-07T07:32:09.746972+0000","last_clean":"2024-03-07T07:32:09.746972+0000","last_became_active":"2024-03-07T07:32:09.736203+0000","last_became_peered":"2024-03-07T07:32:09.736203+0000","last_unstale":"2024-03-07T07:32:09.746972+0000","last_undegraded":"2024-03-07T07:32:09.746972+0000","last_fullsized":"2024-03-07T07:32:09.746972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:15.863540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737268+0000","last_change":"2024-03-07T07:32:09.732781+0000","last_active":"2024-03-07T07:32:09.737268+0000","last_peered":"2024-03-07T07:32:09.737268+0000","last_clean":"2024-03-07T07:32:09.737268+0000","last_became_active":"2024-03-07T07:32:09.732522+0000","last_became_peered":"2024-03-07T07:32:09.732522+0000","last_unstale":"2024-03-07T07:32:09.737268+0000","last_undegraded":"2024-03-07T07:32:09.737268+0000","last_fullsized":"2024-03-07T07:32:09.737268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:22:41.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737916+0000","last_change":"2024-03-07T07:32:09.733989+0000","last_active":"2024-03-07T07:32:09.737916+0000","last_peered":"2024-03-07T07:32:09.737916+0000","last_clean":"2024-03-07T07:32:09.737916+0000","last_became_active":"2024-03-07T07:32:09.733697+0000","last_became_peered":"2024-03-07T07:32:09.733697+0000","last_unstale":"2024-03-07T07:32:09.737916+0000","last_undegraded":"2024-03-07T07:32:09.737916+0000","last_fullsized":"2024-03-07T07:32:09.737916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:24:54.602616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.745886+0000","last_change":"2024-03-07T07:32:09.737262+0000","last_active":"2024-03-07T07:32:09.745886+0000","last_peered":"2024-03-07T07:32:09.745886+0000","last_clean":"2024-03-07T07:32:09.745886+0000","last_became_active":"2024-03-07T07:32:09.734562+0000","last_became_peered":"2024-03-07T07:32:09.734562+0000","last_unstale":"2024-03-07T07:32:09.745886+0000","last_undegraded":"2024-03-07T07:32:09.745886+0000","last_fullsized":"2024-03-07T07:32:09.745886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:58.156994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.731496+0000","last_change":"2024-03-07T07:32:09.720498+0000","last_active":"2024-03-07T07:32:09.731496+0000","last_peered":"2024-03-07T07:32:09.731496+0000","last_clean":"2024-03-07T07:32:09.731496+0000","last_became_active":"2024-03-07T07:32:09.720213+0000","last_became_peered":"2024-03-07T07:32:09.720213+0000","last_unstale":"2024-03-07T07:32:09.731496+0000","last_undegraded":"2024-03-07T07:32:09.731496+0000","last_fullsized":"2024-03-07T07:32:09.731496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:56.867331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955092+0000","last_change":"2024-03-07T07:32:09.741138+0000","last_active":"2024-03-07T07:32:10.955092+0000","last_peered":"2024-03-07T07:32:10.955092+0000","last_clean":"2024-03-07T07:32:10.955092+0000","last_became_active":"2024-03-07T07:32:09.740822+0000","last_became_peered":"2024-03-07T07:32:09.740822+0000","last_unstale":"2024-03-07T07:32:10.955092+0000","last_undegraded":"2024-03-07T07:32:10.955092+0000","last_fullsized":"2024-03-07T07:32:10.955092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:29:17.077153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752414+0000","last_change":"2024-03-07T07:32:08.727746+0000","last_active":"2024-03-07T07:32:09.752414+0000","last_peered":"2024-03-07T07:32:09.752414+0000","last_clean":"2024-03-07T07:32:09.752414+0000","last_became_active":"2024-03-07T07:32:08.726860+0000","last_became_peered":"2024-03-07T07:32:08.726860+0000","last_unstale":"2024-03-07T07:32:09.752414+0000","last_undegraded":"2024-03-07T07:32:09.752414+0000","last_fullsized":"2024-03-07T07:32:09.752414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:41:19.781917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.747653+0000","last_change":"2024-03-07T07:32:09.740174+0000","last_active":"2024-03-07T07:32:09.747653+0000","last_peered":"2024-03-07T07:32:09.747653+0000","last_clean":"2024-03-07T07:32:09.747653+0000","last_became_active":"2024-03-07T07:32:09.739811+0000","last_became_peered":"2024-03-07T07:32:09.739811+0000","last_unstale":"2024-03-07T07:32:09.747653+0000","last_undegraded":"2024-03-07T07:32:09.747653+0000","last_fullsized":"2024-03-07T07:32:09.747653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:57.484266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720858+0000","last_change":"2024-03-07T07:32:08.724895+0000","last_active":"2024-03-07T07:32:10.720858+0000","last_peered":"2024-03-07T07:32:10.720858+0000","last_clean":"2024-03-07T07:32:10.720858+0000","last_became_active":"2024-03-07T07:32:08.724609+0000","last_became_peered":"2024-03-07T07:32:08.724609+0000","last_unstale":"2024-03-07T07:32:10.720858+0000","last_undegraded":"2024-03-07T07:32:10.720858+0000","last_fullsized":"2024-03-07T07:32:10.720858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:31:40.974018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.747809+0000","last_change":"2024-03-07T07:32:09.742029+0000","last_active":"2024-03-07T07:32:09.747809+0000","last_peered":"2024-03-07T07:32:09.747809+0000","last_clean":"2024-03-07T07:32:09.747809+0000","last_became_active":"2024-03-07T07:32:09.741612+0000","last_became_peered":"2024-03-07T07:32:09.741612+0000","last_unstale":"2024-03-07T07:32:09.747809+0000","last_undegraded":"2024-03-07T07:32:09.747809+0000","last_fullsized":"2024-03-07T07:32:09.747809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:04.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741418+0000","last_change":"2024-03-07T07:32:08.728713+0000","last_active":"2024-03-07T07:32:10.741418+0000","last_peered":"2024-03-07T07:32:10.741418+0000","last_clean":"2024-03-07T07:32:10.741418+0000","last_became_active":"2024-03-07T07:32:08.728291+0000","last_became_peered":"2024-03-07T07:32:08.728291+0000","last_unstale":"2024-03-07T07:32:10.741418+0000","last_undegraded":"2024-03-07T07:32:10.741418+0000","last_fullsized":"2024-03-07T07:32:10.741418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:13.628528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720600+0000","last_change":"2024-03-07T07:32:09.732104+0000","last_active":"2024-03-07T07:32:10.720600+0000","last_peered":"2024-03-07T07:32:10.720600+0000","last_clean":"2024-03-07T07:32:10.720600+0000","last_became_active":"2024-03-07T07:32:09.731793+0000","last_became_peered":"2024-03-07T07:32:09.731793+0000","last_unstale":"2024-03-07T07:32:10.720600+0000","last_undegraded":"2024-03-07T07:32:10.720600+0000","last_fullsized":"2024-03-07T07:32:10.720600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:33.195769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.721004+0000","last_change":"2024-03-07T07:32:08.717295+0000","last_active":"2024-03-07T07:32:10.721004+0000","last_peered":"2024-03-07T07:32:10.721004+0000","last_clean":"2024-03-07T07:32:10.721004+0000","last_became_active":"2024-03-07T07:32:08.715284+0000","last_became_peered":"2024-03-07T07:32:08.715284+0000","last_unstale":"2024-03-07T07:32:10.721004+0000","last_undegraded":"2024-03-07T07:32:10.721004+0000","last_fullsized":"2024-03-07T07:32:10.721004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:51:45.177383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752638+0000","last_change":"2024-03-07T07:32:09.742100+0000","last_active":"2024-03-07T07:32:09.752638+0000","last_peered":"2024-03-07T07:32:09.752638+0000","last_clean":"2024-03-07T07:32:09.752638+0000","last_became_active":"2024-03-07T07:32:09.741769+0000","last_became_peered":"2024-03-07T07:32:09.741769+0000","last_unstale":"2024-03-07T07:32:09.752638+0000","last_undegraded":"2024-03-07T07:32:09.752638+0000","last_fullsized":"2024-03-07T07:32:09.752638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:54:10.883851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752898+0000","last_change":"2024-03-07T07:32:08.724105+0000","last_active":"2024-03-07T07:32:09.752898+0000","last_peered":"2024-03-07T07:32:09.752898+0000","last_clean":"2024-03-07T07:32:09.752898+0000","last_became_active":"2024-03-07T07:32:08.723796+0000","last_became_peered":"2024-03-07T07:32:08.723796+0000","last_unstale":"2024-03-07T07:32:09.752898+0000","last_undegraded":"2024-03-07T07:32:09.752898+0000","last_fullsized":"2024-03-07T07:32:09.752898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:09.647569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744660+0000","last_change":"2024-03-07T07:32:09.736758+0000","last_active":"2024-03-07T07:32:09.744660+0000","last_peered":"2024-03-07T07:32:09.744660+0000","last_clean":"2024-03-07T07:32:09.744660+0000","last_became_active":"2024-03-07T07:32:09.736405+0000","last_became_peered":"2024-03-07T07:32:09.736405+0000","last_unstale":"2024-03-07T07:32:09.744660+0000","last_undegraded":"2024-03-07T07:32:09.744660+0000","last_fullsized":"2024-03-07T07:32:09.744660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:44:21.013212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.750777+0000","last_change":"2024-03-07T07:32:08.725455+0000","last_active":"2024-03-07T07:32:09.750777+0000","last_peered":"2024-03-07T07:32:09.750777+0000","last_clean":"2024-03-07T07:32:09.750777+0000","last_became_active":"2024-03-07T07:32:08.721591+0000","last_became_peered":"2024-03-07T07:32:08.721591+0000","last_unstale":"2024-03-07T07:32:09.750777+0000","last_undegraded":"2024-03-07T07:32:09.750777+0000","last_fullsized":"2024-03-07T07:32:09.750777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:23.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752740+0000","last_change":"2024-03-07T07:32:09.743365+0000","last_active":"2024-03-07T07:32:09.752740+0000","last_peered":"2024-03-07T07:32:09.752740+0000","last_clean":"2024-03-07T07:32:09.752740+0000","last_became_active":"2024-03-07T07:32:09.743117+0000","last_became_peered":"2024-03-07T07:32:09.743117+0000","last_unstale":"2024-03-07T07:32:09.752740+0000","last_undegraded":"2024-03-07T07:32:09.752740+0000","last_fullsized":"2024-03-07T07:32:09.752740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:14.634090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741062+0000","last_change":"2024-03-07T07:32:08.722719+0000","last_active":"2024-03-07T07:32:10.741062+0000","last_peered":"2024-03-07T07:32:10.741062+0000","last_clean":"2024-03-07T07:32:10.741062+0000","last_became_active":"2024-03-07T07:32:08.722402+0000","last_became_peered":"2024-03-07T07:32:08.722402+0000","last_unstale":"2024-03-07T07:32:10.741062+0000","last_undegraded":"2024-03-07T07:32:10.741062+0000","last_fullsized":"2024-03-07T07:32:10.741062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:05.619568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720043+0000","last_change":"2024-03-07T07:32:09.730779+0000","last_active":"2024-03-07T07:32:10.720043+0000","last_peered":"2024-03-07T07:32:10.720043+0000","last_clean":"2024-03-07T07:32:10.720043+0000","last_became_active":"2024-03-07T07:32:09.728743+0000","last_became_peered":"2024-03-07T07:32:09.728743+0000","last_unstale":"2024-03-07T07:32:10.720043+0000","last_undegraded":"2024-03-07T07:32:10.720043+0000","last_fullsized":"2024-03-07T07:32:10.720043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:25:43.937006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.719065+0000","last_change":"2024-03-07T07:32:08.717797+0000","last_active":"2024-03-07T07:32:09.719065+0000","last_peered":"2024-03-07T07:32:09.719065+0000","last_clean":"2024-03-07T07:32:09.719065+0000","last_became_active":"2024-03-07T07:32:08.717520+0000","last_became_peered":"2024-03-07T07:32:08.717520+0000","last_unstale":"2024-03-07T07:32:09.719065+0000","last_undegraded":"2024-03-07T07:32:09.719065+0000","last_fullsized":"2024-03-07T07:32:09.719065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:02.290184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744182+0000","last_change":"2024-03-07T07:32:09.738676+0000","last_active":"2024-03-07T07:32:09.744182+0000","last_peered":"2024-03-07T07:32:09.744182+0000","last_clean":"2024-03-07T07:32:09.744182+0000","last_became_active":"2024-03-07T07:32:09.738382+0000","last_became_peered":"2024-03-07T07:32:09.738382+0000","last_unstale":"2024-03-07T07:32:09.744182+0000","last_undegraded":"2024-03-07T07:32:09.744182+0000","last_fullsized":"2024-03-07T07:32:09.744182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:40:45.721561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738361+0000","last_change":"2024-03-07T07:32:08.725251+0000","last_active":"2024-03-07T07:32:10.738361+0000","last_peered":"2024-03-07T07:32:10.738361+0000","last_clean":"2024-03-07T07:32:10.738361+0000","last_became_active":"2024-03-07T07:32:08.724921+0000","last_became_peered":"2024-03-07T07:32:08.724921+0000","last_unstale":"2024-03-07T07:32:10.738361+0000","last_undegraded":"2024-03-07T07:32:10.738361+0000","last_fullsized":"2024-03-07T07:32:10.738361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:03.797461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720989+0000","last_change":"2024-03-07T07:32:09.742287+0000","last_active":"2024-03-07T07:32:10.720989+0000","last_peered":"2024-03-07T07:32:10.720989+0000","last_clean":"2024-03-07T07:32:10.720989+0000","last_became_active":"2024-03-07T07:32:09.741986+0000","last_became_peered":"2024-03-07T07:32:09.741986+0000","last_unstale":"2024-03-07T07:32:10.720989+0000","last_undegraded":"2024-03-07T07:32:10.720989+0000","last_fullsized":"2024-03-07T07:32:10.720989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:32:09.374983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738200+0000","last_change":"2024-03-07T07:32:08.729316+0000","last_active":"2024-03-07T07:32:10.738200+0000","last_peered":"2024-03-07T07:32:10.738200+0000","last_clean":"2024-03-07T07:32:10.738200+0000","last_became_active":"2024-03-07T07:32:08.729021+0000","last_became_peered":"2024-03-07T07:32:08.729021+0000","last_unstale":"2024-03-07T07:32:10.738200+0000","last_undegraded":"2024-03-07T07:32:10.738200+0000","last_fullsized":"2024-03-07T07:32:10.738200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:14.857977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720752+0000","last_change":"2024-03-07T07:32:09.731296+0000","last_active":"2024-03-07T07:32:10.720752+0000","last_peered":"2024-03-07T07:32:10.720752+0000","last_clean":"2024-03-07T07:32:10.720752+0000","last_became_active":"2024-03-07T07:32:09.729898+0000","last_became_peered":"2024-03-07T07:32:09.729898+0000","last_unstale":"2024-03-07T07:32:10.720752+0000","last_undegraded":"2024-03-07T07:32:10.720752+0000","last_fullsized":"2024-03-07T07:32:10.720752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:34:59.725800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.751068+0000","last_change":"2024-03-07T07:32:08.717596+0000","last_active":"2024-03-07T07:32:09.751068+0000","last_peered":"2024-03-07T07:32:09.751068+0000","last_clean":"2024-03-07T07:32:09.751068+0000","last_became_active":"2024-03-07T07:32:08.716657+0000","last_became_peered":"2024-03-07T07:32:08.716657+0000","last_unstale":"2024-03-07T07:32:09.751068+0000","last_undegraded":"2024-03-07T07:32:09.751068+0000","last_fullsized":"2024-03-07T07:32:09.751068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:17.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734385+0000","last_change":"2024-03-07T07:32:09.729099+0000","last_active":"2024-03-07T07:32:09.734385+0000","last_peered":"2024-03-07T07:32:09.734385+0000","last_clean":"2024-03-07T07:32:09.734385+0000","last_became_active":"2024-03-07T07:32:09.728580+0000","last_became_peered":"2024-03-07T07:32:09.728580+0000","last_unstale":"2024-03-07T07:32:09.734385+0000","last_undegraded":"2024-03-07T07:32:09.734385+0000","last_fullsized":"2024-03-07T07:32:09.734385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:47:58.388381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954897+0000","last_change":"2024-03-07T07:32:08.719544+0000","last_active":"2024-03-07T07:32:10.954897+0000","last_peered":"2024-03-07T07:32:10.954897+0000","last_clean":"2024-03-07T07:32:10.954897+0000","last_became_active":"2024-03-07T07:32:08.719222+0000","last_became_peered":"2024-03-07T07:32:08.719222+0000","last_unstale":"2024-03-07T07:32:10.954897+0000","last_undegraded":"2024-03-07T07:32:10.954897+0000","last_fullsized":"2024-03-07T07:32:10.954897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:46:28.182896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954557+0000","last_change":"2024-03-07T07:32:09.743032+0000","last_active":"2024-03-07T07:32:10.954557+0000","last_peered":"2024-03-07T07:32:10.954557+0000","last_clean":"2024-03-07T07:32:10.954557+0000","last_became_active":"2024-03-07T07:32:09.742660+0000","last_became_peered":"2024-03-07T07:32:09.742660+0000","last_unstale":"2024-03-07T07:32:10.954557+0000","last_undegraded":"2024-03-07T07:32:10.954557+0000","last_fullsized":"2024-03-07T07:32:10.954557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:45:20.713770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752346+0000","last_change":"2024-03-07T07:32:08.714266+0000","last_active":"2024-03-07T07:32:09.752346+0000","last_peered":"2024-03-07T07:32:09.752346+0000","last_clean":"2024-03-07T07:32:09.752346+0000","last_became_active":"2024-03-07T07:32:08.713142+0000","last_became_peered":"2024-03-07T07:32:08.713142+0000","last_unstale":"2024-03-07T07:32:09.752346+0000","last_undegraded":"2024-03-07T07:32:09.752346+0000","last_fullsized":"2024-03-07T07:32:09.752346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:23:53.633589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720599+0000","last_change":"2024-03-07T07:32:09.745013+0000","last_active":"2024-03-07T07:32:10.720599+0000","last_peered":"2024-03-07T07:32:10.720599+0000","last_clean":"2024-03-07T07:32:10.720599+0000","last_became_active":"2024-03-07T07:32:09.744437+0000","last_became_peered":"2024-03-07T07:32:09.744437+0000","last_unstale":"2024-03-07T07:32:10.720599+0000","last_undegraded":"2024-03-07T07:32:10.720599+0000","last_fullsized":"2024-03-07T07:32:10.720599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:26:02.360585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720717+0000","last_change":"2024-03-07T07:32:08.717609+0000","last_active":"2024-03-07T07:32:10.720717+0000","last_peered":"2024-03-07T07:32:10.720717+0000","last_clean":"2024-03-07T07:32:10.720717+0000","last_became_active":"2024-03-07T07:32:08.717250+0000","last_became_peered":"2024-03-07T07:32:08.717250+0000","last_unstale":"2024-03-07T07:32:10.720717+0000","last_undegraded":"2024-03-07T07:32:10.720717+0000","last_fullsized":"2024-03-07T07:32:10.720717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:13:04.006716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.754629+0000","last_change":"2024-03-07T07:32:09.747488+0000","last_active":"2024-03-07T07:32:09.754629+0000","last_peered":"2024-03-07T07:32:09.754629+0000","last_clean":"2024-03-07T07:32:09.754629+0000","last_became_active":"2024-03-07T07:32:09.747152+0000","last_became_peered":"2024-03-07T07:32:09.747152+0000","last_unstale":"2024-03-07T07:32:09.754629+0000","last_undegraded":"2024-03-07T07:32:09.754629+0000","last_fullsized":"2024-03-07T07:32:09.754629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:06:31.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719964+0000","last_change":"2024-03-07T07:32:08.719257+0000","last_active":"2024-03-07T07:32:10.719964+0000","last_peered":"2024-03-07T07:32:10.719964+0000","last_clean":"2024-03-07T07:32:10.719964+0000","last_became_active":"2024-03-07T07:32:08.718947+0000","last_became_peered":"2024-03-07T07:32:08.718947+0000","last_unstale":"2024-03-07T07:32:10.719964+0000","last_undegraded":"2024-03-07T07:32:10.719964+0000","last_fullsized":"2024-03-07T07:32:10.719964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:31:46.996542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734268+0000","last_change":"2024-03-07T07:32:09.727647+0000","last_active":"2024-03-07T07:32:09.734268+0000","last_peered":"2024-03-07T07:32:09.734268+0000","last_clean":"2024-03-07T07:32:09.734268+0000","last_became_active":"2024-03-07T07:32:09.727415+0000","last_became_peered":"2024-03-07T07:32:09.727415+0000","last_unstale":"2024-03-07T07:32:09.734268+0000","last_undegraded":"2024-03-07T07:32:09.734268+0000","last_fullsized":"2024-03-07T07:32:09.734268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:10:50.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.740930+0000","last_change":"2024-03-07T07:32:08.722227+0000","last_active":"2024-03-07T07:32:10.740930+0000","last_peered":"2024-03-07T07:32:10.740930+0000","last_clean":"2024-03-07T07:32:10.740930+0000","last_became_active":"2024-03-07T07:32:08.721547+0000","last_became_peered":"2024-03-07T07:32:08.721547+0000","last_unstale":"2024-03-07T07:32:10.740930+0000","last_undegraded":"2024-03-07T07:32:10.740930+0000","last_fullsized":"2024-03-07T07:32:10.740930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:11:30.172990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.738566+0000","last_change":"2024-03-07T07:32:09.728668+0000","last_active":"2024-03-07T07:32:09.738566+0000","last_peered":"2024-03-07T07:32:09.738566+0000","last_clean":"2024-03-07T07:32:09.738566+0000","last_became_active":"2024-03-07T07:32:09.728355+0000","last_became_peered":"2024-03-07T07:32:09.728355+0000","last_unstale":"2024-03-07T07:32:09.738566+0000","last_undegraded":"2024-03-07T07:32:09.738566+0000","last_fullsized":"2024-03-07T07:32:09.738566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:23:36.667810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741438+0000","last_change":"2024-03-07T07:32:08.729034+0000","last_active":"2024-03-07T07:32:10.741438+0000","last_peered":"2024-03-07T07:32:10.741438+0000","last_clean":"2024-03-07T07:32:10.741438+0000","last_became_active":"2024-03-07T07:32:08.728745+0000","last_became_peered":"2024-03-07T07:32:08.728745+0000","last_unstale":"2024-03-07T07:32:10.741438+0000","last_undegraded":"2024-03-07T07:32:10.741438+0000","last_fullsized":"2024-03-07T07:32:10.741438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:54:09.878288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.744006+0000","last_change":"2024-03-07T07:32:09.735410+0000","last_active":"2024-03-07T07:32:09.744006+0000","last_peered":"2024-03-07T07:32:09.744006+0000","last_clean":"2024-03-07T07:32:09.744006+0000","last_became_active":"2024-03-07T07:32:09.735140+0000","last_became_peered":"2024-03-07T07:32:09.735140+0000","last_unstale":"2024-03-07T07:32:09.744006+0000","last_undegraded":"2024-03-07T07:32:09.744006+0000","last_fullsized":"2024-03-07T07:32:09.744006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:35:37.916914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752220+0000","last_change":"2024-03-07T07:32:08.712845+0000","last_active":"2024-03-07T07:32:09.752220+0000","last_peered":"2024-03-07T07:32:09.752220+0000","last_clean":"2024-03-07T07:32:09.752220+0000","last_became_active":"2024-03-07T07:32:08.712543+0000","last_became_peered":"2024-03-07T07:32:08.712543+0000","last_unstale":"2024-03-07T07:32:09.752220+0000","last_undegraded":"2024-03-07T07:32:09.752220+0000","last_fullsized":"2024-03-07T07:32:09.752220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:43.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738023+0000","last_change":"2024-03-07T07:32:09.744731+0000","last_active":"2024-03-07T07:32:10.738023+0000","last_peered":"2024-03-07T07:32:10.738023+0000","last_clean":"2024-03-07T07:32:10.738023+0000","last_became_active":"2024-03-07T07:32:09.744460+0000","last_became_peered":"2024-03-07T07:32:09.744460+0000","last_unstale":"2024-03-07T07:32:10.738023+0000","last_undegraded":"2024-03-07T07:32:10.738023+0000","last_fullsized":"2024-03-07T07:32:10.738023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:21.839830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.753504+0000","last_change":"2024-03-07T07:32:08.726767+0000","last_active":"2024-03-07T07:32:09.753504+0000","last_peered":"2024-03-07T07:32:09.753504+0000","last_clean":"2024-03-07T07:32:09.753504+0000","last_became_active":"2024-03-07T07:32:08.721780+0000","last_became_peered":"2024-03-07T07:32:08.721780+0000","last_unstale":"2024-03-07T07:32:09.753504+0000","last_undegraded":"2024-03-07T07:32:09.753504+0000","last_fullsized":"2024-03-07T07:32:09.753504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:57.931351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741304+0000","last_change":"2024-03-07T07:32:09.736606+0000","last_active":"2024-03-07T07:32:10.741304+0000","last_peered":"2024-03-07T07:32:10.741304+0000","last_clean":"2024-03-07T07:32:10.741304+0000","last_became_active":"2024-03-07T07:32:09.736269+0000","last_became_peered":"2024-03-07T07:32:09.736269+0000","last_unstale":"2024-03-07T07:32:10.741304+0000","last_undegraded":"2024-03-07T07:32:10.741304+0000","last_fullsized":"2024-03-07T07:32:10.741304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:27.999230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.721236+0000","last_change":"2024-03-07T07:32:08.724075+0000","last_active":"2024-03-07T07:32:09.721236+0000","last_peered":"2024-03-07T07:32:09.721236+0000","last_clean":"2024-03-07T07:32:09.721236+0000","last_became_active":"2024-03-07T07:32:08.723816+0000","last_became_peered":"2024-03-07T07:32:08.723816+0000","last_unstale":"2024-03-07T07:32:09.721236+0000","last_undegraded":"2024-03-07T07:32:09.721236+0000","last_fullsized":"2024-03-07T07:32:09.721236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:57.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954548+0000","last_change":"2024-03-07T07:32:09.742852+0000","last_active":"2024-03-07T07:32:10.954548+0000","last_peered":"2024-03-07T07:32:10.954548+0000","last_clean":"2024-03-07T07:32:10.954548+0000","last_became_active":"2024-03-07T07:32:09.741156+0000","last_became_peered":"2024-03-07T07:32:09.741156+0000","last_unstale":"2024-03-07T07:32:10.954548+0000","last_undegraded":"2024-03-07T07:32:10.954548+0000","last_fullsized":"2024-03-07T07:32:10.954548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:12:08.760057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738064+0000","last_change":"2024-03-07T07:32:08.725250+0000","last_active":"2024-03-07T07:32:10.738064+0000","last_peered":"2024-03-07T07:32:10.738064+0000","last_clean":"2024-03-07T07:32:10.738064+0000","last_became_active":"2024-03-07T07:32:08.724952+0000","last_became_peered":"2024-03-07T07:32:08.724952+0000","last_unstale":"2024-03-07T07:32:10.738064+0000","last_undegraded":"2024-03-07T07:32:10.738064+0000","last_fullsized":"2024-03-07T07:32:10.738064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:57.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.737977+0000","last_change":"2024-03-07T07:32:09.738332+0000","last_active":"2024-03-07T07:32:10.737977+0000","last_peered":"2024-03-07T07:32:10.737977+0000","last_clean":"2024-03-07T07:32:10.737977+0000","last_became_active":"2024-03-07T07:32:09.738070+0000","last_became_peered":"2024-03-07T07:32:09.738070+0000","last_unstale":"2024-03-07T07:32:10.737977+0000","last_undegraded":"2024-03-07T07:32:10.737977+0000","last_fullsized":"2024-03-07T07:32:10.737977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:55:29.714693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.717693+0000","last_change":"2024-03-07T07:32:08.722811+0000","last_active":"2024-03-07T07:32:09.717693+0000","last_peered":"2024-03-07T07:32:09.717693+0000","last_clean":"2024-03-07T07:32:09.717693+0000","last_became_active":"2024-03-07T07:32:08.722388+0000","last_became_peered":"2024-03-07T07:32:08.722388+0000","last_unstale":"2024-03-07T07:32:09.717693+0000","last_undegraded":"2024-03-07T07:32:09.717693+0000","last_fullsized":"2024-03-07T07:32:09.717693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:09.210160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954727+0000","last_change":"2024-03-07T07:32:09.746626+0000","last_active":"2024-03-07T07:32:10.954727+0000","last_peered":"2024-03-07T07:32:10.954727+0000","last_clean":"2024-03-07T07:32:10.954727+0000","last_became_active":"2024-03-07T07:32:09.746273+0000","last_became_peered":"2024-03-07T07:32:09.746273+0000","last_unstale":"2024-03-07T07:32:10.954727+0000","last_undegraded":"2024-03-07T07:32:10.954727+0000","last_fullsized":"2024-03-07T07:32:10.954727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:10:23.110753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.724976+0000","last_change":"2024-03-07T07:32:08.727283+0000","last_active":"2024-03-07T07:32:09.724976+0000","last_peered":"2024-03-07T07:32:09.724976+0000","last_clean":"2024-03-07T07:32:09.724976+0000","last_became_active":"2024-03-07T07:32:08.727012+0000","last_became_peered":"2024-03-07T07:32:08.727012+0000","last_unstale":"2024-03-07T07:32:09.724976+0000","last_undegraded":"2024-03-07T07:32:09.724976+0000","last_fullsized":"2024-03-07T07:32:09.724976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:11.184461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.752754+0000","last_change":"2024-03-07T07:32:09.743462+0000","last_active":"2024-03-07T07:32:09.752754+0000","last_peered":"2024-03-07T07:32:09.752754+0000","last_clean":"2024-03-07T07:32:09.752754+0000","last_became_active":"2024-03-07T07:32:09.743094+0000","last_became_peered":"2024-03-07T07:32:09.743094+0000","last_unstale":"2024-03-07T07:32:09.752754+0000","last_undegraded":"2024-03-07T07:32:09.752754+0000","last_fullsized":"2024-03-07T07:32:09.752754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:24.575003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.715054+0000","last_change":"2024-03-07T07:32:08.723260+0000","last_active":"2024-03-07T07:32:09.715054+0000","last_peered":"2024-03-07T07:32:09.715054+0000","last_clean":"2024-03-07T07:32:09.715054+0000","last_became_active":"2024-03-07T07:32:08.723010+0000","last_became_peered":"2024-03-07T07:32:08.723010+0000","last_unstale":"2024-03-07T07:32:09.715054+0000","last_undegraded":"2024-03-07T07:32:09.715054+0000","last_fullsized":"2024-03-07T07:32:09.715054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:20.834267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741395+0000","last_change":"2024-03-07T07:32:09.737681+0000","last_active":"2024-03-07T07:32:10.741395+0000","last_peered":"2024-03-07T07:32:10.741395+0000","last_clean":"2024-03-07T07:32:10.741395+0000","last_became_active":"2024-03-07T07:32:09.736035+0000","last_became_peered":"2024-03-07T07:32:09.736035+0000","last_unstale":"2024-03-07T07:32:10.741395+0000","last_undegraded":"2024-03-07T07:32:10.741395+0000","last_fullsized":"2024-03-07T07:32:10.741395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:18.860889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955059+0000","last_change":"2024-03-07T07:32:08.723288+0000","last_active":"2024-03-07T07:32:10.955059+0000","last_peered":"2024-03-07T07:32:10.955059+0000","last_clean":"2024-03-07T07:32:10.955059+0000","last_became_active":"2024-03-07T07:32:08.723011+0000","last_became_peered":"2024-03-07T07:32:08.723011+0000","last_unstale":"2024-03-07T07:32:10.955059+0000","last_undegraded":"2024-03-07T07:32:10.955059+0000","last_fullsized":"2024-03-07T07:32:10.955059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:35:45.488891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734457+0000","last_change":"2024-03-07T07:32:09.732193+0000","last_active":"2024-03-07T07:32:09.734457+0000","last_peered":"2024-03-07T07:32:09.734457+0000","last_clean":"2024-03-07T07:32:09.734457+0000","last_became_active":"2024-03-07T07:32:09.731912+0000","last_became_peered":"2024-03-07T07:32:09.731912+0000","last_unstale":"2024-03-07T07:32:09.734457+0000","last_undegraded":"2024-03-07T07:32:09.734457+0000","last_fullsized":"2024-03-07T07:32:09.734457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:38:38.626228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738348+0000","last_change":"2024-03-07T07:32:08.728905+0000","last_active":"2024-03-07T07:32:10.738348+0000","last_peered":"2024-03-07T07:32:10.738348+0000","last_clean":"2024-03-07T07:32:10.738348+0000","last_became_active":"2024-03-07T07:32:08.728584+0000","last_became_peered":"2024-03-07T07:32:08.728584+0000","last_unstale":"2024-03-07T07:32:10.738348+0000","last_undegraded":"2024-03-07T07:32:10.738348+0000","last_fullsized":"2024-03-07T07:32:10.738348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:56.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741448+0000","last_change":"2024-03-07T07:32:09.734387+0000","last_active":"2024-03-07T07:32:10.741448+0000","last_peered":"2024-03-07T07:32:10.741448+0000","last_clean":"2024-03-07T07:32:10.741448+0000","last_became_active":"2024-03-07T07:32:09.734040+0000","last_became_peered":"2024-03-07T07:32:09.734040+0000","last_unstale":"2024-03-07T07:32:10.741448+0000","last_undegraded":"2024-03-07T07:32:10.741448+0000","last_fullsized":"2024-03-07T07:32:10.741448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:58.156994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954977+0000","last_change":"2024-03-07T07:32:08.722707+0000","last_active":"2024-03-07T07:32:10.954977+0000","last_peered":"2024-03-07T07:32:10.954977+0000","last_clean":"2024-03-07T07:32:10.954977+0000","last_became_active":"2024-03-07T07:32:08.721788+0000","last_became_peered":"2024-03-07T07:32:08.721788+0000","last_unstale":"2024-03-07T07:32:10.954977+0000","last_undegraded":"2024-03-07T07:32:10.954977+0000","last_fullsized":"2024-03-07T07:32:10.954977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:05:42.008018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737253+0000","last_change":"2024-03-07T07:32:09.732507+0000","last_active":"2024-03-07T07:32:09.737253+0000","last_peered":"2024-03-07T07:32:09.737253+0000","last_clean":"2024-03-07T07:32:09.737253+0000","last_became_active":"2024-03-07T07:32:09.732228+0000","last_became_peered":"2024-03-07T07:32:09.732228+0000","last_unstale":"2024-03-07T07:32:09.737253+0000","last_undegraded":"2024-03-07T07:32:09.737253+0000","last_fullsized":"2024-03-07T07:32:09.737253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:04.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954952+0000","last_change":"2024-03-07T07:32:08.723402+0000","last_active":"2024-03-07T07:32:10.954952+0000","last_peered":"2024-03-07T07:32:10.954952+0000","last_clean":"2024-03-07T07:32:10.954952+0000","last_became_active":"2024-03-07T07:32:08.722984+0000","last_became_peered":"2024-03-07T07:32:08.722984+0000","last_unstale":"2024-03-07T07:32:10.954952+0000","last_undegraded":"2024-03-07T07:32:10.954952+0000","last_fullsized":"2024-03-07T07:32:10.954952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:13:19.770427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720502+0000","last_change":"2024-03-07T07:32:09.744759+0000","last_active":"2024-03-07T07:32:10.720502+0000","last_peered":"2024-03-07T07:32:10.720502+0000","last_clean":"2024-03-07T07:32:10.720502+0000","last_became_active":"2024-03-07T07:32:09.743975+0000","last_became_peered":"2024-03-07T07:32:09.743975+0000","last_unstale":"2024-03-07T07:32:10.720502+0000","last_undegraded":"2024-03-07T07:32:10.720502+0000","last_fullsized":"2024-03-07T07:32:10.720502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:27:29.722998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954863+0000","last_change":"2024-03-07T07:32:08.721683+0000","last_active":"2024-03-07T07:32:10.954863+0000","last_peered":"2024-03-07T07:32:10.954863+0000","last_clean":"2024-03-07T07:32:10.954863+0000","last_became_active":"2024-03-07T07:32:08.721226+0000","last_became_peered":"2024-03-07T07:32:08.721226+0000","last_unstale":"2024-03-07T07:32:10.954863+0000","last_undegraded":"2024-03-07T07:32:10.954863+0000","last_fullsized":"2024-03-07T07:32:10.954863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:34:30.228981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720429+0000","last_change":"2024-03-07T07:32:09.726098+0000","last_active":"2024-03-07T07:32:10.720429+0000","last_peered":"2024-03-07T07:32:10.720429+0000","last_clean":"2024-03-07T07:32:10.720429+0000","last_became_active":"2024-03-07T07:32:09.725778+0000","last_became_peered":"2024-03-07T07:32:09.725778+0000","last_unstale":"2024-03-07T07:32:10.720429+0000","last_undegraded":"2024-03-07T07:32:10.720429+0000","last_fullsized":"2024-03-07T07:32:10.720429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:45:58.369642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.719575+0000","last_change":"2024-03-07T07:32:08.714980+0000","last_active":"2024-03-07T07:32:09.719575+0000","last_peered":"2024-03-07T07:32:09.719575+0000","last_clean":"2024-03-07T07:32:09.719575+0000","last_became_active":"2024-03-07T07:32:08.714659+0000","last_became_peered":"2024-03-07T07:32:08.714659+0000","last_unstale":"2024-03-07T07:32:09.719575+0000","last_undegraded":"2024-03-07T07:32:09.719575+0000","last_fullsized":"2024-03-07T07:32:09.719575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:14.784463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.734491+0000","last_change":"2024-03-07T07:32:09.732846+0000","last_active":"2024-03-07T07:32:09.734491+0000","last_peered":"2024-03-07T07:32:09.734491+0000","last_clean":"2024-03-07T07:32:09.734491+0000","last_became_active":"2024-03-07T07:32:09.731979+0000","last_became_peered":"2024-03-07T07:32:09.731979+0000","last_unstale":"2024-03-07T07:32:09.734491+0000","last_undegraded":"2024-03-07T07:32:09.734491+0000","last_fullsized":"2024-03-07T07:32:09.734491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:39:44.332839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720371+0000","last_change":"2024-03-07T07:32:08.726960+0000","last_active":"2024-03-07T07:32:10.720371+0000","last_peered":"2024-03-07T07:32:10.720371+0000","last_clean":"2024-03-07T07:32:10.720371+0000","last_became_active":"2024-03-07T07:32:08.726686+0000","last_became_peered":"2024-03-07T07:32:08.726686+0000","last_unstale":"2024-03-07T07:32:10.720371+0000","last_undegraded":"2024-03-07T07:32:10.720371+0000","last_fullsized":"2024-03-07T07:32:10.720371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:13:19.770427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.737233+0000","last_change":"2024-03-07T07:32:09.733315+0000","last_active":"2024-03-07T07:32:09.737233+0000","last_peered":"2024-03-07T07:32:09.737233+0000","last_clean":"2024-03-07T07:32:09.737233+0000","last_became_active":"2024-03-07T07:32:09.733052+0000","last_became_peered":"2024-03-07T07:32:09.733052+0000","last_unstale":"2024-03-07T07:32:09.737233+0000","last_undegraded":"2024-03-07T07:32:09.737233+0000","last_fullsized":"2024-03-07T07:32:09.737233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:06:31.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.716459+0000","last_change":"2024-03-07T07:32:08.721617+0000","last_active":"2024-03-07T07:32:09.716459+0000","last_peered":"2024-03-07T07:32:09.716459+0000","last_clean":"2024-03-07T07:32:09.716459+0000","last_became_active":"2024-03-07T07:32:08.721242+0000","last_became_peered":"2024-03-07T07:32:08.721242+0000","last_unstale":"2024-03-07T07:32:09.716459+0000","last_undegraded":"2024-03-07T07:32:09.716459+0000","last_fullsized":"2024-03-07T07:32:09.716459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:41:43.318106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-07T07:32:09.725441+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:32:09.725441+0000","last_peered":"2024-03-07T07:32:09.725441+0000","last_clean":"2024-03-07T07:32:09.725441+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:32:09.725441+0000","last_undegraded":"2024-03-07T07:32:09.725441+0000","last_fullsized":"2024-03-07T07:32:09.725441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":725008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":149327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":738665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":149349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:32:18.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:32:18.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc990a00640 1 Processor -- start 2024-03-07T07:32:18.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc990a00640 1 -- start start 2024-03-07T07:32:18.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc990a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c15c1f0 0x7fc98c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc990a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc98c0b3a00 0x7fc98c0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc990a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c0b0290 con 0x7fc98c0cf100 2024-03-07T07:32:18.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc990a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0b1d40 con 0x7fc98c0b3a00 2024-03-07T07:32:18.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc990a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0b0570 con 0x7fc98c15c1f0 2024-03-07T07:32:18.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc989400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc98c0cf100 0x7fc98c0d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56806/0 (socket says 172.21.15.84:56806) 2024-03-07T07:32:18.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc989400640 1 -- 172.21.15.84:0/2528009003 learned_addr learned my addr 172.21.15.84:0/2528009003 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:18.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc98a800640 1 --2- 172.21.15.84:0/2528009003 >> v2:172.21.15.161:3300/0 conn(0x7fc98c0b3a00 0x7fc98c0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.525+0000 7fc989e00640 1 --2- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c15c1f0 0x7fc98c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc988a00640 1 -- 172.21.15.84:0/2528009003 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221883271 0 0) 0x7fc98c0b0290 con 0x7fc98c0cf100 2024-03-07T07:32:18.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc988a00640 1 -- 172.21.15.84:0/2528009003 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc970003530 con 0x7fc98c0cf100 2024-03-07T07:32:18.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc988a00640 1 -- 172.21.15.84:0/2528009003 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678697664 0 0) 0x7fc970003530 con 0x7fc98c0cf100 2024-03-07T07:32:18.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc98a800640 1 -- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c15c1f0 msgr2=0x7fc98c0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:18.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc98a800640 1 --2- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c15c1f0 0x7fc98c0b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc98a800640 1 -- 172.21.15.84:0/2528009003 >> v1:172.21.15.84:6789/0 conn(0x7fc98c0cf100 legacy=0x7fc98c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc98a800640 1 -- 172.21.15.84:0/2528009003 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0b0850 con 0x7fc98c0b3a00 2024-03-07T07:32:18.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc989e00640 1 --2- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c15c1f0 0x7fc98c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:32:18.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc98a800640 1 --2- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c0b3a00 0x7fc98c0aefa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc984009d90 tx=0x7fc98401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f285303043614c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:18.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc988a00640 1 -- 172.21.15.84:0/2528009003 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840b2070 con 0x7fc98c0b3a00 2024-03-07T07:32:18.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc988a00640 1 -- 172.21.15.84:0/2528009003 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9840a5510 con 0x7fc98c0b3a00 2024-03-07T07:32:18.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.529+0000 7fc988a00640 1 -- 172.21.15.84:0/2528009003 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978001680 con 0x7fc98c0b3a00 2024-03-07T07:32:18.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c0b3a00 msgr2=0x7fc98c0aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 --2- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c0b3a00 0x7fc98c0aefa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc984009d90 tx=0x7fc98401c800 comp rx=0 tx=0).stop 2024-03-07T07:32:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- 172.21.15.84:0/2528009003 shutdown_connections 2024-03-07T07:32:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 --2- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c0b3a00 0x7fc98c0aefa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 --2- 172.21.15.84:0/2528009003 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c15c1f0 0x7fc98c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- 172.21.15.84:0/2528009003 >> 172.21.15.84:0/2528009003 conn(0x7fc98c0b1ed0 msgr2=0x7fc98c0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- 172.21.15.84:0/2528009003 shutdown_connections 2024-03-07T07:32:18.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- 172.21.15.84:0/2528009003 wait complete. 2024-03-07T07:32:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 Processor -- start 2024-03-07T07:32:18.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- start start 2024-03-07T07:32:18.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c0b3a00 0x7fc98c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c0cf100 0x7fc98c0b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c15c1f0 0x7fc98c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c168ce0 con 0x7fc98c15c1f0 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0aff40 con 0x7fc98c0cf100 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc990a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c168e60 con 0x7fc98c0b3a00 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc98a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c15c1f0 0x7fc98c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc98a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c15c1f0 0x7fc98c0b77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44642/0 (socket says 172.21.15.84:44642) 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc98a800640 1 -- 172.21.15.84:0/2006871713 learned_addr learned my addr 172.21.15.84:0/2006871713 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc98a800640 1 -- 172.21.15.84:0/2006871713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c0b3a00 msgr2=0x7fc98c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc98a800640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c0b3a00 0x7fc98c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc98a800640 1 -- 172.21.15.84:0/2006871713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c0cf100 msgr2=0x7fc98c0b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc98a800640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c0cf100 0x7fc98c0b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.533+0000 7fc98a800640 1 -- 172.21.15.84:0/2006871713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c153340 con 0x7fc98c15c1f0 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc98a800640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c15c1f0 0x7fc98c0b77e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9840b0040 tx=0x7fc9840195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:18.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc982000640 1 -- 172.21.15.84:0/2006871713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840b2050 con 0x7fc98c15c1f0 2024-03-07T07:32:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc982000640 1 -- 172.21.15.84:0/2006871713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9840be070 con 0x7fc98c15c1f0 2024-03-07T07:32:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c153620 con 0x7fc98c15c1f0 2024-03-07T07:32:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc982000640 1 -- 172.21.15.84:0/2006871713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984009450 con 0x7fc98c15c1f0 2024-03-07T07:32:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c153be0 con 0x7fc98c15c1f0 2024-03-07T07:32:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c062d40 con 0x7fc98c15c1f0 2024-03-07T07:32:18.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc982000640 1 -- 172.21.15.84:0/2006871713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc984004240 con 0x7fc98c15c1f0 2024-03-07T07:32:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc982000640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc96c066f60 0x7fc96c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc982000640 1 -- 172.21.15.84:0/2006871713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc98411fee0 con 0x7fc98c15c1f0 2024-03-07T07:32:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.537+0000 7fc989e00640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc96c066f60 0x7fc96c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.541+0000 7fc989e00640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc96c066f60 0x7fc96c069420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc97c006e90 tx=0x7fc97c006de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:18.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.549+0000 7fc982000640 1 -- 172.21.15.84:0/2006871713 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc9840c8020 con 0x7fc98c15c1f0 2024-03-07T07:32:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.701+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc98c06bc20 con 0x7fc96c066f60 2024-03-07T07:32:18.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.713+0000 7fc982000640 1 -- 172.21.15.84:0/2006871713 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251931 (secure 0 0 0) 0x7fc98c06bc20 con 0x7fc96c066f60 2024-03-07T07:32:18.717 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:18.719 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc96c066f60 msgr2=0x7fc96c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc96c066f60 0x7fc96c069420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc97c006e90 tx=0x7fc97c006de0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c15c1f0 msgr2=0x7fc98c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c15c1f0 0x7fc98c0b77e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9840b0040 tx=0x7fc9840195a0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 shutdown_connections 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc96c066f60 0x7fc96c069420 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98c15c1f0 0x7fc98c0b77e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c0cf100 0x7fc98c0b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 --2- 172.21.15.84:0/2006871713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc98c0b3a00 0x7fc98c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 >> 172.21.15.84:0/2006871713 conn(0x7fc98c0b1ed0 msgr2=0x7fc98c0b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:18.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 shutdown_connections 2024-03-07T07:32:18.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.717+0000 7fc990a00640 1 -- 172.21.15.84:0/2006871713 wait complete. 2024-03-07T07:32:18.738 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-03-07T07:32:16.891577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220352,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754368,"statfs":{"total":773094113280,"available":772868472832,"internally_reserved":0,"allocated":4268032,"data_stored":2367276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001355"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720575+0000","last_change":"2024-03-07T07:32:09.730012+0000","last_active":"2024-03-07T07:32:10.720575+0000","last_peered":"2024-03-07T07:32:10.720575+0000","last_clean":"2024-03-07T07:32:10.720575+0000","last_became_active":"2024-03-07T07:32:09.729740+0000","last_became_peered":"2024-03-07T07:32:09.729740+0000","last_unstale":"2024-03-07T07:32:10.720575+0000","last_undegraded":"2024-03-07T07:32:10.720575+0000","last_fullsized":"2024-03-07T07:32:10.720575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:41:20.787479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738205+0000","last_change":"2024-03-07T07:32:09.751991+0000","last_active":"2024-03-07T07:32:10.738205+0000","last_peered":"2024-03-07T07:32:10.738205+0000","last_clean":"2024-03-07T07:32:10.738205+0000","last_became_active":"2024-03-07T07:32:09.751560+0000","last_became_peered":"2024-03-07T07:32:09.751560+0000","last_unstale":"2024-03-07T07:32:10.738205+0000","last_undegraded":"2024-03-07T07:32:10.738205+0000","last_fullsized":"2024-03-07T07:32:10.738205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:18.598342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954516+0000","last_change":"2024-03-07T07:32:09.741223+0000","last_active":"2024-03-07T07:32:10.954516+0000","last_peered":"2024-03-07T07:32:10.954516+0000","last_clean":"2024-03-07T07:32:10.954516+0000","last_became_active":"2024-03-07T07:32:09.740812+0000","last_became_peered":"2024-03-07T07:32:09.740812+0000","last_unstale":"2024-03-07T07:32:10.954516+0000","last_undegraded":"2024-03-07T07:32:10.954516+0000","last_fullsized":"2024-03-07T07:32:10.954516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:23:54.639152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720842+0000","last_change":"2024-03-07T07:32:09.731679+0000","last_active":"2024-03-07T07:32:10.720842+0000","last_peered":"2024-03-07T07:32:10.720842+0000","last_clean":"2024-03-07T07:32:10.720842+0000","last_became_active":"2024-03-07T07:32:09.730404+0000","last_became_peered":"2024-03-07T07:32:09.730404+0000","last_unstale":"2024-03-07T07:32:10.720842+0000","last_undegraded":"2024-03-07T07:32:10.720842+0000","last_fullsized":"2024-03-07T07:32:10.720842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:46.835153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.737860+0000","last_change":"2024-03-07T07:32:09.738081+0000","last_active":"2024-03-07T07:32:10.737860+0000","last_peered":"2024-03-07T07:32:10.737860+0000","last_clean":"2024-03-07T07:32:10.737860+0000","last_became_active":"2024-03-07T07:32:09.737682+0000","last_became_peered":"2024-03-07T07:32:09.737682+0000","last_unstale":"2024-03-07T07:32:10.737860+0000","last_undegraded":"2024-03-07T07:32:10.737860+0000","last_fullsized":"2024-03-07T07:32:10.737860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:53:15.103011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741030+0000","last_change":"2024-03-07T07:32:09.736939+0000","last_active":"2024-03-07T07:32:10.741030+0000","last_peered":"2024-03-07T07:32:10.741030+0000","last_clean":"2024-03-07T07:32:10.741030+0000","last_became_active":"2024-03-07T07:32:09.736639+0000","last_became_peered":"2024-03-07T07:32:09.736639+0000","last_unstale":"2024-03-07T07:32:10.741030+0000","last_undegraded":"2024-03-07T07:32:10.741030+0000","last_fullsized":"2024-03-07T07:32:10.741030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:15.790026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719901+0000","last_change":"2024-03-07T07:32:09.745334+0000","last_active":"2024-03-07T07:32:10.719901+0000","last_peered":"2024-03-07T07:32:10.719901+0000","last_clean":"2024-03-07T07:32:10.719901+0000","last_became_active":"2024-03-07T07:32:09.745084+0000","last_became_peered":"2024-03-07T07:32:09.745084+0000","last_unstale":"2024-03-07T07:32:10.719901+0000","last_undegraded":"2024-03-07T07:32:10.719901+0000","last_fullsized":"2024-03-07T07:32:10.719901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:53:15.103011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719834+0000","last_change":"2024-03-07T07:32:09.736538+0000","last_active":"2024-03-07T07:32:10.719834+0000","last_peered":"2024-03-07T07:32:10.719834+0000","last_clean":"2024-03-07T07:32:10.719834+0000","last_became_active":"2024-03-07T07:32:09.736186+0000","last_became_peered":"2024-03-07T07:32:09.736186+0000","last_unstale":"2024-03-07T07:32:10.719834+0000","last_undegraded":"2024-03-07T07:32:10.719834+0000","last_fullsized":"2024-03-07T07:32:10.719834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:11.731988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955370+0000","last_change":"2024-03-07T07:32:09.744105+0000","last_active":"2024-03-07T07:32:10.955370+0000","last_peered":"2024-03-07T07:32:10.955370+0000","last_clean":"2024-03-07T07:32:10.955370+0000","last_became_active":"2024-03-07T07:32:09.743854+0000","last_became_peered":"2024-03-07T07:32:09.743854+0000","last_unstale":"2024-03-07T07:32:10.955370+0000","last_undegraded":"2024-03-07T07:32:10.955370+0000","last_fullsized":"2024-03-07T07:32:10.955370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:27.999230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720705+0000","last_change":"2024-03-07T07:32:09.741258+0000","last_active":"2024-03-07T07:32:10.720705+0000","last_peered":"2024-03-07T07:32:10.720705+0000","last_clean":"2024-03-07T07:32:10.720705+0000","last_became_active":"2024-03-07T07:32:09.740973+0000","last_became_peered":"2024-03-07T07:32:09.740973+0000","last_unstale":"2024-03-07T07:32:10.720705+0000","last_undegraded":"2024-03-07T07:32:10.720705+0000","last_fullsized":"2024-03-07T07:32:10.720705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:42:04.100114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954848+0000","last_change":"2024-03-07T07:32:09.729434+0000","last_active":"2024-03-07T07:32:10.954848+0000","last_peered":"2024-03-07T07:32:10.954848+0000","last_clean":"2024-03-07T07:32:10.954848+0000","last_became_active":"2024-03-07T07:32:09.728932+0000","last_became_peered":"2024-03-07T07:32:09.728932+0000","last_unstale":"2024-03-07T07:32:10.954848+0000","last_undegraded":"2024-03-07T07:32:10.954848+0000","last_fullsized":"2024-03-07T07:32:10.954848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:34:24.174562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955116+0000","last_change":"2024-03-07T07:32:09.742631+0000","last_active":"2024-03-07T07:32:10.955116+0000","last_peered":"2024-03-07T07:32:10.955116+0000","last_clean":"2024-03-07T07:32:10.955116+0000","last_became_active":"2024-03-07T07:32:09.740785+0000","last_became_peered":"2024-03-07T07:32:09.740785+0000","last_unstale":"2024-03-07T07:32:10.955116+0000","last_undegraded":"2024-03-07T07:32:10.955116+0000","last_fullsized":"2024-03-07T07:32:10.955116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:03.295747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954828+0000","last_change":"2024-03-07T07:32:09.735005+0000","last_active":"2024-03-07T07:32:10.954828+0000","last_peered":"2024-03-07T07:32:10.954828+0000","last_clean":"2024-03-07T07:32:10.954828+0000","last_became_active":"2024-03-07T07:32:09.734422+0000","last_became_peered":"2024-03-07T07:32:09.734422+0000","last_unstale":"2024-03-07T07:32:10.954828+0000","last_undegraded":"2024-03-07T07:32:10.954828+0000","last_fullsized":"2024-03-07T07:32:10.954828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:28:50.769300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720794+0000","last_change":"2024-03-07T07:32:09.741208+0000","last_active":"2024-03-07T07:32:10.720794+0000","last_peered":"2024-03-07T07:32:10.720794+0000","last_clean":"2024-03-07T07:32:10.720794+0000","last_became_active":"2024-03-07T07:32:09.740919+0000","last_became_peered":"2024-03-07T07:32:09.740919+0000","last_unstale":"2024-03-07T07:32:10.720794+0000","last_undegraded":"2024-03-07T07:32:10.720794+0000","last_fullsized":"2024-03-07T07:32:10.720794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:40:21.118189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.716486+0000","last_change":"2024-03-07T07:32:09.727701+0000","last_active":"2024-03-07T07:32:10.716486+0000","last_peered":"2024-03-07T07:32:10.716486+0000","last_clean":"2024-03-07T07:32:10.716486+0000","last_became_active":"2024-03-07T07:32:09.727424+0000","last_became_peered":"2024-03-07T07:32:09.727424+0000","last_unstale":"2024-03-07T07:32:10.716486+0000","last_undegraded":"2024-03-07T07:32:10.716486+0000","last_fullsized":"2024-03-07T07:32:10.716486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:11.731988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.716474+0000","last_change":"2024-03-07T07:32:09.732094+0000","last_active":"2024-03-07T07:32:10.716474+0000","last_peered":"2024-03-07T07:32:10.716474+0000","last_clean":"2024-03-07T07:32:10.716474+0000","last_became_active":"2024-03-07T07:32:09.731685+0000","last_became_peered":"2024-03-07T07:32:09.731685+0000","last_unstale":"2024-03-07T07:32:10.716474+0000","last_undegraded":"2024-03-07T07:32:10.716474+0000","last_fullsized":"2024-03-07T07:32:10.716474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:44.220844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955141+0000","last_change":"2024-03-07T07:32:09.733381+0000","last_active":"2024-03-07T07:32:10.955141+0000","last_peered":"2024-03-07T07:32:10.955141+0000","last_clean":"2024-03-07T07:32:10.955141+0000","last_became_active":"2024-03-07T07:32:09.733061+0000","last_became_peered":"2024-03-07T07:32:09.733061+0000","last_unstale":"2024-03-07T07:32:10.955141+0000","last_undegraded":"2024-03-07T07:32:10.955141+0000","last_fullsized":"2024-03-07T07:32:10.955141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:26:25.406969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741422+0000","last_change":"2024-03-07T07:32:09.737756+0000","last_active":"2024-03-07T07:32:10.741422+0000","last_peered":"2024-03-07T07:32:10.741422+0000","last_clean":"2024-03-07T07:32:10.741422+0000","last_became_active":"2024-03-07T07:32:09.737480+0000","last_became_peered":"2024-03-07T07:32:09.737480+0000","last_unstale":"2024-03-07T07:32:10.741422+0000","last_undegraded":"2024-03-07T07:32:10.741422+0000","last_fullsized":"2024-03-07T07:32:10.741422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:44:21.013212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741300+0000","last_change":"2024-03-07T07:32:09.748535+0000","last_active":"2024-03-07T07:32:10.741300+0000","last_peered":"2024-03-07T07:32:10.741300+0000","last_clean":"2024-03-07T07:32:10.741300+0000","last_became_active":"2024-03-07T07:32:09.748275+0000","last_became_peered":"2024-03-07T07:32:09.748275+0000","last_unstale":"2024-03-07T07:32:10.741300+0000","last_undegraded":"2024-03-07T07:32:10.741300+0000","last_fullsized":"2024-03-07T07:32:10.741300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:47.428345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954828+0000","last_change":"2024-03-07T07:32:09.737919+0000","last_active":"2024-03-07T07:32:10.954828+0000","last_peered":"2024-03-07T07:32:10.954828+0000","last_clean":"2024-03-07T07:32:10.954828+0000","last_became_active":"2024-03-07T07:32:09.737568+0000","last_became_peered":"2024-03-07T07:32:09.737568+0000","last_unstale":"2024-03-07T07:32:10.954828+0000","last_undegraded":"2024-03-07T07:32:10.954828+0000","last_fullsized":"2024-03-07T07:32:10.954828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:13:20.079214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.716720+0000","last_change":"2024-03-07T07:32:09.733151+0000","last_active":"2024-03-07T07:32:10.716720+0000","last_peered":"2024-03-07T07:32:10.716720+0000","last_clean":"2024-03-07T07:32:10.716720+0000","last_became_active":"2024-03-07T07:32:09.732916+0000","last_became_peered":"2024-03-07T07:32:09.732916+0000","last_unstale":"2024-03-07T07:32:10.716720+0000","last_undegraded":"2024-03-07T07:32:10.716720+0000","last_fullsized":"2024-03-07T07:32:10.716720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:55:29.714693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719936+0000","last_change":"2024-03-07T07:32:09.729634+0000","last_active":"2024-03-07T07:32:10.719936+0000","last_peered":"2024-03-07T07:32:10.719936+0000","last_clean":"2024-03-07T07:32:10.719936+0000","last_became_active":"2024-03-07T07:32:09.729365+0000","last_became_peered":"2024-03-07T07:32:09.729365+0000","last_unstale":"2024-03-07T07:32:10.719936+0000","last_undegraded":"2024-03-07T07:32:10.719936+0000","last_fullsized":"2024-03-07T07:32:10.719936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:55:29.714693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954563+0000","last_change":"2024-03-07T07:32:09.749518+0000","last_active":"2024-03-07T07:32:10.954563+0000","last_peered":"2024-03-07T07:32:10.954563+0000","last_clean":"2024-03-07T07:32:10.954563+0000","last_became_active":"2024-03-07T07:32:09.749193+0000","last_became_peered":"2024-03-07T07:32:09.749193+0000","last_unstale":"2024-03-07T07:32:10.954563+0000","last_undegraded":"2024-03-07T07:32:10.954563+0000","last_fullsized":"2024-03-07T07:32:10.954563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:43:57.558786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719818+0000","last_change":"2024-03-07T07:32:09.743716+0000","last_active":"2024-03-07T07:32:10.719818+0000","last_peered":"2024-03-07T07:32:10.719818+0000","last_clean":"2024-03-07T07:32:10.719818+0000","last_became_active":"2024-03-07T07:32:09.743472+0000","last_became_peered":"2024-03-07T07:32:09.743472+0000","last_unstale":"2024-03-07T07:32:10.719818+0000","last_undegraded":"2024-03-07T07:32:10.719818+0000","last_fullsized":"2024-03-07T07:32:10.719818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:44.220844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720912+0000","last_change":"2024-03-07T07:32:09.729570+0000","last_active":"2024-03-07T07:32:10.720912+0000","last_peered":"2024-03-07T07:32:10.720912+0000","last_clean":"2024-03-07T07:32:10.720912+0000","last_became_active":"2024-03-07T07:32:09.729298+0000","last_became_peered":"2024-03-07T07:32:09.729298+0000","last_unstale":"2024-03-07T07:32:10.720912+0000","last_undegraded":"2024-03-07T07:32:10.720912+0000","last_fullsized":"2024-03-07T07:32:10.720912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:49:36.169423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720812+0000","last_change":"2024-03-07T07:32:09.745412+0000","last_active":"2024-03-07T07:32:10.720812+0000","last_peered":"2024-03-07T07:32:10.720812+0000","last_clean":"2024-03-07T07:32:10.720812+0000","last_became_active":"2024-03-07T07:32:09.745165+0000","last_became_peered":"2024-03-07T07:32:09.745165+0000","last_unstale":"2024-03-07T07:32:10.720812+0000","last_undegraded":"2024-03-07T07:32:10.720812+0000","last_fullsized":"2024-03-07T07:32:10.720812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:35.756378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738227+0000","last_change":"2024-03-07T07:32:09.735870+0000","last_active":"2024-03-07T07:32:10.738227+0000","last_peered":"2024-03-07T07:32:10.738227+0000","last_clean":"2024-03-07T07:32:10.738227+0000","last_became_active":"2024-03-07T07:32:09.735573+0000","last_became_peered":"2024-03-07T07:32:09.735573+0000","last_unstale":"2024-03-07T07:32:10.738227+0000","last_undegraded":"2024-03-07T07:32:10.738227+0000","last_fullsized":"2024-03-07T07:32:10.738227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:58.936914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720198+0000","last_change":"2024-03-07T07:32:09.737554+0000","last_active":"2024-03-07T07:32:10.720198+0000","last_peered":"2024-03-07T07:32:10.720198+0000","last_clean":"2024-03-07T07:32:10.720198+0000","last_became_active":"2024-03-07T07:32:09.736203+0000","last_became_peered":"2024-03-07T07:32:09.736203+0000","last_unstale":"2024-03-07T07:32:10.720198+0000","last_undegraded":"2024-03-07T07:32:10.720198+0000","last_fullsized":"2024-03-07T07:32:10.720198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:18.598342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.716839+0000","last_change":"2024-03-07T07:32:09.732781+0000","last_active":"2024-03-07T07:32:10.716839+0000","last_peered":"2024-03-07T07:32:10.716839+0000","last_clean":"2024-03-07T07:32:10.716839+0000","last_became_active":"2024-03-07T07:32:09.732522+0000","last_became_peered":"2024-03-07T07:32:09.732522+0000","last_unstale":"2024-03-07T07:32:10.716839+0000","last_undegraded":"2024-03-07T07:32:10.716839+0000","last_fullsized":"2024-03-07T07:32:10.716839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:18.598342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.716587+0000","last_change":"2024-03-07T07:32:09.733989+0000","last_active":"2024-03-07T07:32:10.716587+0000","last_peered":"2024-03-07T07:32:10.716587+0000","last_clean":"2024-03-07T07:32:10.716587+0000","last_became_active":"2024-03-07T07:32:09.733697+0000","last_became_peered":"2024-03-07T07:32:09.733697+0000","last_unstale":"2024-03-07T07:32:10.716587+0000","last_undegraded":"2024-03-07T07:32:10.716587+0000","last_fullsized":"2024-03-07T07:32:10.716587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:10:33.308129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719893+0000","last_change":"2024-03-07T07:32:09.737262+0000","last_active":"2024-03-07T07:32:10.719893+0000","last_peered":"2024-03-07T07:32:10.719893+0000","last_clean":"2024-03-07T07:32:10.719893+0000","last_became_active":"2024-03-07T07:32:09.734562+0000","last_became_peered":"2024-03-07T07:32:09.734562+0000","last_unstale":"2024-03-07T07:32:10.719893+0000","last_undegraded":"2024-03-07T07:32:10.719893+0000","last_fullsized":"2024-03-07T07:32:10.719893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:10:33.308129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954795+0000","last_change":"2024-03-07T07:32:09.720498+0000","last_active":"2024-03-07T07:32:10.954795+0000","last_peered":"2024-03-07T07:32:10.954795+0000","last_clean":"2024-03-07T07:32:10.954795+0000","last_became_active":"2024-03-07T07:32:09.720213+0000","last_became_peered":"2024-03-07T07:32:09.720213+0000","last_unstale":"2024-03-07T07:32:10.954795+0000","last_undegraded":"2024-03-07T07:32:10.954795+0000","last_fullsized":"2024-03-07T07:32:10.954795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.056605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955092+0000","last_change":"2024-03-07T07:32:09.741138+0000","last_active":"2024-03-07T07:32:10.955092+0000","last_peered":"2024-03-07T07:32:10.955092+0000","last_clean":"2024-03-07T07:32:10.955092+0000","last_became_active":"2024-03-07T07:32:09.740822+0000","last_became_peered":"2024-03-07T07:32:09.740822+0000","last_unstale":"2024-03-07T07:32:10.955092+0000","last_undegraded":"2024-03-07T07:32:10.955092+0000","last_fullsized":"2024-03-07T07:32:10.955092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:29:17.077153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955356+0000","last_change":"2024-03-07T07:32:08.727746+0000","last_active":"2024-03-07T07:32:10.955356+0000","last_peered":"2024-03-07T07:32:10.955356+0000","last_clean":"2024-03-07T07:32:10.955356+0000","last_became_active":"2024-03-07T07:32:08.726860+0000","last_became_peered":"2024-03-07T07:32:08.726860+0000","last_unstale":"2024-03-07T07:32:10.955356+0000","last_undegraded":"2024-03-07T07:32:10.955356+0000","last_fullsized":"2024-03-07T07:32:10.955356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:41:19.781917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720604+0000","last_change":"2024-03-07T07:32:09.740174+0000","last_active":"2024-03-07T07:32:10.720604+0000","last_peered":"2024-03-07T07:32:10.720604+0000","last_clean":"2024-03-07T07:32:10.720604+0000","last_became_active":"2024-03-07T07:32:09.739811+0000","last_became_peered":"2024-03-07T07:32:09.739811+0000","last_unstale":"2024-03-07T07:32:10.720604+0000","last_undegraded":"2024-03-07T07:32:10.720604+0000","last_fullsized":"2024-03-07T07:32:10.720604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:56.867331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720858+0000","last_change":"2024-03-07T07:32:08.724895+0000","last_active":"2024-03-07T07:32:10.720858+0000","last_peered":"2024-03-07T07:32:10.720858+0000","last_clean":"2024-03-07T07:32:10.720858+0000","last_became_active":"2024-03-07T07:32:08.724609+0000","last_became_peered":"2024-03-07T07:32:08.724609+0000","last_unstale":"2024-03-07T07:32:10.720858+0000","last_undegraded":"2024-03-07T07:32:10.720858+0000","last_fullsized":"2024-03-07T07:32:10.720858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:31:40.974018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720259+0000","last_change":"2024-03-07T07:32:09.742029+0000","last_active":"2024-03-07T07:32:10.720259+0000","last_peered":"2024-03-07T07:32:10.720259+0000","last_clean":"2024-03-07T07:32:10.720259+0000","last_became_active":"2024-03-07T07:32:09.741612+0000","last_became_peered":"2024-03-07T07:32:09.741612+0000","last_unstale":"2024-03-07T07:32:10.720259+0000","last_undegraded":"2024-03-07T07:32:10.720259+0000","last_fullsized":"2024-03-07T07:32:10.720259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:58.936914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741418+0000","last_change":"2024-03-07T07:32:08.728713+0000","last_active":"2024-03-07T07:32:10.741418+0000","last_peered":"2024-03-07T07:32:10.741418+0000","last_clean":"2024-03-07T07:32:10.741418+0000","last_became_active":"2024-03-07T07:32:08.728291+0000","last_became_peered":"2024-03-07T07:32:08.728291+0000","last_unstale":"2024-03-07T07:32:10.741418+0000","last_undegraded":"2024-03-07T07:32:10.741418+0000","last_fullsized":"2024-03-07T07:32:10.741418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:01:13.628528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720600+0000","last_change":"2024-03-07T07:32:09.732104+0000","last_active":"2024-03-07T07:32:10.720600+0000","last_peered":"2024-03-07T07:32:10.720600+0000","last_clean":"2024-03-07T07:32:10.720600+0000","last_became_active":"2024-03-07T07:32:09.731793+0000","last_became_peered":"2024-03-07T07:32:09.731793+0000","last_unstale":"2024-03-07T07:32:10.720600+0000","last_undegraded":"2024-03-07T07:32:10.720600+0000","last_fullsized":"2024-03-07T07:32:10.720600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:33.195769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.721004+0000","last_change":"2024-03-07T07:32:08.717295+0000","last_active":"2024-03-07T07:32:10.721004+0000","last_peered":"2024-03-07T07:32:10.721004+0000","last_clean":"2024-03-07T07:32:10.721004+0000","last_became_active":"2024-03-07T07:32:08.715284+0000","last_became_peered":"2024-03-07T07:32:08.715284+0000","last_unstale":"2024-03-07T07:32:10.721004+0000","last_undegraded":"2024-03-07T07:32:10.721004+0000","last_fullsized":"2024-03-07T07:32:10.721004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:51:45.177383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955237+0000","last_change":"2024-03-07T07:32:09.742100+0000","last_active":"2024-03-07T07:32:10.955237+0000","last_peered":"2024-03-07T07:32:10.955237+0000","last_clean":"2024-03-07T07:32:10.955237+0000","last_became_active":"2024-03-07T07:32:09.741769+0000","last_became_peered":"2024-03-07T07:32:09.741769+0000","last_unstale":"2024-03-07T07:32:10.955237+0000","last_undegraded":"2024-03-07T07:32:10.955237+0000","last_fullsized":"2024-03-07T07:32:10.955237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:15.790026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720360+0000","last_change":"2024-03-07T07:32:08.724105+0000","last_active":"2024-03-07T07:32:10.720360+0000","last_peered":"2024-03-07T07:32:10.720360+0000","last_clean":"2024-03-07T07:32:10.720360+0000","last_became_active":"2024-03-07T07:32:08.723796+0000","last_became_peered":"2024-03-07T07:32:08.723796+0000","last_unstale":"2024-03-07T07:32:10.720360+0000","last_undegraded":"2024-03-07T07:32:10.720360+0000","last_fullsized":"2024-03-07T07:32:10.720360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:09.647569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720413+0000","last_change":"2024-03-07T07:32:09.736758+0000","last_active":"2024-03-07T07:32:10.720413+0000","last_peered":"2024-03-07T07:32:10.720413+0000","last_clean":"2024-03-07T07:32:10.720413+0000","last_became_active":"2024-03-07T07:32:09.736405+0000","last_became_peered":"2024-03-07T07:32:09.736405+0000","last_unstale":"2024-03-07T07:32:10.720413+0000","last_undegraded":"2024-03-07T07:32:10.720413+0000","last_fullsized":"2024-03-07T07:32:10.720413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:41:44.323669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719962+0000","last_change":"2024-03-07T07:32:08.725455+0000","last_active":"2024-03-07T07:32:10.719962+0000","last_peered":"2024-03-07T07:32:10.719962+0000","last_clean":"2024-03-07T07:32:10.719962+0000","last_became_active":"2024-03-07T07:32:08.721591+0000","last_became_peered":"2024-03-07T07:32:08.721591+0000","last_unstale":"2024-03-07T07:32:10.719962+0000","last_undegraded":"2024-03-07T07:32:10.719962+0000","last_fullsized":"2024-03-07T07:32:10.719962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:14:23.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954229+0000","last_change":"2024-03-07T07:32:09.743365+0000","last_active":"2024-03-07T07:32:10.954229+0000","last_peered":"2024-03-07T07:32:10.954229+0000","last_clean":"2024-03-07T07:32:10.954229+0000","last_became_active":"2024-03-07T07:32:09.743117+0000","last_became_peered":"2024-03-07T07:32:09.743117+0000","last_unstale":"2024-03-07T07:32:10.954229+0000","last_undegraded":"2024-03-07T07:32:10.954229+0000","last_fullsized":"2024-03-07T07:32:10.954229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:44.362452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741062+0000","last_change":"2024-03-07T07:32:08.722719+0000","last_active":"2024-03-07T07:32:10.741062+0000","last_peered":"2024-03-07T07:32:10.741062+0000","last_clean":"2024-03-07T07:32:10.741062+0000","last_became_active":"2024-03-07T07:32:08.722402+0000","last_became_peered":"2024-03-07T07:32:08.722402+0000","last_unstale":"2024-03-07T07:32:10.741062+0000","last_undegraded":"2024-03-07T07:32:10.741062+0000","last_fullsized":"2024-03-07T07:32:10.741062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:05.619568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720043+0000","last_change":"2024-03-07T07:32:09.730779+0000","last_active":"2024-03-07T07:32:10.720043+0000","last_peered":"2024-03-07T07:32:10.720043+0000","last_clean":"2024-03-07T07:32:10.720043+0000","last_became_active":"2024-03-07T07:32:09.728743+0000","last_became_peered":"2024-03-07T07:32:09.728743+0000","last_unstale":"2024-03-07T07:32:10.720043+0000","last_undegraded":"2024-03-07T07:32:10.720043+0000","last_fullsized":"2024-03-07T07:32:10.720043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:25:43.937006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719959+0000","last_change":"2024-03-07T07:32:08.717797+0000","last_active":"2024-03-07T07:32:10.719959+0000","last_peered":"2024-03-07T07:32:10.719959+0000","last_clean":"2024-03-07T07:32:10.719959+0000","last_became_active":"2024-03-07T07:32:08.717520+0000","last_became_peered":"2024-03-07T07:32:08.717520+0000","last_unstale":"2024-03-07T07:32:10.719959+0000","last_undegraded":"2024-03-07T07:32:10.719959+0000","last_fullsized":"2024-03-07T07:32:10.719959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:02.290184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954587+0000","last_change":"2024-03-07T07:32:09.738676+0000","last_active":"2024-03-07T07:32:10.954587+0000","last_peered":"2024-03-07T07:32:10.954587+0000","last_clean":"2024-03-07T07:32:10.954587+0000","last_became_active":"2024-03-07T07:32:09.738382+0000","last_became_peered":"2024-03-07T07:32:09.738382+0000","last_unstale":"2024-03-07T07:32:10.954587+0000","last_undegraded":"2024-03-07T07:32:10.954587+0000","last_fullsized":"2024-03-07T07:32:10.954587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:58:39.836337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738361+0000","last_change":"2024-03-07T07:32:08.725251+0000","last_active":"2024-03-07T07:32:10.738361+0000","last_peered":"2024-03-07T07:32:10.738361+0000","last_clean":"2024-03-07T07:32:10.738361+0000","last_became_active":"2024-03-07T07:32:08.724921+0000","last_became_peered":"2024-03-07T07:32:08.724921+0000","last_unstale":"2024-03-07T07:32:10.738361+0000","last_undegraded":"2024-03-07T07:32:10.738361+0000","last_fullsized":"2024-03-07T07:32:10.738361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:58:03.797461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720989+0000","last_change":"2024-03-07T07:32:09.742287+0000","last_active":"2024-03-07T07:32:10.720989+0000","last_peered":"2024-03-07T07:32:10.720989+0000","last_clean":"2024-03-07T07:32:10.720989+0000","last_became_active":"2024-03-07T07:32:09.741986+0000","last_became_peered":"2024-03-07T07:32:09.741986+0000","last_unstale":"2024-03-07T07:32:10.720989+0000","last_undegraded":"2024-03-07T07:32:10.720989+0000","last_fullsized":"2024-03-07T07:32:10.720989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:32:09.374983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738200+0000","last_change":"2024-03-07T07:32:08.729316+0000","last_active":"2024-03-07T07:32:10.738200+0000","last_peered":"2024-03-07T07:32:10.738200+0000","last_clean":"2024-03-07T07:32:10.738200+0000","last_became_active":"2024-03-07T07:32:08.729021+0000","last_became_peered":"2024-03-07T07:32:08.729021+0000","last_unstale":"2024-03-07T07:32:10.738200+0000","last_undegraded":"2024-03-07T07:32:10.738200+0000","last_fullsized":"2024-03-07T07:32:10.738200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:59:14.857977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720752+0000","last_change":"2024-03-07T07:32:09.731296+0000","last_active":"2024-03-07T07:32:10.720752+0000","last_peered":"2024-03-07T07:32:10.720752+0000","last_clean":"2024-03-07T07:32:10.720752+0000","last_became_active":"2024-03-07T07:32:09.729898+0000","last_became_peered":"2024-03-07T07:32:09.729898+0000","last_unstale":"2024-03-07T07:32:10.720752+0000","last_undegraded":"2024-03-07T07:32:10.720752+0000","last_fullsized":"2024-03-07T07:32:10.720752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:34:59.725800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954761+0000","last_change":"2024-03-07T07:32:08.717596+0000","last_active":"2024-03-07T07:32:10.954761+0000","last_peered":"2024-03-07T07:32:10.954761+0000","last_clean":"2024-03-07T07:32:10.954761+0000","last_became_active":"2024-03-07T07:32:08.716657+0000","last_became_peered":"2024-03-07T07:32:08.716657+0000","last_unstale":"2024-03-07T07:32:10.954761+0000","last_undegraded":"2024-03-07T07:32:10.954761+0000","last_fullsized":"2024-03-07T07:32:10.954761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:19:17.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954700+0000","last_change":"2024-03-07T07:32:09.729099+0000","last_active":"2024-03-07T07:32:10.954700+0000","last_peered":"2024-03-07T07:32:10.954700+0000","last_clean":"2024-03-07T07:32:10.954700+0000","last_became_active":"2024-03-07T07:32:09.728580+0000","last_became_peered":"2024-03-07T07:32:09.728580+0000","last_unstale":"2024-03-07T07:32:10.954700+0000","last_undegraded":"2024-03-07T07:32:10.954700+0000","last_fullsized":"2024-03-07T07:32:10.954700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:00:29.298638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954897+0000","last_change":"2024-03-07T07:32:08.719544+0000","last_active":"2024-03-07T07:32:10.954897+0000","last_peered":"2024-03-07T07:32:10.954897+0000","last_clean":"2024-03-07T07:32:10.954897+0000","last_became_active":"2024-03-07T07:32:08.719222+0000","last_became_peered":"2024-03-07T07:32:08.719222+0000","last_unstale":"2024-03-07T07:32:10.954897+0000","last_undegraded":"2024-03-07T07:32:10.954897+0000","last_fullsized":"2024-03-07T07:32:10.954897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:46:28.182896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954557+0000","last_change":"2024-03-07T07:32:09.743032+0000","last_active":"2024-03-07T07:32:10.954557+0000","last_peered":"2024-03-07T07:32:10.954557+0000","last_clean":"2024-03-07T07:32:10.954557+0000","last_became_active":"2024-03-07T07:32:09.742660+0000","last_became_peered":"2024-03-07T07:32:09.742660+0000","last_unstale":"2024-03-07T07:32:10.954557+0000","last_undegraded":"2024-03-07T07:32:10.954557+0000","last_fullsized":"2024-03-07T07:32:10.954557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:45:20.713770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720413+0000","last_change":"2024-03-07T07:32:08.714266+0000","last_active":"2024-03-07T07:32:10.720413+0000","last_peered":"2024-03-07T07:32:10.720413+0000","last_clean":"2024-03-07T07:32:10.720413+0000","last_became_active":"2024-03-07T07:32:08.713142+0000","last_became_peered":"2024-03-07T07:32:08.713142+0000","last_unstale":"2024-03-07T07:32:10.720413+0000","last_undegraded":"2024-03-07T07:32:10.720413+0000","last_fullsized":"2024-03-07T07:32:10.720413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:23:53.633589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720599+0000","last_change":"2024-03-07T07:32:09.745013+0000","last_active":"2024-03-07T07:32:10.720599+0000","last_peered":"2024-03-07T07:32:10.720599+0000","last_clean":"2024-03-07T07:32:10.720599+0000","last_became_active":"2024-03-07T07:32:09.744437+0000","last_became_peered":"2024-03-07T07:32:09.744437+0000","last_unstale":"2024-03-07T07:32:10.720599+0000","last_undegraded":"2024-03-07T07:32:10.720599+0000","last_fullsized":"2024-03-07T07:32:10.720599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:26:02.360585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720717+0000","last_change":"2024-03-07T07:32:08.717609+0000","last_active":"2024-03-07T07:32:10.720717+0000","last_peered":"2024-03-07T07:32:10.720717+0000","last_clean":"2024-03-07T07:32:10.720717+0000","last_became_active":"2024-03-07T07:32:08.717250+0000","last_became_peered":"2024-03-07T07:32:08.717250+0000","last_unstale":"2024-03-07T07:32:10.720717+0000","last_undegraded":"2024-03-07T07:32:10.720717+0000","last_fullsized":"2024-03-07T07:32:10.720717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:13:04.006716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719981+0000","last_change":"2024-03-07T07:32:09.747488+0000","last_active":"2024-03-07T07:32:10.719981+0000","last_peered":"2024-03-07T07:32:10.719981+0000","last_clean":"2024-03-07T07:32:10.719981+0000","last_became_active":"2024-03-07T07:32:09.747152+0000","last_became_peered":"2024-03-07T07:32:09.747152+0000","last_unstale":"2024-03-07T07:32:10.719981+0000","last_undegraded":"2024-03-07T07:32:10.719981+0000","last_fullsized":"2024-03-07T07:32:10.719981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:21.839830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719964+0000","last_change":"2024-03-07T07:32:08.719257+0000","last_active":"2024-03-07T07:32:10.719964+0000","last_peered":"2024-03-07T07:32:10.719964+0000","last_clean":"2024-03-07T07:32:10.719964+0000","last_became_active":"2024-03-07T07:32:08.718947+0000","last_became_peered":"2024-03-07T07:32:08.718947+0000","last_unstale":"2024-03-07T07:32:10.719964+0000","last_undegraded":"2024-03-07T07:32:10.719964+0000","last_fullsized":"2024-03-07T07:32:10.719964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:31:46.996542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954464+0000","last_change":"2024-03-07T07:32:09.727647+0000","last_active":"2024-03-07T07:32:10.954464+0000","last_peered":"2024-03-07T07:32:10.954464+0000","last_clean":"2024-03-07T07:32:10.954464+0000","last_became_active":"2024-03-07T07:32:09.727415+0000","last_became_peered":"2024-03-07T07:32:09.727415+0000","last_unstale":"2024-03-07T07:32:10.954464+0000","last_undegraded":"2024-03-07T07:32:10.954464+0000","last_fullsized":"2024-03-07T07:32:10.954464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:23.066491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.740930+0000","last_change":"2024-03-07T07:32:08.722227+0000","last_active":"2024-03-07T07:32:10.740930+0000","last_peered":"2024-03-07T07:32:10.740930+0000","last_clean":"2024-03-07T07:32:10.740930+0000","last_became_active":"2024-03-07T07:32:08.721547+0000","last_became_peered":"2024-03-07T07:32:08.721547+0000","last_unstale":"2024-03-07T07:32:10.740930+0000","last_undegraded":"2024-03-07T07:32:10.740930+0000","last_fullsized":"2024-03-07T07:32:10.740930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:11:30.172990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954677+0000","last_change":"2024-03-07T07:32:09.728668+0000","last_active":"2024-03-07T07:32:10.954677+0000","last_peered":"2024-03-07T07:32:10.954677+0000","last_clean":"2024-03-07T07:32:10.954677+0000","last_became_active":"2024-03-07T07:32:09.728355+0000","last_became_peered":"2024-03-07T07:32:09.728355+0000","last_unstale":"2024-03-07T07:32:10.954677+0000","last_undegraded":"2024-03-07T07:32:10.954677+0000","last_fullsized":"2024-03-07T07:32:10.954677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:56:35.385010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741438+0000","last_change":"2024-03-07T07:32:08.729034+0000","last_active":"2024-03-07T07:32:10.741438+0000","last_peered":"2024-03-07T07:32:10.741438+0000","last_clean":"2024-03-07T07:32:10.741438+0000","last_became_active":"2024-03-07T07:32:08.728745+0000","last_became_peered":"2024-03-07T07:32:08.728745+0000","last_unstale":"2024-03-07T07:32:10.741438+0000","last_undegraded":"2024-03-07T07:32:10.741438+0000","last_fullsized":"2024-03-07T07:32:10.741438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:54:09.878288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955371+0000","last_change":"2024-03-07T07:32:09.735410+0000","last_active":"2024-03-07T07:32:10.955371+0000","last_peered":"2024-03-07T07:32:10.955371+0000","last_clean":"2024-03-07T07:32:10.955371+0000","last_became_active":"2024-03-07T07:32:09.735140+0000","last_became_peered":"2024-03-07T07:32:09.735140+0000","last_unstale":"2024-03-07T07:32:10.955371+0000","last_undegraded":"2024-03-07T07:32:10.955371+0000","last_fullsized":"2024-03-07T07:32:10.955371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T07:36:47.428345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720091+0000","last_change":"2024-03-07T07:32:08.712845+0000","last_active":"2024-03-07T07:32:10.720091+0000","last_peered":"2024-03-07T07:32:10.720091+0000","last_clean":"2024-03-07T07:32:10.720091+0000","last_became_active":"2024-03-07T07:32:08.712543+0000","last_became_peered":"2024-03-07T07:32:08.712543+0000","last_unstale":"2024-03-07T07:32:10.720091+0000","last_undegraded":"2024-03-07T07:32:10.720091+0000","last_fullsized":"2024-03-07T07:32:10.720091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:47:43.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738023+0000","last_change":"2024-03-07T07:32:09.744731+0000","last_active":"2024-03-07T07:32:10.738023+0000","last_peered":"2024-03-07T07:32:10.738023+0000","last_clean":"2024-03-07T07:32:10.738023+0000","last_became_active":"2024-03-07T07:32:09.744460+0000","last_became_peered":"2024-03-07T07:32:09.744460+0000","last_unstale":"2024-03-07T07:32:10.738023+0000","last_undegraded":"2024-03-07T07:32:10.738023+0000","last_fullsized":"2024-03-07T07:32:10.738023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:21.839830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954893+0000","last_change":"2024-03-07T07:32:08.726767+0000","last_active":"2024-03-07T07:32:10.954893+0000","last_peered":"2024-03-07T07:32:10.954893+0000","last_clean":"2024-03-07T07:32:10.954893+0000","last_became_active":"2024-03-07T07:32:08.721780+0000","last_became_peered":"2024-03-07T07:32:08.721780+0000","last_unstale":"2024-03-07T07:32:10.954893+0000","last_undegraded":"2024-03-07T07:32:10.954893+0000","last_fullsized":"2024-03-07T07:32:10.954893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:57.931351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741304+0000","last_change":"2024-03-07T07:32:09.736606+0000","last_active":"2024-03-07T07:32:10.741304+0000","last_peered":"2024-03-07T07:32:10.741304+0000","last_clean":"2024-03-07T07:32:10.741304+0000","last_became_active":"2024-03-07T07:32:09.736269+0000","last_became_peered":"2024-03-07T07:32:09.736269+0000","last_unstale":"2024-03-07T07:32:10.741304+0000","last_undegraded":"2024-03-07T07:32:10.741304+0000","last_fullsized":"2024-03-07T07:32:10.741304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:49:27.999230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.716682+0000","last_change":"2024-03-07T07:32:08.724075+0000","last_active":"2024-03-07T07:32:10.716682+0000","last_peered":"2024-03-07T07:32:10.716682+0000","last_clean":"2024-03-07T07:32:10.716682+0000","last_became_active":"2024-03-07T07:32:08.723816+0000","last_became_peered":"2024-03-07T07:32:08.723816+0000","last_unstale":"2024-03-07T07:32:10.716682+0000","last_undegraded":"2024-03-07T07:32:10.716682+0000","last_fullsized":"2024-03-07T07:32:10.716682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:57.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954548+0000","last_change":"2024-03-07T07:32:09.742852+0000","last_active":"2024-03-07T07:32:10.954548+0000","last_peered":"2024-03-07T07:32:10.954548+0000","last_clean":"2024-03-07T07:32:10.954548+0000","last_became_active":"2024-03-07T07:32:09.741156+0000","last_became_peered":"2024-03-07T07:32:09.741156+0000","last_unstale":"2024-03-07T07:32:10.954548+0000","last_undegraded":"2024-03-07T07:32:10.954548+0000","last_fullsized":"2024-03-07T07:32:10.954548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:12:08.760057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738064+0000","last_change":"2024-03-07T07:32:08.725250+0000","last_active":"2024-03-07T07:32:10.738064+0000","last_peered":"2024-03-07T07:32:10.738064+0000","last_clean":"2024-03-07T07:32:10.738064+0000","last_became_active":"2024-03-07T07:32:08.724952+0000","last_became_peered":"2024-03-07T07:32:08.724952+0000","last_unstale":"2024-03-07T07:32:10.738064+0000","last_undegraded":"2024-03-07T07:32:10.738064+0000","last_fullsized":"2024-03-07T07:32:10.738064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:57.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.737977+0000","last_change":"2024-03-07T07:32:09.738332+0000","last_active":"2024-03-07T07:32:10.737977+0000","last_peered":"2024-03-07T07:32:10.737977+0000","last_clean":"2024-03-07T07:32:10.737977+0000","last_became_active":"2024-03-07T07:32:09.738070+0000","last_became_peered":"2024-03-07T07:32:09.738070+0000","last_unstale":"2024-03-07T07:32:10.737977+0000","last_undegraded":"2024-03-07T07:32:10.737977+0000","last_fullsized":"2024-03-07T07:32:10.737977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:55:29.714693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720011+0000","last_change":"2024-03-07T07:32:08.722811+0000","last_active":"2024-03-07T07:32:10.720011+0000","last_peered":"2024-03-07T07:32:10.720011+0000","last_clean":"2024-03-07T07:32:10.720011+0000","last_became_active":"2024-03-07T07:32:08.722388+0000","last_became_peered":"2024-03-07T07:32:08.722388+0000","last_unstale":"2024-03-07T07:32:10.720011+0000","last_undegraded":"2024-03-07T07:32:10.720011+0000","last_fullsized":"2024-03-07T07:32:10.720011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:21:09.210160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954727+0000","last_change":"2024-03-07T07:32:09.746626+0000","last_active":"2024-03-07T07:32:10.954727+0000","last_peered":"2024-03-07T07:32:10.954727+0000","last_clean":"2024-03-07T07:32:10.954727+0000","last_became_active":"2024-03-07T07:32:09.746273+0000","last_became_peered":"2024-03-07T07:32:09.746273+0000","last_unstale":"2024-03-07T07:32:10.954727+0000","last_undegraded":"2024-03-07T07:32:10.954727+0000","last_fullsized":"2024-03-07T07:32:10.954727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:10:23.110753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954533+0000","last_change":"2024-03-07T07:32:08.727283+0000","last_active":"2024-03-07T07:32:10.954533+0000","last_peered":"2024-03-07T07:32:10.954533+0000","last_clean":"2024-03-07T07:32:10.954533+0000","last_became_active":"2024-03-07T07:32:08.727012+0000","last_became_peered":"2024-03-07T07:32:08.727012+0000","last_unstale":"2024-03-07T07:32:10.954533+0000","last_undegraded":"2024-03-07T07:32:10.954533+0000","last_fullsized":"2024-03-07T07:32:10.954533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:58:11.184461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954291+0000","last_change":"2024-03-07T07:32:09.743462+0000","last_active":"2024-03-07T07:32:10.954291+0000","last_peered":"2024-03-07T07:32:10.954291+0000","last_clean":"2024-03-07T07:32:10.954291+0000","last_became_active":"2024-03-07T07:32:09.743094+0000","last_became_peered":"2024-03-07T07:32:09.743094+0000","last_unstale":"2024-03-07T07:32:10.954291+0000","last_undegraded":"2024-03-07T07:32:10.954291+0000","last_fullsized":"2024-03-07T07:32:10.954291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:10.653132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954572+0000","last_change":"2024-03-07T07:32:08.723260+0000","last_active":"2024-03-07T07:32:10.954572+0000","last_peered":"2024-03-07T07:32:10.954572+0000","last_clean":"2024-03-07T07:32:10.954572+0000","last_became_active":"2024-03-07T07:32:08.723010+0000","last_became_peered":"2024-03-07T07:32:08.723010+0000","last_unstale":"2024-03-07T07:32:10.954572+0000","last_undegraded":"2024-03-07T07:32:10.954572+0000","last_fullsized":"2024-03-07T07:32:10.954572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:20.834267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741395+0000","last_change":"2024-03-07T07:32:09.737681+0000","last_active":"2024-03-07T07:32:10.741395+0000","last_peered":"2024-03-07T07:32:10.741395+0000","last_clean":"2024-03-07T07:32:10.741395+0000","last_became_active":"2024-03-07T07:32:09.736035+0000","last_became_peered":"2024-03-07T07:32:09.736035+0000","last_unstale":"2024-03-07T07:32:10.741395+0000","last_undegraded":"2024-03-07T07:32:10.741395+0000","last_fullsized":"2024-03-07T07:32:10.741395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:37:18.860889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955059+0000","last_change":"2024-03-07T07:32:08.723288+0000","last_active":"2024-03-07T07:32:10.955059+0000","last_peered":"2024-03-07T07:32:10.955059+0000","last_clean":"2024-03-07T07:32:10.955059+0000","last_became_active":"2024-03-07T07:32:08.723011+0000","last_became_peered":"2024-03-07T07:32:08.723011+0000","last_unstale":"2024-03-07T07:32:10.955059+0000","last_undegraded":"2024-03-07T07:32:10.955059+0000","last_fullsized":"2024-03-07T07:32:10.955059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:35:45.488891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.955272+0000","last_change":"2024-03-07T07:32:09.732193+0000","last_active":"2024-03-07T07:32:10.955272+0000","last_peered":"2024-03-07T07:32:10.955272+0000","last_clean":"2024-03-07T07:32:10.955272+0000","last_became_active":"2024-03-07T07:32:09.731912+0000","last_became_peered":"2024-03-07T07:32:09.731912+0000","last_unstale":"2024-03-07T07:32:10.955272+0000","last_undegraded":"2024-03-07T07:32:10.955272+0000","last_fullsized":"2024-03-07T07:32:10.955272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:03:35.895193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.738348+0000","last_change":"2024-03-07T07:32:08.728905+0000","last_active":"2024-03-07T07:32:10.738348+0000","last_peered":"2024-03-07T07:32:10.738348+0000","last_clean":"2024-03-07T07:32:10.738348+0000","last_became_active":"2024-03-07T07:32:08.728584+0000","last_became_peered":"2024-03-07T07:32:08.728584+0000","last_unstale":"2024-03-07T07:32:10.738348+0000","last_undegraded":"2024-03-07T07:32:10.738348+0000","last_fullsized":"2024-03-07T07:32:10.738348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:09:56.478703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.741448+0000","last_change":"2024-03-07T07:32:09.734387+0000","last_active":"2024-03-07T07:32:10.741448+0000","last_peered":"2024-03-07T07:32:10.741448+0000","last_clean":"2024-03-07T07:32:10.741448+0000","last_became_active":"2024-03-07T07:32:09.734040+0000","last_became_peered":"2024-03-07T07:32:09.734040+0000","last_unstale":"2024-03-07T07:32:10.741448+0000","last_undegraded":"2024-03-07T07:32:10.741448+0000","last_fullsized":"2024-03-07T07:32:10.741448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:58.156994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954977+0000","last_change":"2024-03-07T07:32:08.722707+0000","last_active":"2024-03-07T07:32:10.954977+0000","last_peered":"2024-03-07T07:32:10.954977+0000","last_clean":"2024-03-07T07:32:10.954977+0000","last_became_active":"2024-03-07T07:32:08.721788+0000","last_became_peered":"2024-03-07T07:32:08.721788+0000","last_unstale":"2024-03-07T07:32:10.954977+0000","last_undegraded":"2024-03-07T07:32:10.954977+0000","last_fullsized":"2024-03-07T07:32:10.954977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:05:42.008018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.716730+0000","last_change":"2024-03-07T07:32:09.732507+0000","last_active":"2024-03-07T07:32:10.716730+0000","last_peered":"2024-03-07T07:32:10.716730+0000","last_clean":"2024-03-07T07:32:10.716730+0000","last_became_active":"2024-03-07T07:32:09.732228+0000","last_became_peered":"2024-03-07T07:32:09.732228+0000","last_unstale":"2024-03-07T07:32:10.716730+0000","last_undegraded":"2024-03-07T07:32:10.716730+0000","last_fullsized":"2024-03-07T07:32:10.716730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:02:21.839830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954952+0000","last_change":"2024-03-07T07:32:08.723402+0000","last_active":"2024-03-07T07:32:10.954952+0000","last_peered":"2024-03-07T07:32:10.954952+0000","last_clean":"2024-03-07T07:32:10.954952+0000","last_became_active":"2024-03-07T07:32:08.722984+0000","last_became_peered":"2024-03-07T07:32:08.722984+0000","last_unstale":"2024-03-07T07:32:10.954952+0000","last_undegraded":"2024-03-07T07:32:10.954952+0000","last_fullsized":"2024-03-07T07:32:10.954952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:13:19.770427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720502+0000","last_change":"2024-03-07T07:32:09.744759+0000","last_active":"2024-03-07T07:32:10.720502+0000","last_peered":"2024-03-07T07:32:10.720502+0000","last_clean":"2024-03-07T07:32:10.720502+0000","last_became_active":"2024-03-07T07:32:09.743975+0000","last_became_peered":"2024-03-07T07:32:09.743975+0000","last_unstale":"2024-03-07T07:32:10.720502+0000","last_undegraded":"2024-03-07T07:32:10.720502+0000","last_fullsized":"2024-03-07T07:32:10.720502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T09:27:29.722998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954863+0000","last_change":"2024-03-07T07:32:08.721683+0000","last_active":"2024-03-07T07:32:10.954863+0000","last_peered":"2024-03-07T07:32:10.954863+0000","last_clean":"2024-03-07T07:32:10.954863+0000","last_became_active":"2024-03-07T07:32:08.721226+0000","last_became_peered":"2024-03-07T07:32:08.721226+0000","last_unstale":"2024-03-07T07:32:10.954863+0000","last_undegraded":"2024-03-07T07:32:10.954863+0000","last_fullsized":"2024-03-07T07:32:10.954863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:34:30.228981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720429+0000","last_change":"2024-03-07T07:32:09.726098+0000","last_active":"2024-03-07T07:32:10.720429+0000","last_peered":"2024-03-07T07:32:10.720429+0000","last_clean":"2024-03-07T07:32:10.720429+0000","last_became_active":"2024-03-07T07:32:09.725778+0000","last_became_peered":"2024-03-07T07:32:09.725778+0000","last_unstale":"2024-03-07T07:32:10.720429+0000","last_undegraded":"2024-03-07T07:32:10.720429+0000","last_fullsized":"2024-03-07T07:32:10.720429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T08:45:58.369642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.719989+0000","last_change":"2024-03-07T07:32:08.714980+0000","last_active":"2024-03-07T07:32:10.719989+0000","last_peered":"2024-03-07T07:32:10.719989+0000","last_clean":"2024-03-07T07:32:10.719989+0000","last_became_active":"2024-03-07T07:32:08.714659+0000","last_became_peered":"2024-03-07T07:32:08.714659+0000","last_unstale":"2024-03-07T07:32:10.719989+0000","last_undegraded":"2024-03-07T07:32:10.719989+0000","last_fullsized":"2024-03-07T07:32:10.719989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:34:14.784463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954627+0000","last_change":"2024-03-07T07:32:09.732846+0000","last_active":"2024-03-07T07:32:10.954627+0000","last_peered":"2024-03-07T07:32:10.954627+0000","last_clean":"2024-03-07T07:32:10.954627+0000","last_became_active":"2024-03-07T07:32:09.731979+0000","last_became_peered":"2024-03-07T07:32:09.731979+0000","last_unstale":"2024-03-07T07:32:10.954627+0000","last_undegraded":"2024-03-07T07:32:10.954627+0000","last_fullsized":"2024-03-07T07:32:10.954627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:45:55.887757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.720371+0000","last_change":"2024-03-07T07:32:08.726960+0000","last_active":"2024-03-07T07:32:10.720371+0000","last_peered":"2024-03-07T07:32:10.720371+0000","last_clean":"2024-03-07T07:32:10.720371+0000","last_became_active":"2024-03-07T07:32:08.726686+0000","last_became_peered":"2024-03-07T07:32:08.726686+0000","last_unstale":"2024-03-07T07:32:10.720371+0000","last_undegraded":"2024-03-07T07:32:10.720371+0000","last_fullsized":"2024-03-07T07:32:10.720371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:13:19.770427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.716699+0000","last_change":"2024-03-07T07:32:09.733315+0000","last_active":"2024-03-07T07:32:10.716699+0000","last_peered":"2024-03-07T07:32:10.716699+0000","last_clean":"2024-03-07T07:32:10.716699+0000","last_became_active":"2024-03-07T07:32:09.733052+0000","last_became_peered":"2024-03-07T07:32:09.733052+0000","last_unstale":"2024-03-07T07:32:10.716699+0000","last_undegraded":"2024-03-07T07:32:10.716699+0000","last_fullsized":"2024-03-07T07:32:10.716699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:08.694693+0000","last_clean_scrub_stamp":"2024-03-07T07:32:08.694693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:53:15.103011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954946+0000","last_change":"2024-03-07T07:32:08.721617+0000","last_active":"2024-03-07T07:32:10.954946+0000","last_peered":"2024-03-07T07:32:10.954946+0000","last_clean":"2024-03-07T07:32:10.954946+0000","last_became_active":"2024-03-07T07:32:08.721242+0000","last_became_peered":"2024-03-07T07:32:08.721242+0000","last_unstale":"2024-03-07T07:32:10.954946+0000","last_undegraded":"2024-03-07T07:32:10.954946+0000","last_fullsized":"2024-03-07T07:32:10.954946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:32:07.689130+0000","last_clean_scrub_stamp":"2024-03-07T07:32:07.689130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:41:43.318106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-07T07:32:10.954341+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:32:10.954341+0000","last_peered":"2024-03-07T07:32:10.954341+0000","last_clean":"2024-03-07T07:32:10.954341+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:32:10.954341+0000","last_undegraded":"2024-03-07T07:32:10.954341+0000","last_fullsized":"2024-03-07T07:32:10.954341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":148491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":738153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":149327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":738665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":149349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:32:18.742 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-07T07:32:18.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-07T07:32:18.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.933+0000 7fc74d200640 1 Processor -- start 2024-03-07T07:32:18.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.933+0000 7fc74d200640 1 -- start start 2024-03-07T07:32:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc74d200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc74815cf00 0x7fc7480c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc74d200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480c5db0 con 0x7fc7480b2da0 2024-03-07T07:32:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc74d200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc748156920 con 0x7fc748156540 2024-03-07T07:32:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc74d200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74815fc10 con 0x7fc74815cf00 2024-03-07T07:32:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc73fe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc7480b2da0 0x7fc7480704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56808/0 (socket says 172.21.15.84:56808) 2024-03-07T07:32:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc73fe00640 1 -- 172.21.15.84:0/656166351 learned_addr learned my addr 172.21.15.84:0/656166351 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc746800640 1 --2- 172.21.15.84:0/656166351 >> v2:172.21.15.84:3300/0 conn(0x7fc74815cf00 0x7fc7480c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc745400640 1 -- 172.21.15.84:0/656166351 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585748807 0 0) 0x7fc7480c5db0 con 0x7fc7480b2da0 2024-03-07T07:32:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc745400640 1 -- 172.21.15.84:0/656166351 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc72c003530 con 0x7fc7480b2da0 2024-03-07T07:32:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc745400640 1 -- 172.21.15.84:0/656166351 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515117394 0 0) 0x7fc748156920 con 0x7fc748156540 2024-03-07T07:32:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc745400640 1 -- 172.21.15.84:0/656166351 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480c5db0 con 0x7fc748156540 2024-03-07T07:32:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc746800640 1 -- 172.21.15.84:0/656166351 >> v1:172.21.15.161:6789/0 conn(0x7fc748156540 legacy=0x7fc7481600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc746800640 1 -- 172.21.15.84:0/656166351 >> v1:172.21.15.84:6789/0 conn(0x7fc7480b2da0 legacy=0x7fc7480704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc746800640 1 -- 172.21.15.84:0/656166351 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480c57f0 con 0x7fc74815cf00 2024-03-07T07:32:18.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.937+0000 7fc746800640 1 --2- 172.21.15.84:0/656166351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc74815cf00 0x7fc7480c5ff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc74815fd90 tx=0x7fc74001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2ba426efa03574 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc745400640 1 -- 172.21.15.84:0/656166351 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7400b2070 con 0x7fc74815cf00 2024-03-07T07:32:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc745400640 1 -- 172.21.15.84:0/656166351 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7400a5810 con 0x7fc74815cf00 2024-03-07T07:32:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc745400640 1 -- 172.21.15.84:0/656166351 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7400a5be0 con 0x7fc74815cf00 2024-03-07T07:32:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 -- 172.21.15.84:0/656166351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc74815cf00 msgr2=0x7fc7480c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 --2- 172.21.15.84:0/656166351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc74815cf00 0x7fc7480c5ff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc74815fd90 tx=0x7fc74001c950 comp rx=0 tx=0).stop 2024-03-07T07:32:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 -- 172.21.15.84:0/656166351 shutdown_connections 2024-03-07T07:32:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 --2- 172.21.15.84:0/656166351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc74815cf00 0x7fc7480c5ff0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 -- 172.21.15.84:0/656166351 >> 172.21.15.84:0/656166351 conn(0x7fc7480cd530 msgr2=0x7fc7480cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:18.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 -- 172.21.15.84:0/656166351 shutdown_connections 2024-03-07T07:32:18.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 -- 172.21.15.84:0/656166351 wait complete. 2024-03-07T07:32:18.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 Processor -- start 2024-03-07T07:32:18.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.941+0000 7fc74d200640 1 -- start start 2024-03-07T07:32:18.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7480b2da0 0x7fc74814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc748156540 0x7fc748150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc74815cf00 0x7fc74814d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480c6940 con 0x7fc7480b2da0 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74815d370 con 0x7fc74815cf00 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74816a400 con 0x7fc748156540 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7480b2da0 0x7fc74814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7480b2da0 0x7fc74814db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44658/0 (socket says 172.21.15.84:44658) 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 -- 172.21.15.84:0/607453663 learned_addr learned my addr 172.21.15.84:0/607453663 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc73fe00640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc748156540 0x7fc748150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc746800640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc74815cf00 0x7fc74814d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 -- 172.21.15.84:0/607453663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc748156540 msgr2=0x7fc748150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc748156540 0x7fc748150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 -- 172.21.15.84:0/607453663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc74815cf00 msgr2=0x7fc74814d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:18.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc74815cf00 0x7fc74814d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:18.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 -- 172.21.15.84:0/607453663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74814e390 con 0x7fc7480b2da0 2024-03-07T07:32:18.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc745e00640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7480b2da0 0x7fc74814db00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc73800c500 tx=0x7fc73800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:18.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc73e000640 1 -- 172.21.15.84:0/607453663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7380052d0 con 0x7fc7480b2da0 2024-03-07T07:32:18.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc73e000640 1 -- 172.21.15.84:0/607453663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc738005490 con 0x7fc7480b2da0 2024-03-07T07:32:18.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc73e000640 1 -- 172.21.15.84:0/607453663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738012850 con 0x7fc7480b2da0 2024-03-07T07:32:18.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc748151b50 con 0x7fc7480b2da0 2024-03-07T07:32:18.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7480c8260 con 0x7fc7480b2da0 2024-03-07T07:32:18.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc748151e50 con 0x7fc7480b2da0 2024-03-07T07:32:18.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.945+0000 7fc73e000640 1 -- 172.21.15.84:0/607453663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc7380129f0 con 0x7fc7480b2da0 2024-03-07T07:32:18.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.949+0000 7fc73e000640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc724066f60 0x7fc724069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:18.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.949+0000 7fc73e000640 1 -- 172.21.15.84:0/607453663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc738084c50 con 0x7fc7480b2da0 2024-03-07T07:32:18.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.949+0000 7fc73fe00640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc724066f60 0x7fc724069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:18.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.949+0000 7fc73fe00640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc724066f60 0x7fc724069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc74815ced0 tx=0x7fc730007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:18.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:18.953+0000 7fc73e000640 1 -- 172.21.15.84:0/607453663 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fc748151e50 con 0x7fc7480b2da0 2024-03-07T07:32:19.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.165+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc748156920 con 0x7fc7480b2da0 2024-03-07T07:32:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc73e000640 1 -- 172.21.15.84:0/607453663 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc738055580 con 0x7fc7480b2da0 2024-03-07T07:32:19.170 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-03-07T07:32:19.170 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbellW6BnOBAAntECnVfbCrv87gpYUuAGtw== 2024-03-07T07:32:19.171 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2024-03-07T07:32:19.171 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2024-03-07T07:32:19.171 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-07T07:32:19.171 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2024-03-07T07:32:19.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc724066f60 msgr2=0x7fc724069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:19.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc724066f60 0x7fc724069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc74815ced0 tx=0x7fc730007d40 comp rx=0 tx=0).stop 2024-03-07T07:32:19.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7480b2da0 msgr2=0x7fc74814db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:19.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7480b2da0 0x7fc74814db00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc73800c500 tx=0x7fc73800c9c0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 shutdown_connections 2024-03-07T07:32:19.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc724066f60 0x7fc724069420 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc74815cf00 0x7fc74814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc748156540 0x7fc748150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 --2- 172.21.15.84:0/607453663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7480b2da0 0x7fc74814db00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 >> 172.21.15.84:0/607453663 conn(0x7fc7480cd530 msgr2=0x7fc7481600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:19.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 shutdown_connections 2024-03-07T07:32:19.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.169+0000 7fc74d200640 1 -- 172.21.15.84:0/607453663 wait complete. 2024-03-07T07:32:19.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:32:19.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.325+0000 7f07d6200640 1 Processor -- start 2024-03-07T07:32:19.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.325+0000 7f07d6200640 1 -- start start 2024-03-07T07:32:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07d6200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f07d0147d10 0x7f07d00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07d6200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d0071600 0x7f07d00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07d6200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d00724f0 con 0x7f07d00b3a00 2024-03-07T07:32:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07d6200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d01480f0 con 0x7f07d0147d10 2024-03-07T07:32:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07d6200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00b0f80 con 0x7f07d0071600 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d0071600 0x7f07d00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cf400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f07d0147d10 0x7f07d00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d0071600 0x7f07d00b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:33886/0 (socket says 172.21.15.84:33886) 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cf400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f07d0147d10 0x7f07d00b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:51406/0 (socket says 172.21.15.84:51406) 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cea00640 1 -- 172.21.15.84:0/4281059762 learned_addr learned my addr 172.21.15.84:0/4281059762 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07ce000640 1 -- 172.21.15.84:0/4281059762 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311642394 0 0) 0x7f07c80014a0 con 0x7f07d00b3a00 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cea00640 1 -- 172.21.15.84:0/4281059762 >> v2:172.21.15.161:3300/0 conn(0x7f07d0147d10 msgr2=0x7f07d00b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cea00640 1 --2- 172.21.15.84:0/4281059762 >> v2:172.21.15.161:3300/0 conn(0x7f07d0147d10 0x7f07d00b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cea00640 1 -- 172.21.15.84:0/4281059762 >> v1:172.21.15.161:6789/0 conn(0x7f07d00b3a00 legacy=0x7f07d00aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.329+0000 7f07cea00640 1 -- 172.21.15.84:0/4281059762 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00732f0 con 0x7f07d0071600 2024-03-07T07:32:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07cea00640 1 --2- 172.21.15.84:0/4281059762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d0071600 0x7f07d00b0700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009870 tx=0x7f07bc01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81102841134735b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07ce000640 1 -- 172.21.15.84:0/4281059762 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0b5070 con 0x7f07d0071600 2024-03-07T07:32:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07ce000640 1 -- 172.21.15.84:0/4281059762 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc0a8a50 con 0x7f07d0071600 2024-03-07T07:32:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07ce000640 1 -- 172.21.15.84:0/4281059762 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0a8e20 con 0x7f07d0071600 2024-03-07T07:32:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 -- 172.21.15.84:0/4281059762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d0071600 msgr2=0x7f07d00b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 --2- 172.21.15.84:0/4281059762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d0071600 0x7f07d00b0700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009870 tx=0x7f07bc01ed50 comp rx=0 tx=0).stop 2024-03-07T07:32:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 -- 172.21.15.84:0/4281059762 shutdown_connections 2024-03-07T07:32:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 --2- 172.21.15.84:0/4281059762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d0071600 0x7f07d00b0700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 --2- 172.21.15.84:0/4281059762 >> v2:172.21.15.161:3300/0 conn(0x7f07d0147d10 0x7f07d00b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 -- 172.21.15.84:0/4281059762 >> 172.21.15.84:0/4281059762 conn(0x7f07d00b1ed0 msgr2=0x7f07d00b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 -- 172.21.15.84:0/4281059762 shutdown_connections 2024-03-07T07:32:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 -- 172.21.15.84:0/4281059762 wait complete. 2024-03-07T07:32:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 Processor -- start 2024-03-07T07:32:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.333+0000 7f07d6200640 1 -- start start 2024-03-07T07:32:19.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0071600 0x7f07d0139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d00b3a00 0x7f07d00b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d0147d10 0x7f07d00b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0072d30 con 0x7f07d0071600 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0072a50 con 0x7f07d0147d10 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0073010 con 0x7f07d00b3a00 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0071600 0x7f07d0139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0071600 0x7f07d0139980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44662/0 (socket says 172.21.15.84:44662) 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 -- 172.21.15.84:0/3773901194 learned_addr learned my addr 172.21.15.84:0/3773901194 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cea00640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d00b3a00 0x7f07d00b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cfe00640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d0147d10 0x7f07d00b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 -- 172.21.15.84:0/3773901194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d00b3a00 msgr2=0x7f07d00b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d00b3a00 0x7f07d00b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 -- 172.21.15.84:0/3773901194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d0147d10 msgr2=0x7f07d00b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d0147d10 0x7f07d00b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 -- 172.21.15.84:0/3773901194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00b8330 con 0x7f07d0071600 2024-03-07T07:32:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07cf400640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0071600 0x7f07d0139980 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07c000e870 tx=0x7f07c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07c7400640 1 -- 172.21.15.84:0/3773901194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0017070 con 0x7f07d0071600 2024-03-07T07:32:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07c7400640 1 -- 172.21.15.84:0/3773901194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c000c940 con 0x7f07d0071600 2024-03-07T07:32:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d01f4800 con 0x7f07d0071600 2024-03-07T07:32:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07c7400640 1 -- 172.21.15.84:0/3773901194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c000ccf0 con 0x7f07d0071600 2024-03-07T07:32:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d01f4aa0 con 0x7f07d0071600 2024-03-07T07:32:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d0143860 con 0x7f07d0071600 2024-03-07T07:32:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.337+0000 7f07c7400640 1 -- 172.21.15.84:0/3773901194 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f07c001a070 con 0x7f07d0071600 2024-03-07T07:32:19.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.341+0000 7f07c7400640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f60 0x7f07b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:19.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.341+0000 7f07c7400640 1 -- 172.21.15.84:0/3773901194 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07c0084e20 con 0x7f07d0071600 2024-03-07T07:32:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.341+0000 7f07cea00640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f60 0x7f07b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.341+0000 7f07cea00640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f60 0x7f07b0069420 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0b2000 tx=0x7f07bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:19.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.345+0000 7f07c7400640 1 -- 172.21.15.84:0/3773901194 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f07c00557d0 con 0x7f07d0071600 2024-03-07T07:32:19.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.533+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07d0062d40 con 0x7f07d0071600 2024-03-07T07:32:19.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.533+0000 7f07c7400640 1 -- 172.21.15.84:0/3773901194 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4980 (secure 0 0 0) 0x7f07c0059870 con 0x7f07d0071600 2024-03-07T07:32:19.537 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:19.537 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/2371752160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2371752160},{"type":"v1","addr":"172.21.15.161:6834","nonce":2371752160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/850187244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":850187244},{"type":"v1","addr":"172.21.15.161:6835","nonce":850187244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3878293455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3878293455},{"type":"v1","addr":"172.21.15.84:6836","nonce":3878293455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:32:09.092583+0000","modified":"2024-03-07T07:32:12.103936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2828752085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2828752085},{"type":"v1","addr":"172.21.15.84:6837","nonce":2828752085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4995,"qdb_cluster":[4995]},"id":2}]} 2024-03-07T07:32:19.537 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-03-07T07:32:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f60 msgr2=0x7f07b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f60 0x7f07b0069420 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0b2000 tx=0x7f07bc009040 comp rx=0 tx=0).stop 2024-03-07T07:32:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0071600 msgr2=0x7f07d0139980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0071600 0x7f07d0139980 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07c000e870 tx=0x7f07c000ec70 comp rx=0 tx=0).stop 2024-03-07T07:32:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 shutdown_connections 2024-03-07T07:32:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f07b0066f60 0x7f07b0069420 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07d0147d10 0x7f07d00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07d00b3a00 0x7f07d00b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 --2- 172.21.15.84:0/3773901194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0071600 0x7f07d0139980 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 >> 172.21.15.84:0/3773901194 conn(0x7f07d00b1ed0 msgr2=0x7f07d00d03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 shutdown_connections 2024-03-07T07:32:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:19.537+0000 7f07d6200640 1 -- 172.21.15.84:0/3773901194 wait complete. 2024-03-07T07:32:19.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-07T07:32:09.092583+0000', 'modified': '2024-03-07T07:32:12.103936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4995}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4995': {'gid': 4995, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/2828752085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 2828752085}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 2828752085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4995, 'qdb_cluster': [4995]} 2024-03-07T07:32:19.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-07T07:32:19.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-07T07:32:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.105+0000 7f5a24000640 1 Processor -- start 2024-03-07T07:32:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.105+0000 7f5a24000640 1 -- start start 2024-03-07T07:32:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a24000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c147d10 0x7f5a1c0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a24000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a1c0d07c0 0x7f5a1c0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a24000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1c0724f0 con 0x7f5a1c071600 2024-03-07T07:32:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a24000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1c1480f0 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a24000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0b0f80 con 0x7f5a1c147d10 2024-03-07T07:32:20.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a20c00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5a1c071600 0x7f5a1c0aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56822/0 (socket says 172.21.15.84:56822) 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a20c00640 1 -- 172.21.15.84:0/2475477016 learned_addr learned my addr 172.21.15.84:0/2475477016 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a21600640 1 --2- 172.21.15.84:0/2475477016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c147d10 0x7f5a1c0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a22000640 1 --2- 172.21.15.84:0/2475477016 >> v2:172.21.15.161:3300/0 conn(0x7f5a1c0d07c0 0x7f5a1c0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a1be00640 1 -- 172.21.15.84:0/2475477016 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694604909 0 0) 0x7f5a08001120 con 0x7f5a1c071600 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a1be00640 1 -- 172.21.15.84:0/2475477016 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a04003530 con 0x7f5a1c071600 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a21600640 1 -- 172.21.15.84:0/2475477016 >> v2:172.21.15.161:3300/0 conn(0x7f5a1c0d07c0 msgr2=0x7f5a1c0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a21600640 1 --2- 172.21.15.84:0/2475477016 >> v2:172.21.15.161:3300/0 conn(0x7f5a1c0d07c0 0x7f5a1c0b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a21600640 1 -- 172.21.15.84:0/2475477016 >> v1:172.21.15.84:6789/0 conn(0x7f5a1c071600 legacy=0x7f5a1c0aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.109+0000 7f5a21600640 1 -- 172.21.15.84:0/2475477016 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c0732f0 con 0x7f5a1c147d10 2024-03-07T07:32:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a21600640 1 --2- 172.21.15.84:0/2475477016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c147d10 0x7f5a1c0b01c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a100097c0 tx=0x7f5a1001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5fda770e8040188 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a1be00640 1 -- 172.21.15.84:0/2475477016 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100b5070 con 0x7f5a1c147d10 2024-03-07T07:32:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a1be00640 1 -- 172.21.15.84:0/2475477016 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a100a8990 con 0x7f5a1c147d10 2024-03-07T07:32:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a1be00640 1 -- 172.21.15.84:0/2475477016 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100a8d60 con 0x7f5a1c147d10 2024-03-07T07:32:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 -- 172.21.15.84:0/2475477016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c147d10 msgr2=0x7f5a1c0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 --2- 172.21.15.84:0/2475477016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c147d10 0x7f5a1c0b01c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a100097c0 tx=0x7f5a1001ec90 comp rx=0 tx=0).stop 2024-03-07T07:32:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 -- 172.21.15.84:0/2475477016 shutdown_connections 2024-03-07T07:32:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 --2- 172.21.15.84:0/2475477016 >> v2:172.21.15.161:3300/0 conn(0x7f5a1c0d07c0 0x7f5a1c0b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 --2- 172.21.15.84:0/2475477016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c147d10 0x7f5a1c0b01c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 -- 172.21.15.84:0/2475477016 >> 172.21.15.84:0/2475477016 conn(0x7f5a1c0b1ed0 msgr2=0x7f5a1c0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 -- 172.21.15.84:0/2475477016 shutdown_connections 2024-03-07T07:32:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 -- 172.21.15.84:0/2475477016 wait complete. 2024-03-07T07:32:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.113+0000 7f5a24000640 1 Processor -- start 2024-03-07T07:32:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 -- start start 2024-03-07T07:32:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c071600 0x7f5a1c142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a1c0d07c0 0x7f5a1c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a1c147d10 0x7f5a1c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c072d30 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c072a50 con 0x7f5a1c147d10 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c073010 con 0x7f5a1c071600 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a1c0d07c0 0x7f5a1c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a1c0d07c0 0x7f5a1c15dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44676/0 (socket says 172.21.15.84:44676) 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 -- 172.21.15.84:0/1514032244 learned_addr learned my addr 172.21.15.84:0/1514032244 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a21600640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c071600 0x7f5a1c142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a22000640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a1c147d10 0x7f5a1c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 -- 172.21.15.84:0/1514032244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c071600 msgr2=0x7f5a1c142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c071600 0x7f5a1c142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 -- 172.21.15.84:0/1514032244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a1c147d10 msgr2=0x7f5a1c0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a1c147d10 0x7f5a1c0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 -- 172.21.15.84:0/1514032244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c141c90 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a20c00640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a1c0d07c0 0x7f5a1c15dc80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800c730 tx=0x7f5a0800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a19600640 1 -- 172.21.15.84:0/1514032244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08017070 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a19600640 1 -- 172.21.15.84:0/1514032244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a08005ae0 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a19600640 1 -- 172.21.15.84:0/1514032244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08007e30 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 -- 172.21.15.84:0/1514032244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1c141f70 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.117+0000 7f5a24000640 1 -- 172.21.15.84:0/1514032244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1c142810 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a19600640 1 -- 172.21.15.84:0/1514032244 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f5a0801a070 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a19600640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f59fc066f60 0x7f59fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a19600640 1 -- 172.21.15.84:0/1514032244 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a08084350 con 0x7f5a1c0d07c0 2024-03-07T07:32:20.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a27477000 1 Processor -- start 2024-03-07T07:32:20.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a21600640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f59fc066f60 0x7f59fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a27477000 1 -- start start 2024-03-07T07:32:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a21600640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f59fc066f60 0x7f59fc069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a100b2000 tx=0x7f5a10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a27477000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f72fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a27477000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a27477000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72b2f90 0x5594f72b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a27477000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f719a420 con 0x5594f72fd680 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a27477000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f7101fa0 con 0x5594f72b2f90 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a27477000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594f7089e00 con 0x5594f72fcd60 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44678/0 (socket says 172.21.15.84:44678) 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a20c00640 1 -- 172.21.15.84:0/2296900819 learned_addr learned my addr 172.21.15.84:0/2296900819 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a21600640 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f72fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.121+0000 7f5a22000640 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72b2f90 0x5594f72b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a20c00640 1 -- 172.21.15.84:0/2296900819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 msgr2=0x5594f72fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a20c00640 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f72fd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a20c00640 1 -- 172.21.15.84:0/2296900819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72b2f90 msgr2=0x5594f72b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a20c00640 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72b2f90 0x5594f72b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a20c00640 1 -- 172.21.15.84:0/2296900819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594f708dcc0 con 0x5594f72fd680 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a20c00640 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72b2a50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5a0805ce30 tx=0x7f5a08054970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4317ea7ca220f1f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a0e000640 1 -- 172.21.15.84:0/2296900819 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080840c0 con 0x5594f72fd680 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a0e000640 1 -- 172.21.15.84:0/2296900819 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a08053000 con 0x5594f72fd680 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a0e000640 1 -- 172.21.15.84:0/2296900819 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0805ced0 con 0x5594f72fd680 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- 172.21.15.84:0/2296900819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 msgr2=0x5594f72b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72b2a50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5a0805ce30 tx=0x7f5a08054970 comp rx=0 tx=0).stop 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- 172.21.15.84:0/2296900819 shutdown_connections 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72b2f90 0x5594f72b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72b2a50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 --2- 172.21.15.84:0/2296900819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f72fd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- 172.21.15.84:0/2296900819 >> 172.21.15.84:0/2296900819 conn(0x5594f72aa310 msgr2=0x5594f72b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- 172.21.15.84:0/2296900819 shutdown_connections 2024-03-07T07:32:20.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- 172.21.15.84:0/2296900819 wait complete. 2024-03-07T07:32:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- start start 2024-03-07T07:32:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 Processor -- start 2024-03-07T07:32:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72b2f90 0x5594f72be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 0x5594f72be650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f70bcb00 con 0x5594f72fd680 2024-03-07T07:32:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f70fe040 con 0x5594f72fcd60 2024-03-07T07:32:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594f71065d0 con 0x5594f72b2f90 2024-03-07T07:32:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a27477000 10 client.0 _ll_register_callbacks cb 0x5594f70a3ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-07T07:32:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a22000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a22000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72beb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44684/0 (socket says 172.21.15.84:44684) 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a22000640 1 -- 172.21.15.84:0/121227309 learned_addr learned my addr 172.21.15.84:0/121227309 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a20c00640 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 0x5594f72be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.125+0000 7f5a21600640 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72b2f90 0x5594f72be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a22000640 1 -- 172.21.15.84:0/121227309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72b2f90 msgr2=0x5594f72be110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a22000640 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72b2f90 0x5594f72be110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a22000640 1 -- 172.21.15.84:0/121227309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 msgr2=0x5594f72be650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a22000640 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 0x5594f72be650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a22000640 1 -- 172.21.15.84:0/121227309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594f70c6380 con 0x5594f72fd680 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a22000640 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72beb90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5a14007da0 tx=0x7f5a14013620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aa6fe3bc86691e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 1 -- 172.21.15.84:0/121227309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1401d020 con 0x5594f72fd680 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 1 -- 172.21.15.84:0/121227309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a08053000 con 0x5594f72fd680 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 1 -- 172.21.15.84:0/121227309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a14019480 con 0x5594f72fd680 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 1 -- 172.21.15.84:0/121227309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a14027050 con 0x5594f72fd680 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 10 client.5205 fetch_fsmap learned FSMap version 17 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 1 -- 172.21.15.84:0/121227309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5594f70d5830 con 0x5594f72fd680 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 1 -- 172.21.15.84:0/121227309 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a08053000 con 0x5594f72fd680 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 1 -- 172.21.15.84:0/121227309 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) v1 ==== 3314+0+0 (secure 0 0 0) 0x7f5a1402a020 con 0x5594f72fd680 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 10 client.5205 fetch_fsmap finished waiting for FSMap version 17 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 10 client.5205 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-07T07:32:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 20 client.5205 populate_metadata read hostname 'smithi084' 2024-03-07T07:32:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] conn(0x5594f72bf460 0x5594f730e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 4 client.5205 mds_command: new command op to 4995 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-07T07:32:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 1 -- 172.21.15.84:0/121227309 --> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594f709db60 con 0x5594f72bf460 2024-03-07T07:32:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a21600640 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] conn(0x5594f72bf460 0x5594f730e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 10 client.5205 ms_handle_connect on v2:172.21.15.84:6835/2828752085 2024-03-07T07:32:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a21600640 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] conn(0x5594f72bf460 0x5594f730e4e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5ef7ba2e381920d server_cookie=af0342c94220e9cf in_seq=0 out_seq=0 2024-03-07T07:32:20.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 1 -- 172.21.15.84:0/121227309 <== mds.0 v2:172.21.15.84:6835/2828752085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5594f709db60 con 0x5594f72bf460 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a02a00640 10 client.5205 handle_command_reply: tid=0 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.129+0000 7f5a27477000 1 client.5205 shutdown 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 -- 172.21.15.84:0/121227309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 msgr2=0x5594f72beb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72beb90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5a14007da0 tx=0x7f5a14013620 comp rx=0 tx=0).stop 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 -- 172.21.15.84:0/121227309 shutdown_connections 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] conn(0x5594f72bf460 0x5594f730e4e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72fd680 0x5594f72beb90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 0x5594f72be650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 --2- 172.21.15.84:0/121227309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72b2f90 0x5594f72be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 -- 172.21.15.84:0/121227309 >> 172.21.15.84:0/121227309 conn(0x5594f72aa310 msgr2=0x5594f72b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a02a00640 0 client.5205 ms_handle_reset on v2:172.21.15.84:6835/2828752085 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 -- 172.21.15.84:0/121227309 shutdown_connections 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 1 -- 172.21.15.84:0/121227309 wait complete. 2024-03-07T07:32:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.133+0000 7f5a27477000 20 client.5205 trim_cache size 0 max 16384 2024-03-07T07:32:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 Processor -- start 2024-03-07T07:32:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 -- start start 2024-03-07T07:32:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72aa310 0x5594f735e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f735e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f735ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c2004d0 con 0x5594f72b2f90 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c1ff640 con 0x5594f72aa310 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0b5100 con 0x5594f72fcd60 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f735e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f735e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44696/0 (socket says 172.21.15.84:44696) 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 -- 172.21.15.84:0/258077144 learned_addr learned my addr 172.21.15.84:0/258077144 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a21600640 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72aa310 0x5594f735e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a22000640 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f735ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 -- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 msgr2=0x5594f735ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f735ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 -- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72aa310 msgr2=0x5594f735e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72aa310 0x5594f735e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 -- 172.21.15.84:0/258077144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594f70cffb0 con 0x5594f72b2f90 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a22000640 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f735ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a20c00640 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f735e550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5a08054ec0 tx=0x7f5a08084050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66fb59606399b65 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a0d600640 1 -- 172.21.15.84:0/258077144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08070070 con 0x5594f72b2f90 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a0d600640 1 -- 172.21.15.84:0/258077144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a080840c0 con 0x5594f72b2f90 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a0d600640 1 -- 172.21.15.84:0/258077144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08054840 con 0x5594f72b2f90 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 -- 172.21.15.84:0/258077144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 msgr2=0x5594f735e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f735e550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5a08054ec0 tx=0x7f5a08084050 comp rx=0 tx=0).stop 2024-03-07T07:32:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 -- 172.21.15.84:0/258077144 shutdown_connections 2024-03-07T07:32:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72fcd60 0x5594f735ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f735e550 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 --2- 172.21.15.84:0/258077144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72aa310 0x5594f735e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 -- 172.21.15.84:0/258077144 >> 172.21.15.84:0/258077144 conn(0x5594f72fc1f0 msgr2=0x5594f72b8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.149+0000 7f5a27477000 1 -- 172.21.15.84:0/258077144 shutdown_connections 2024-03-07T07:32:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 -- 172.21.15.84:0/258077144 wait complete. 2024-03-07T07:32:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 -- start start 2024-03-07T07:32:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 Processor -- start 2024-03-07T07:32:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72aa310 0x5594f73624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f7362a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 0x5594f731ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f72bc4e0 con 0x5594f72b2f90 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0b5700 con 0x5594f72fcd60 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594f71bdb80 con 0x5594f72aa310 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 10 client.0 _ll_register_callbacks cb 0x7f5a14009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f7362a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f7362a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44712/0 (socket says 172.21.15.84:44712) 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 -- 172.21.15.84:0/3694584134 learned_addr learned my addr 172.21.15.84:0/3694584134 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a22000640 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 0x5594f731ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a21600640 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72aa310 0x5594f73624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 -- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72aa310 msgr2=0x5594f73624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72aa310 0x5594f73624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 -- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 msgr2=0x5594f731ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 0x5594f731ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 -- 172.21.15.84:0/3694584134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594f71832e0 con 0x5594f72b2f90 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a21600640 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72aa310 0x5594f73624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a20c00640 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f7362a00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5a08054ec0 tx=0x7f5a08000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c95c422e6ab0747 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a02a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a02a00640 1 -- 172.21.15.84:0/3694584134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08070070 con 0x5594f72b2f90 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a02a00640 1 -- 172.21.15.84:0/3694584134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a0805ced0 con 0x5594f72b2f90 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 -- 172.21.15.84:0/3694584134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a080840c0 con 0x5594f72b2f90 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a02a00640 1 -- 172.21.15.84:0/3694584134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a0805d0f0 con 0x5594f72b2f90 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 10 client.5211 fetch_fsmap learned FSMap version 17 2024-03-07T07:32:20.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 -- 172.21.15.84:0/3694584134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5594f70a90a0 con 0x5594f72b2f90 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a02a00640 1 -- 172.21.15.84:0/3694584134 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a080840c0 con 0x5594f72b2f90 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a02a00640 1 -- 172.21.15.84:0/3694584134 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) v1 ==== 3314+0+0 (secure 0 0 0) 0x7f5a08054150 con 0x5594f72b2f90 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 10 client.5211 fetch_fsmap finished waiting for FSMap version 17 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 10 client.5211 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 20 client.5211 populate_metadata read hostname 'smithi084' 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] conn(0x5594f72fd680 0x5594f731d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 4 client.5211 mds_command: new command op to 4995 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a27477000 1 -- 172.21.15.84:0/3694584134 --> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5594f710f4e0 con 0x5594f72fd680 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.153+0000 7f5a21600640 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] conn(0x5594f72fd680 0x5594f731d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a02a00640 10 client.5211 ms_handle_connect on v2:172.21.15.84:6835/2828752085 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a21600640 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] conn(0x5594f72fd680 0x5594f731d7c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85d34b6a4ead5f74 server_cookie=8ee32cbb0d90fd2a in_seq=0 out_seq=0 2024-03-07T07:32:20.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a02a00640 1 -- 172.21.15.84:0/3694584134 <== mds.0 v2:172.21.15.84:6835/2828752085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5594f710f4e0 con 0x5594f72fd680 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a02a00640 10 client.5211 handle_command_reply: tid=0 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 client.5211 shutdown 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 -- 172.21.15.84:0/3694584134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 msgr2=0x5594f7362a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f7362a00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5a08054ec0 tx=0x7f5a08000bd0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 -- 172.21.15.84:0/3694584134 shutdown_connections 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.84:6835/2828752085,v1:172.21.15.84:6837/2828752085] conn(0x5594f72fd680 0x5594f731d7c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5594f72fcd60 0x5594f731ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594f72b2f90 0x5594f7362a00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a02a00640 0 client.5211 ms_handle_reset on v2:172.21.15.84:6835/2828752085 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 --2- 172.21.15.84:0/3694584134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5594f72aa310 0x5594f73624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 -- 172.21.15.84:0/3694584134 >> 172.21.15.84:0/3694584134 conn(0x5594f72fc1f0 msgr2=0x5594f730e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:20.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 -- 172.21.15.84:0/3694584134 shutdown_connections 2024-03-07T07:32:20.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 1 -- 172.21.15.84:0/3694584134 wait complete. 2024-03-07T07:32:20.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a27477000 20 client.5211 trim_cache size 0 max 16384 2024-03-07T07:32:20.165 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:32:20.165 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "9dc7a008-fd12-4491-ba8d-83bae22f3106", 2024-03-07T07:32:20.165 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-03-07T07:32:20.165 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4995, 2024-03-07T07:32:20.165 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-03-07T07:32:20.166 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-03-07T07:32:20.166 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-03-07T07:32:20.166 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 10.434495494, 2024-03-07T07:32:20.166 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 17, 2024-03-07T07:32:20.166 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 34, 2024-03-07T07:32:20.166 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 34, 2024-03-07T07:32:20.166 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 17.466321570000002 2024-03-07T07:32:20.166 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:32:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 -- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f59fc066f60 msgr2=0x7f59fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f59fc066f60 0x7f59fc069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a100b2000 tx=0x7f5a10008040 comp rx=0 tx=0).stop 2024-03-07T07:32:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 -- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a1c0d07c0 msgr2=0x7f5a1c15dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a1c0d07c0 0x7f5a1c15dc80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800c730 tx=0x7f5a0800cbf0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 -- 172.21.15.84:0/1514032244 shutdown_connections 2024-03-07T07:32:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f59fc066f60 0x7f59fc069420 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a1c147d10 0x7f5a1c0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a1c0d07c0 0x7f5a1c15dc80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 --2- 172.21.15.84:0/1514032244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a1c071600 0x7f5a1c142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 -- 172.21.15.84:0/1514032244 >> 172.21.15.84:0/1514032244 conn(0x7f5a1c0b1ed0 msgr2=0x7f5a1c0b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 -- 172.21.15.84:0/1514032244 shutdown_connections 2024-03-07T07:32:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.157+0000 7f5a24000640 1 -- 172.21.15.84:0/1514032244 wait complete. 2024-03-07T07:32:20.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-07T07:32:20.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.309+0000 7f8b1cc00640 1 Processor -- start 2024-03-07T07:32:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.309+0000 7f8b1cc00640 1 -- start start 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b1cc00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b1815c1f0 0x7f8b180b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b1cc00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b180b3a00 0x7f8b180aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b1cc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180b0290 con 0x7f8b180cf100 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b1cc00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180b1d40 con 0x7f8b180b3a00 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b1cc00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180b0570 con 0x7f8b1815c1f0 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b16800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b180b3a00 0x7f8b180aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b16800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b180b3a00 0x7f8b180aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44726/0 (socket says 172.21.15.84:44726) 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b16800640 1 -- 172.21.15.84:0/2344663884 learned_addr learned my addr 172.21.15.84:0/2344663884 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b15e00640 1 --2- 172.21.15.84:0/2344663884 >> v2:172.21.15.161:3300/0 conn(0x7f8b1815c1f0 0x7f8b180b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b16800640 1 -- 172.21.15.84:0/2344663884 >> v2:172.21.15.161:3300/0 conn(0x7f8b1815c1f0 msgr2=0x7f8b180b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b16800640 1 --2- 172.21.15.84:0/2344663884 >> v2:172.21.15.161:3300/0 conn(0x7f8b1815c1f0 0x7f8b180b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b16800640 1 -- 172.21.15.84:0/2344663884 >> v1:172.21.15.161:6789/0 conn(0x7f8b180cf100 legacy=0x7f8b180d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.313+0000 7f8b16800640 1 -- 172.21.15.84:0/2344663884 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180b0850 con 0x7f8b180b3a00 2024-03-07T07:32:20.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b16800640 1 --2- 172.21.15.84:0/2344663884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b180aefa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8b1806ed40 tx=0x7f8b1001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386d7de757149899 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b15400640 1 -- 172.21.15.84:0/2344663884 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b100a5730 con 0x7f8b180b3a00 2024-03-07T07:32:20.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b15400640 1 -- 172.21.15.84:0/2344663884 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b100a58d0 con 0x7f8b180b3a00 2024-03-07T07:32:20.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b15400640 1 -- 172.21.15.84:0/2344663884 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b100a5ca0 con 0x7f8b180b3a00 2024-03-07T07:32:20.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- 172.21.15.84:0/2344663884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 msgr2=0x7f8b180aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/2344663884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b180aefa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8b1806ed40 tx=0x7f8b1001c960 comp rx=0 tx=0).stop 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- 172.21.15.84:0/2344663884 shutdown_connections 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/2344663884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b180aefa0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/2344663884 >> v2:172.21.15.161:3300/0 conn(0x7f8b1815c1f0 0x7f8b180b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- 172.21.15.84:0/2344663884 >> 172.21.15.84:0/2344663884 conn(0x7f8b180b1ed0 msgr2=0x7f8b180b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- 172.21.15.84:0/2344663884 shutdown_connections 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- 172.21.15.84:0/2344663884 wait complete. 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 Processor -- start 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- start start 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b1814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180cf100 0x7f8b18153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b1815c1f0 0x7f8b1814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18168ce0 con 0x7f8b180b3a00 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180aff00 con 0x7f8b1815c1f0 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.317+0000 7f8b1cc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18168e60 con 0x7f8b180cf100 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b1814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b1814c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44732/0 (socket says 172.21.15.84:44732) 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 -- 172.21.15.84:0/3607827229 learned_addr learned my addr 172.21.15.84:0/3607827229 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b16800640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b1815c1f0 0x7f8b1814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b0fe00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180cf100 0x7f8b18153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 -- 172.21.15.84:0/3607827229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180cf100 msgr2=0x7f8b18153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180cf100 0x7f8b18153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 -- 172.21.15.84:0/3607827229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b1815c1f0 msgr2=0x7f8b1814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b1815c1f0 0x7f8b1814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 -- 172.21.15.84:0/3607827229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1813dd00 con 0x7f8b180b3a00 2024-03-07T07:32:20.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b15e00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b1814c530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800d5f0 tx=0x7f8b0800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b0e000640 1 -- 172.21.15.84:0/3607827229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080125f0 con 0x7f8b180b3a00 2024-03-07T07:32:20.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b0e000640 1 -- 172.21.15.84:0/3607827229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b08019070 con 0x7f8b180b3a00 2024-03-07T07:32:20.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b0e000640 1 -- 172.21.15.84:0/3607827229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080129b0 con 0x7f8b180b3a00 2024-03-07T07:32:20.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1814de90 con 0x7f8b180b3a00 2024-03-07T07:32:20.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1814ba50 con 0x7f8b180b3a00 2024-03-07T07:32:20.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b18062d40 con 0x7f8b180b3a00 2024-03-07T07:32:20.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.321+0000 7f8b0e000640 1 -- 172.21.15.84:0/3607827229 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f8b08012b50 con 0x7f8b180b3a00 2024-03-07T07:32:20.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.325+0000 7f8b0e000640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8af4066f60 0x7f8af4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:20.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.325+0000 7f8b0e000640 1 -- 172.21.15.84:0/3607827229 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b080852f0 con 0x7f8b180b3a00 2024-03-07T07:32:20.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.325+0000 7f8b0fe00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8af4066f60 0x7f8af4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:20.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.325+0000 7f8b0fe00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8af4066f60 0x7f8af4069420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8b180ce980 tx=0x7f8b00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:20.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.329+0000 7f8b0e000640 1 -- 172.21.15.84:0/3607827229 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f8b08055cb0 con 0x7f8b180b3a00 2024-03-07T07:32:20.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.517+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8b1806b6f0 con 0x7f8b180b3a00 2024-03-07T07:32:20.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.517+0000 7f8b0e000640 1 -- 172.21.15.84:0/3607827229 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8b08059d50 con 0x7f8b180b3a00 2024-03-07T07:32:20.519 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-07T07:32:20.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8af4066f60 msgr2=0x7f8af4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8af4066f60 0x7f8af4069420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8b180ce980 tx=0x7f8b00009040 comp rx=0 tx=0).stop 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 msgr2=0x7f8b1814c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b1814c530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800d5f0 tx=0x7f8b0800dab0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 shutdown_connections 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f8af4066f60 0x7f8af4069420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b1815c1f0 0x7f8b1814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180cf100 0x7f8b18153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 --2- 172.21.15.84:0/3607827229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180b3a00 0x7f8b1814c530 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 >> 172.21.15.84:0/3607827229 conn(0x7f8b180b1ed0 msgr2=0x7f8b1815b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 shutdown_connections 2024-03-07T07:32:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:20.521+0000 7f8b1cc00640 1 -- 172.21.15.84:0/3607827229 wait complete. 2024-03-07T07:32:20.541 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-07T07:32:20.541 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-07T07:32:20.541 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-03-07T07:32:20.541 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-07T07:32:20.541 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-07T07:32:20.541 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-07T07:32:20.541 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-07T07:32:20.541 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-07T07:32:20.542 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-07T07:32:20.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:20.542 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-03-07T07:32:20.551 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T07:32:20.551 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T07:32:20.551 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T07:32:20.551 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:32:20.551 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42407sec preferred_lft 42407sec 2024-03-07T07:32:20.552 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-03-07T07:32:20.553 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:32:20.553 INFO:teuthology.orchestra.run.smithi084.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-07T07:32:20.553 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 02:42:51:43:ce:2d brd ff:ff:ff:ff:ff:ff 2024-03-07T07:32:20.553 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-07T07:32:20.553 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:32:20.553 INFO:teuthology.orchestra.run.smithi084.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-07T07:32:20.554 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-07T07:32:20.554 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-07T07:32:20.554 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:32:20.554 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-07T07:32:20.554 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:32:20.554 INFO:teuthology.orchestra.run.smithi084.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-07T07:32:20.554 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-07T07:32:20.555 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-07T07:32:20.555 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:32:20.555 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-07T07:32:20.555 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-07T07:32:20.555 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-07T07:32:20.556 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-03-07T07:32:20.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:20.556 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-07T07:32:20.610 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-03-07T07:32:20.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:20.612 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-03-07T07:32:20.662 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-03-07T07:32:20.662 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-07T07:32:20.662 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-07T07:32:20.663 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-07T07:32:20.663 INFO:teuthology.orchestra.run.smithi084.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-07T07:32:20.663 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-07T07:32:20.663 INFO:teuthology.orchestra.run.smithi084.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:32:20.663 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:32:20.663 INFO:teuthology.orchestra.run.smithi084.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-07T07:32:20.663 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-07T07:32:20.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:20.663 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-03-07T07:32:20.664 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-03-07T07:32:20.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-07T07:32:20.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-07T07:32:20.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-07T07:32:20.664 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-03-07T07:32:20.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:20.752 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-03-07T07:32:20.760 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-07T07:32:20.760 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-07T07:32:20.761 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-07T07:32:20.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:20.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-03-07T07:32:20.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:32:20.825 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-07T07:32:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-07T07:32:20.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T07:32:20.878 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-07T07:32:20.929 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-07T07:32:20.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:20.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:32:21.022 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:32:21.022 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:32:21.036 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-07T07:32:21.036 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-07T07:32:21.036 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2024-03-07T07:32:21.036 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@9dc7a008-fd12-4491-ba8d-83bae22f3106.cephfs=/ 2024-03-07T07:32:21.036 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.161:3300/172.21.15.161:3301" will pass to kernel 2024-03-07T07:32:21.040 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-07T07:32:21.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:21.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-07T07:32:21.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:21.060 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T07:32:21.117 INFO:teuthology.orchestra.run.smithi084.stdout:client4970 2024-03-07T07:32:21.118 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:32:21.118 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:32:21.170 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=xfstests-dev 2024-03-07T07:32:21.220 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.NNXPT5PfHFxfstests-dev 2024-03-07T07:32:21.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:21.220 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.NNXPT5PfHFxfstests-dev) 2024-03-07T07:32:21.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:21.281 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.NNXPT5PfHFxfstests-dev) 2024-03-07T07:32:21.337 INFO:teuthology.orchestra.run.smithi084.stderr:Cloning into '/tmp/tmp.NNXPT5PfHFxfstests-dev'... 2024-03-07T07:32:22.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:22.283 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-07T07:32:22.340 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=test 2024-03-07T07:32:22.388 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.qkA86MCBjatest 2024-03-07T07:32:22.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:32:22.388 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-07T07:32:22.439 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=scratch 2024-03-07T07:32:22.488 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.jXK0QJcBgFscratch 2024-03-07T07:32:22.488 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2024-03-07T07:32:22.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev 2024-03-07T07:32:22.609 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-03-07T07:32:22.784 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2024-03-07T07:32:22.785 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2024-03-07T07:32:22.948 INFO:teuthology.orchestra.run.smithi084.stdout:acl is already the newest version (2.3.1-1). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:acl set to manually installed. 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:attr is already the newest version (1:2.5.1-1build1). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:automake is already the newest version (1:1.16.5-1.3). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:bc is already the newest version (1.07.1-3build1). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:gcc set to manually installed. 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:libacl1-dev is already the newest version (2.3.1-1). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:libtool is already the newest version (2.4.6-15build2). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2024-03-07T07:32:22.949 INFO:teuthology.orchestra.run.smithi084.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:make is already the newest version (4.3-4.1build1). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:make set to manually installed. 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:psmisc is already the newest version (23.4-2build3). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:quota is already the newest version (4.06-1build2). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:sed is already the newest version (4.8-1ubuntu2). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-07T07:32:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:dbench is already the newest version (4.0-2build1). 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:dump is already the newest version (0.4b47-3). 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:python3 is already the newest version (3.10.6-1~22.04). 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2024-03-07T07:32:22.951 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2024-03-07T07:32:22.952 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-03-07T07:32:22.952 INFO:teuthology.orchestra.run.smithi084.stdout: python2.7 python2.7-dev python2.7-minimal 2024-03-07T07:32:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-07T07:32:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2024-03-07T07:32:22.952 INFO:teuthology.orchestra.run.smithi084.stdout: libcap2 libcmap4 libcorosync-common4 libdlm3 libpmemblk1 libqb100 2024-03-07T07:32:22.953 INFO:teuthology.orchestra.run.smithi084.stdout: libsqlite3-0 2024-03-07T07:32:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2024-03-07T07:32:22.953 INFO:teuthology.orchestra.run.smithi084.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc dvd+rw-tools udfclient 2024-03-07T07:32:22.995 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2024-03-07T07:32:22.995 INFO:teuthology.orchestra.run.smithi084.stdout: exfatprogs f2fs-tools fio libcap-dev libcmap4 libcorosync-common4 libdlm3 2024-03-07T07:32:22.996 INFO:teuthology.orchestra.run.smithi084.stdout: libgdbm-dev libpmemblk1 libqb100 liburing-dev ocfs2-tools sqlite3 udftools 2024-03-07T07:32:22.996 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2024-03-07T07:32:22.998 INFO:teuthology.orchestra.run.smithi084.stdout: gawk libcap2 libsqlite3-0 2024-03-07T07:32:23.183 INFO:teuthology.orchestra.run.smithi084.stdout:3 upgraded, 14 newly installed, 0 to remove and 274 not upgraded. 2024-03-07T07:32:23.183 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 7,282 kB of archives. 2024-03-07T07:32:23.183 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 14.2 MB of additional disk space will be used. 2024-03-07T07:32:23.183 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2024-03-07T07:32:23.719 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2024-03-07T07:32:23.719 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2024-03-07T07:32:23.728 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2024-03-07T07:32:23.730 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2024-03-07T07:32:23.732 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2024-03-07T07:32:23.837 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2024-03-07T07:32:23.839 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-03-07T07:32:23.900 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2024-03-07T07:32:23.902 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2024-03-07T07:32:23.912 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2024-03-07T07:32:24.081 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2024-03-07T07:32:24.905 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2024-03-07T07:32:24.905 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2024-03-07T07:32:24.908 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2024-03-07T07:32:24.909 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-03-07T07:32:24.923 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2024-03-07T07:32:25.247 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: unable to initialize frontend: Dialog 2024-03-07T07:32:25.247 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-03-07T07:32:25.247 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: falling back to frontend: Readline 2024-03-07T07:32:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: unable to initialize frontend: Readline 2024-03-07T07:32:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: (This frontend requires a controlling tty.) 2024-03-07T07:32:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: falling back to frontend: Teletype 2024-03-07T07:32:25.276 INFO:teuthology.orchestra.run.smithi084.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-03-07T07:32:25.318 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 7,282 kB in 2s (3,792 kB/s) 2024-03-07T07:32:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143385 files and directories currently installed.) 2024-03-07T07:32:25.577 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../0-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2024-03-07T07:32:25.734 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2024-03-07T07:32:26.277 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2024-03-07T07:32:26.292 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../1-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2024-03-07T07:32:26.378 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2024-03-07T07:32:26.772 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqb100:amd64. 2024-03-07T07:32:26.787 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../2-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2024-03-07T07:32:26.839 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2024-03-07T07:32:27.201 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcmap4:amd64. 2024-03-07T07:32:27.215 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../3-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2024-03-07T07:32:27.259 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2024-03-07T07:32:27.587 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libdlm3:amd64. 2024-03-07T07:32:27.601 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../4-libdlm3_4.1.1-1build1_amd64.deb ... 2024-03-07T07:32:27.645 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2024-03-07T07:32:28.048 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ocfs2-tools. 2024-03-07T07:32:28.064 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../5-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2024-03-07T07:32:28.098 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2024-03-07T07:32:28.585 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../6-libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:32:28.712 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2024-03-07T07:32:29.069 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-03-07T07:32:29.493 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143459 files and directories currently installed.) 2024-03-07T07:32:29.497 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../0-libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-03-07T07:32:29.621 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-03-07T07:32:29.966 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package exfatprogs. 2024-03-07T07:32:29.990 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../1-exfatprogs_1.1.3-1_amd64.deb ... 2024-03-07T07:32:30.033 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking exfatprogs (1.1.3-1) ... 2024-03-07T07:32:30.452 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package f2fs-tools. 2024-03-07T07:32:30.467 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../2-f2fs-tools_1.14.0-2build1_amd64.deb ... 2024-03-07T07:32:30.595 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2024-03-07T07:32:31.023 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpmemblk1:amd64. 2024-03-07T07:32:31.047 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../3-libpmemblk1_1.11.1-3build1_amd64.deb ... 2024-03-07T07:32:31.098 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2024-03-07T07:32:31.459 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package fio. 2024-03-07T07:32:31.481 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../4-fio_3.28-1_amd64.deb ... 2024-03-07T07:32:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking fio (3.28-1) ... 2024-03-07T07:32:31.955 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcap-dev:amd64. 2024-03-07T07:32:31.970 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../5-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2024-03-07T07:32:32.005 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-03-07T07:32:32.318 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2024-03-07T07:32:32.333 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../6-libgdbm-dev_1.23-1_amd64.deb ... 2024-03-07T07:32:32.385 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2024-03-07T07:32:32.697 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liburing-dev:amd64. 2024-03-07T07:32:32.711 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../7-liburing-dev_2.1-2build1_amd64.deb ... 2024-03-07T07:32:32.763 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2024-03-07T07:32:33.075 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package sqlite3. 2024-03-07T07:32:33.098 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../8-sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-03-07T07:32:33.175 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-03-07T07:32:33.603 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package udftools. 2024-03-07T07:32:33.625 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../9-udftools_2.3-1_amd64.deb ... 2024-03-07T07:32:33.682 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking udftools (2.3-1) ... 2024-03-07T07:32:33.977 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up exfatprogs (1.1.3-1) ... 2024-03-07T07:32:34.141 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2024-03-07T07:32:34.427 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2024-03-07T07:32:34.569 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-03-07T07:32:34.696 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2024-03-07T07:32:34.838 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2024-03-07T07:32:35.014 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2024-03-07T07:32:35.165 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up udftools (2.3-1) ... 2024-03-07T07:32:35.317 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2024-03-07T07:32:35.417 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2024-03-07T07:32:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-03-07T07:32:35.653 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-03-07T07:32:35.797 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2024-03-07T07:32:35.930 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2024-03-07T07:32:36.056 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up fio (3.28-1) ... 2024-03-07T07:32:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2024-03-07T07:32:36.895 INFO:teuthology.orchestra.run.smithi084.stdout:debconf: unable to initialize frontend: Dialog 2024-03-07T07:32:36.895 INFO:teuthology.orchestra.run.smithi084.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-03-07T07:32:36.895 INFO:teuthology.orchestra.run.smithi084.stdout:debconf: falling back to frontend: Readline 2024-03-07T07:32:37.986 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2024-03-07T07:32:38.107 INFO:teuthology.orchestra.run.smithi084.stdout:update-initramfs: Generating /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-07T07:32:41.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:32:41.357 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:32:52.858 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-07T07:32:52.985 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-07T07:32:53.986 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-07T07:32:54.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd -m fsgqa 2024-03-07T07:32:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:useradd: user 'fsgqa' already exists 2024-03-07T07:32:54.545 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-07T07:32:54.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo groupadd fsgqa 2024-03-07T07:32:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:groupadd: group 'fsgqa' already exists 2024-03-07T07:32:54.607 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-07T07:32:54.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd fsgqa2 2024-03-07T07:32:55.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd 123456-fsgqa 2024-03-07T07:32:55.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-07T07:32:55.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d6b000640 1 Processor -- start 2024-03-07T07:32:55.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d6b000640 1 -- start start 2024-03-07T07:32:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d6b000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640cf460 0x7f2d640d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d6b000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d640d1180 0x7f2d640d1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d6b000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d64147e20 con 0x7f2d64147a40 2024-03-07T07:32:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d6b000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d640d0a10 con 0x7f2d640d1180 2024-03-07T07:32:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d6b000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d64072060 con 0x7f2d640cf460 2024-03-07T07:32:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d69000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d640d1180 0x7f2d640d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d69000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d640d1180 0x7f2d640d1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52506/0 (socket says 172.21.15.84:52506) 2024-03-07T07:32:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d69000640 1 -- 172.21.15.84:0/1553696190 learned_addr learned my addr 172.21.15.84:0/1553696190 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:55.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d69000640 1 -- 172.21.15.84:0/1553696190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640cf460 msgr2=0x7f2d640d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:55.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d63400640 1 --2- 172.21.15.84:0/1553696190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640cf460 0x7f2d640d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:55.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d69000640 1 --2- 172.21.15.84:0/1553696190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640cf460 0x7f2d640d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d69000640 1 -- 172.21.15.84:0/1553696190 >> v1:172.21.15.161:6789/0 conn(0x7f2d64147a40 legacy=0x7f2d640ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:55.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d69000640 1 -- 172.21.15.84:0/1553696190 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d64071730 con 0x7f2d640d1180 2024-03-07T07:32:55.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.672+0000 7f2d63400640 1 --2- 172.21.15.84:0/1553696190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640cf460 0x7f2d640d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:32:55.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d69000640 1 --2- 172.21.15.84:0/1553696190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d640d1180 0x7f2d640d1610 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009e50 tx=0x7f2d5c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da5aea7da45db38 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d62a00640 1 -- 172.21.15.84:0/1553696190 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0a56d0 con 0x7f2d640d1180 2024-03-07T07:32:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d62a00640 1 -- 172.21.15.84:0/1553696190 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c0a5870 con 0x7f2d640d1180 2024-03-07T07:32:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d62a00640 1 -- 172.21.15.84:0/1553696190 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0a5c40 con 0x7f2d640d1180 2024-03-07T07:32:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d6b000640 1 -- 172.21.15.84:0/1553696190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d640d1180 msgr2=0x7f2d640d1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1553696190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d640d1180 0x7f2d640d1610 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009e50 tx=0x7f2d5c01c960 comp rx=0 tx=0).stop 2024-03-07T07:32:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d6b000640 1 -- 172.21.15.84:0/1553696190 shutdown_connections 2024-03-07T07:32:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1553696190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d640d1180 0x7f2d640d1610 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1553696190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640cf460 0x7f2d640d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d6b000640 1 -- 172.21.15.84:0/1553696190 >> 172.21.15.84:0/1553696190 conn(0x7f2d640704b0 msgr2=0x7f2d640708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:55.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d6b000640 1 -- 172.21.15.84:0/1553696190 shutdown_connections 2024-03-07T07:32:55.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.676+0000 7f2d6b000640 1 -- 172.21.15.84:0/1553696190 wait complete. 2024-03-07T07:32:55.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 Processor -- start 2024-03-07T07:32:55.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 -- start start 2024-03-07T07:32:55.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d640cf460 0x7f2d6415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:55.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640d1180 0x7f2d64141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:55.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d64147a40 0x7f2d64142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:55.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d64072e80 con 0x7f2d64147a40 2024-03-07T07:32:55.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d64072d00 con 0x7f2d640cf460 2024-03-07T07:32:55.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d64073000 con 0x7f2d640d1180 2024-03-07T07:32:55.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d64147a40 0x7f2d64142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:55.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d64147a40 0x7f2d64142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52510/0 (socket says 172.21.15.84:52510) 2024-03-07T07:32:55.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 -- 172.21.15.84:0/1512931507 learned_addr learned my addr 172.21.15.84:0/1512931507 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:55.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d63e00640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d640cf460 0x7f2d6415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:55.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d63400640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640d1180 0x7f2d64141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:55.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 -- 172.21.15.84:0/1512931507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640d1180 msgr2=0x7f2d64141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:55.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640d1180 0x7f2d64141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 -- 172.21.15.84:0/1512931507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d640cf460 msgr2=0x7f2d6415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:55.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d640cf460 0x7f2d6415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 -- 172.21.15.84:0/1512931507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d64139370 con 0x7f2d64147a40 2024-03-07T07:32:55.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d69000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d64147a40 0x7f2d64142510 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0af040 tx=0x7f2d5c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:55.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d5be00640 1 -- 172.21.15.84:0/1512931507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0bc020 con 0x7f2d64147a40 2024-03-07T07:32:55.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d5be00640 1 -- 172.21.15.84:0/1512931507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c0b8670 con 0x7f2d64147a40 2024-03-07T07:32:55.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d64139650 con 0x7f2d64147a40 2024-03-07T07:32:55.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d5be00640 1 -- 172.21.15.84:0/1512931507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0b8a60 con 0x7f2d64147a40 2024-03-07T07:32:55.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.680+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d64139c10 con 0x7f2d64147a40 2024-03-07T07:32:55.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.684+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d64067d30 con 0x7f2d64147a40 2024-03-07T07:32:55.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.684+0000 7f2d5be00640 1 -- 172.21.15.84:0/1512931507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f2d5c0bf020 con 0x7f2d64147a40 2024-03-07T07:32:55.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.684+0000 7f2d5be00640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2d44066f90 0x7f2d44069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:55.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.684+0000 7f2d5be00640 1 -- 172.21.15.84:0/1512931507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2d5c11fb90 con 0x7f2d64147a40 2024-03-07T07:32:55.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.684+0000 7f2d63e00640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2d44066f90 0x7f2d44069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:55.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.684+0000 7f2d63e00640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2d44066f90 0x7f2d44069450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2d54004e30 tx=0x7f2d54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:55.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.688+0000 7f2d5be00640 1 -- 172.21.15.84:0/1512931507 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f2d5c0c7020 con 0x7f2d64147a40 2024-03-07T07:32:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2d640ced30 con 0x7f2d64147a40 2024-03-07T07:32:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d5be00640 1 -- 172.21.15.84:0/1512931507 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1285 (secure 0 0 0) 0x7f2d5c0165e0 con 0x7f2d64147a40 2024-03-07T07:32:55.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:32:55.915 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":1,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","modified":"2024-03-07T07:30:12.878892Z","created":"2024-03-07T07:30:12.878892Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3301","nonce":0},{"type":"v1","addr":"172.21.15.161:6790","nonce":0}]},"addr":"172.21.15.161:6790/0","public_addr":"172.21.15.161:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-07T07:32:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:dumped monmap epoch 1 2024-03-07T07:32:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2d44066f90 msgr2=0x7f2d44069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2d44066f90 0x7f2d44069450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2d54004e30 tx=0x7f2d54009040 comp rx=0 tx=0).stop 2024-03-07T07:32:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d64147a40 msgr2=0x7f2d64142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d64147a40 0x7f2d64142510 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0af040 tx=0x7f2d5c019700 comp rx=0 tx=0).stop 2024-03-07T07:32:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 shutdown_connections 2024-03-07T07:32:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2d44066f90 0x7f2d44069450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d64147a40 0x7f2d64142510 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d640d1180 0x7f2d64141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 --2- 172.21.15.84:0/1512931507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d640cf460 0x7f2d6415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 >> 172.21.15.84:0/1512931507 conn(0x7f2d640704b0 msgr2=0x7f2d64140c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 shutdown_connections 2024-03-07T07:32:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:55.912+0000 7f2d6b000640 1 -- 172.21.15.84:0/1512931507 wait complete. 2024-03-07T07:32:55.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-03-07T07:32:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f1314e00640 1 Processor -- start 2024-03-07T07:32:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f1314e00640 1 -- start start 2024-03-07T07:32:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f1314e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1310143dd0 0x7f13100cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f1314e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13100730e0 0x7f131015b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f1314e00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100cc880 con 0x7f1310144360 2024-03-07T07:32:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f1314e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13101441b0 con 0x7f1310143dd0 2024-03-07T07:32:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f1314e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100cf050 con 0x7f13100730e0 2024-03-07T07:32:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f130de00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1310143dd0 0x7f13100cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f130de00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1310143dd0 0x7f13100cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52514/0 (socket says 172.21.15.84:52514) 2024-03-07T07:32:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.072+0000 7f130de00640 1 -- 172.21.15.84:0/4272206099 learned_addr learned my addr 172.21.15.84:0/4272206099 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130e800640 1 --2- 172.21.15.84:0/4272206099 >> v2:172.21.15.161:3300/0 conn(0x7f13100730e0 0x7f131015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130de00640 1 -- 172.21.15.84:0/4272206099 >> v2:172.21.15.161:3300/0 conn(0x7f13100730e0 msgr2=0x7f131015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130de00640 1 --2- 172.21.15.84:0/4272206099 >> v2:172.21.15.161:3300/0 conn(0x7f13100730e0 0x7f131015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130de00640 1 -- 172.21.15.84:0/4272206099 >> v1:172.21.15.161:6789/0 conn(0x7f1310144360 legacy=0x7f13100729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:32:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130de00640 1 -- 172.21.15.84:0/4272206099 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100ccb60 con 0x7f1310143dd0 2024-03-07T07:32:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130de00640 1 --2- 172.21.15.84:0/4272206099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13100cdc00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f131006b720 tx=0x7f130001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bb97681eb65d17 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130d400640 1 -- 172.21.15.84:0/4272206099 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000aa430 con 0x7f1310143dd0 2024-03-07T07:32:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130d400640 1 -- 172.21.15.84:0/4272206099 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13000af070 con 0x7f1310143dd0 2024-03-07T07:32:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f130d400640 1 -- 172.21.15.84:0/4272206099 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000aa7f0 con 0x7f1310143dd0 2024-03-07T07:32:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f1314e00640 1 -- 172.21.15.84:0/4272206099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 msgr2=0x7f13100cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.076+0000 7f1314e00640 1 --2- 172.21.15.84:0/4272206099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13100cdc00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f131006b720 tx=0x7f130001c4b0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 -- 172.21.15.84:0/4272206099 shutdown_connections 2024-03-07T07:32:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 --2- 172.21.15.84:0/4272206099 >> v2:172.21.15.161:3300/0 conn(0x7f13100730e0 0x7f131015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 --2- 172.21.15.84:0/4272206099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13100cdc00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 -- 172.21.15.84:0/4272206099 >> 172.21.15.84:0/4272206099 conn(0x7f13100704b0 msgr2=0x7f13100708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 -- 172.21.15.84:0/4272206099 shutdown_connections 2024-03-07T07:32:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 -- 172.21.15.84:0/4272206099 wait complete. 2024-03-07T07:32:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 Processor -- start 2024-03-07T07:32:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 -- start start 2024-03-07T07:32:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13100730e0 0x7f1310159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13101f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1310144360 0x7f13101426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1310167960 con 0x7f1310143dd0 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13100cd6e0 con 0x7f13100730e0 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1314e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1310167ae0 con 0x7f1310144360 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13101f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13101f7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52530/0 (socket says 172.21.15.84:52530) 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 -- 172.21.15.84:0/1351290702 learned_addr learned my addr 172.21.15.84:0/1351290702 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f130de00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13100730e0 0x7f1310159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f130e800640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1310144360 0x7f13101426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 -- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1310144360 msgr2=0x7f13101426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1310144360 0x7f13101426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 -- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13100730e0 msgr2=0x7f1310159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13100730e0 0x7f1310159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 -- 172.21.15.84:0/1351290702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13101f7cc0 con 0x7f1310143dd0 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f130e800640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1310144360 0x7f13101426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.080+0000 7f1307e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13101f7580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f12f800b410 tx=0x7f12f800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.084+0000 7f1306000640 1 -- 172.21.15.84:0/1351290702 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8015030 con 0x7f1310143dd0 2024-03-07T07:32:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.084+0000 7f1306000640 1 -- 172.21.15.84:0/1351290702 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8004020 con 0x7f1310143dd0 2024-03-07T07:32:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.084+0000 7f1306000640 1 -- 172.21.15.84:0/1351290702 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8004450 con 0x7f1310143dd0 2024-03-07T07:32:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.084+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13101f7fa0 con 0x7f1310143dd0 2024-03-07T07:32:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.084+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13101f8560 con 0x7f1310143dd0 2024-03-07T07:32:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.084+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1310062d40 con 0x7f1310143dd0 2024-03-07T07:32:56.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.084+0000 7f1306000640 1 -- 172.21.15.84:0/1351290702 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f12f8018070 con 0x7f1310143dd0 2024-03-07T07:32:56.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.084+0000 7f1306000640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f12ec066f90 0x7f12ec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:32:56.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.088+0000 7f1306000640 1 -- 172.21.15.84:0/1351290702 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f12f8084b60 con 0x7f1310143dd0 2024-03-07T07:32:56.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.088+0000 7f130de00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f12ec066f90 0x7f12ec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:32:56.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.088+0000 7f130de00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f12ec066f90 0x7f12ec069450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f13000ae000 tx=0x7f13000a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:32:56.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.092+0000 7f1306000640 1 -- 172.21.15.84:0/1351290702 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f12f8055af0 con 0x7f1310143dd0 2024-03-07T07:32:56.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.424+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f131015b1f0 con 0x7f1310143dd0 2024-03-07T07:32:56.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.424+0000 7f1306000640 1 -- 172.21.15.84:0/1351290702 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f12f80553f0 con 0x7f1310143dd0 2024-03-07T07:32:56.429 INFO:teuthology.orchestra.run.smithi084.stdout:[client.admin] 2024-03-07T07:32:56.429 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAFbellfpmFBRAAxfDauhaAh5SVVEtgkfskOA== 2024-03-07T07:32:56.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f12ec066f90 msgr2=0x7f12ec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:56.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f12ec066f90 0x7f12ec069450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f13000ae000 tx=0x7f13000a7000 comp rx=0 tx=0).stop 2024-03-07T07:32:56.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 msgr2=0x7f13101f7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:32:56.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13101f7580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f12f800b410 tx=0x7f12f800b8d0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 shutdown_connections 2024-03-07T07:32:56.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f12ec066f90 0x7f12ec069450 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1310144360 0x7f13101426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1310143dd0 0x7f13101f7580 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 --2- 172.21.15.84:0/1351290702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13100730e0 0x7f1310159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:32:56.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 >> 172.21.15.84:0/1351290702 conn(0x7f13100704b0 msgr2=0x7f131013e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:32:56.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 shutdown_connections 2024-03-07T07:32:56.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:32:56.428+0000 7f1314e00640 1 -- 172.21.15.84:0/1351290702 wait complete. 2024-03-07T07:32:56.451 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:32:56.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/tmp/tmp.NNXPT5PfHFxfstests-dev/local.config 2024-03-07T07:32:56.470 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.84:6789:/test export TEST_DIR=/tmp/tmp.qkA86MCBjatest export SCRATCH_DEV=172.21.15.84:6789:/scratch export SCRATCH_MNT=/tmp/tmp.jXK0QJcBgFscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAFbellfpmFBRAAxfDauhaAh5SVVEtgkfskOA==" 2024-03-07T07:32:56.471 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:32:56.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/tmp/tmp.NNXPT5PfHFxfstests-dev/ceph.exclude 2024-03-07T07:32:56.531 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.NNXPT5PfHFxfstests-dev && exec sudo make) 2024-03-07T07:32:56.596 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize -cfi 2024-03-07T07:32:56.922 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-07T07:32:56.922 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './config.guess' 2024-03-07T07:32:56.931 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './config.sub' 2024-03-07T07:32:56.945 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './install-sh' 2024-03-07T07:32:56.956 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './ltmain.sh' 2024-03-07T07:32:57.007 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-07T07:32:57.008 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-07T07:32:57.015 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-07T07:32:57.025 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-07T07:32:57.034 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-07T07:32:57.044 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-07T07:32:57.054 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-07T07:32:57.056 INFO:teuthology.orchestra.run.smithi084.stdout:cp include/install-sh . 2024-03-07T07:32:57.058 INFO:teuthology.orchestra.run.smithi084.stdout:aclocal -I m4 2024-03-07T07:32:58.064 INFO:teuthology.orchestra.run.smithi084.stdout:autoheader 2024-03-07T07:32:58.426 INFO:teuthology.orchestra.run.smithi084.stdout:autoconf 2024-03-07T07:32:58.840 INFO:teuthology.orchestra.run.smithi084.stdout:./configure \ 2024-03-07T07:32:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: --libexecdir=/usr/lib \ 2024-03-07T07:32:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: --exec_prefix=/var/lib 2024-03-07T07:32:59.363 INFO:teuthology.orchestra.run.smithi084.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-07T07:32:59.363 INFO:teuthology.orchestra.run.smithi084.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-07T07:32:59.403 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to print strings... printf 2024-03-07T07:32:59.403 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc... gcc 2024-03-07T07:32:59.604 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the C compiler works... yes 2024-03-07T07:32:59.604 INFO:teuthology.orchestra.run.smithi084.stdout:checking for C compiler default output file name... a.out 2024-03-07T07:32:59.654 INFO:teuthology.orchestra.run.smithi084.stdout:checking for suffix of executables... 2024-03-07T07:32:59.769 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether we are cross compiling... no 2024-03-07T07:32:59.795 INFO:teuthology.orchestra.run.smithi084.stdout:checking for suffix of object files... o 2024-03-07T07:32:59.818 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the compiler supports GNU C... yes 2024-03-07T07:32:59.843 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc accepts -g... yes 2024-03-07T07:32:59.970 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to enable C11 features... none needed 2024-03-07T07:32:59.976 INFO:teuthology.orchestra.run.smithi084.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-03-07T07:32:59.981 INFO:teuthology.orchestra.run.smithi084.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-03-07T07:32:59.984 INFO:teuthology.orchestra.run.smithi084.stdout:checking for egrep... /usr/bin/grep -E 2024-03-07T07:32:59.987 INFO:teuthology.orchestra.run.smithi084.stdout:checking for fgrep... /usr/bin/grep -F 2024-03-07T07:32:59.994 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ld used by gcc... /usr/bin/ld 2024-03-07T07:32:59.998 INFO:teuthology.orchestra.run.smithi084.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-03-07T07:33:00.017 INFO:teuthology.orchestra.run.smithi084.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-03-07T07:33:00.048 INFO:teuthology.orchestra.run.smithi084.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-03-07T07:33:00.048 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether ln -s works... yes 2024-03-07T07:33:00.059 INFO:teuthology.orchestra.run.smithi084.stdout:checking the maximum length of command line arguments... 1572864 2024-03-07T07:33:00.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-07T07:33:00.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-07T07:33:00.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-03-07T07:33:00.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking for objdump... objdump 2024-03-07T07:33:00.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to recognize dependent libraries... pass_all 2024-03-07T07:33:00.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dlltool... no 2024-03-07T07:33:00.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-07T07:33:00.070 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ar... ar 2024-03-07T07:33:00.110 INFO:teuthology.orchestra.run.smithi084.stdout:checking for archiver @FILE support... @ 2024-03-07T07:33:00.111 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strip... strip 2024-03-07T07:33:00.111 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ranlib... ranlib 2024-03-07T07:33:00.112 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gawk... gawk 2024-03-07T07:33:00.210 INFO:teuthology.orchestra.run.smithi084.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-03-07T07:33:00.213 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sysroot... no 2024-03-07T07:33:00.221 INFO:teuthology.orchestra.run.smithi084.stdout:checking for a working dd... /usr/bin/dd 2024-03-07T07:33:00.229 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-03-07T07:33:00.249 INFO:teuthology.orchestra.run.smithi084.stdout:checking for mt... mt 2024-03-07T07:33:00.273 INFO:teuthology.orchestra.run.smithi084.stdout:checking if mt is a manifest tool... no 2024-03-07T07:33:00.309 INFO:teuthology.orchestra.run.smithi084.stdout:checking for stdio.h... yes 2024-03-07T07:33:00.356 INFO:teuthology.orchestra.run.smithi084.stdout:checking for stdlib.h... yes 2024-03-07T07:33:00.391 INFO:teuthology.orchestra.run.smithi084.stdout:checking for string.h... yes 2024-03-07T07:33:00.434 INFO:teuthology.orchestra.run.smithi084.stdout:checking for inttypes.h... yes 2024-03-07T07:33:00.467 INFO:teuthology.orchestra.run.smithi084.stdout:checking for stdint.h... yes 2024-03-07T07:33:00.501 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strings.h... yes 2024-03-07T07:33:00.548 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/stat.h... yes 2024-03-07T07:33:00.582 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/types.h... yes 2024-03-07T07:33:00.621 INFO:teuthology.orchestra.run.smithi084.stdout:checking for unistd.h... yes 2024-03-07T07:33:00.659 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dlfcn.h... yes 2024-03-07T07:33:00.665 INFO:teuthology.orchestra.run.smithi084.stdout:checking for objdir... .libs 2024-03-07T07:33:00.778 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-07T07:33:00.778 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-07T07:33:00.806 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-07T07:33:01.032 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc static flag -static works... yes 2024-03-07T07:33:01.072 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -c -o file.o... yes 2024-03-07T07:33:01.072 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-07T07:33:01.086 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-07T07:33:01.122 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether -lc should be explicitly linked in... no 2024-03-07T07:33:01.210 INFO:teuthology.orchestra.run.smithi084.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-07T07:33:01.210 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to hardcode library paths into programs... immediate 2024-03-07T07:33:01.229 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether stripping libraries is possible... yes 2024-03-07T07:33:01.229 INFO:teuthology.orchestra.run.smithi084.stdout:checking if libtool supports shared libraries... yes 2024-03-07T07:33:01.229 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether to build shared libraries... yes 2024-03-07T07:33:01.229 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether to build static libraries... yes 2024-03-07T07:33:01.244 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc... (cached) gcc 2024-03-07T07:33:01.285 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-03-07T07:33:01.286 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-07T07:33:01.286 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-03-07T07:33:01.286 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gmake... /usr/bin/gmake 2024-03-07T07:33:01.286 INFO:teuthology.orchestra.run.smithi084.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2024-03-07T07:33:01.287 INFO:teuthology.orchestra.run.smithi084.stdout:checking for tar... /bin/tar 2024-03-07T07:33:01.287 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gzip... /bin/gzip 2024-03-07T07:33:01.310 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc -MM is supported... yes 2024-03-07T07:33:01.311 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sort... /bin/sort 2024-03-07T07:33:01.311 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether ln -s works... yes 2024-03-07T07:33:01.311 INFO:teuthology.orchestra.run.smithi084.stdout:checking for rpm... no 2024-03-07T07:33:01.349 INFO:teuthology.orchestra.run.smithi084.stdout:checking for assert.h... yes 2024-03-07T07:33:01.389 INFO:teuthology.orchestra.run.smithi084.stdout:checking for bstring.h... no 2024-03-07T07:33:01.427 INFO:teuthology.orchestra.run.smithi084.stdout:checking for libgen.h... yes 2024-03-07T07:33:01.496 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dirent.h... yes 2024-03-07T07:33:01.578 INFO:teuthology.orchestra.run.smithi084.stdout:checking for errno.h... yes 2024-03-07T07:33:01.617 INFO:teuthology.orchestra.run.smithi084.stdout:checking for malloc.h... yes 2024-03-07T07:33:01.658 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid.h... no 2024-03-07T07:33:01.717 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid/uuid.h... yes 2024-03-07T07:33:01.760 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/uuid.h... no 2024-03-07T07:33:01.799 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/file.h... yes 2024-03-07T07:33:01.838 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fcntl.h... yes 2024-03-07T07:33:01.878 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/syssgi.h... no 2024-03-07T07:33:01.932 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/param.h... yes 2024-03-07T07:33:01.932 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/stat.h... (cached) yes 2024-03-07T07:33:01.970 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/statvfs.h... yes 2024-03-07T07:33:02.007 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/time.h... yes 2024-03-07T07:33:02.052 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/ioctl.h... yes 2024-03-07T07:33:02.093 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/wait.h... yes 2024-03-07T07:33:02.093 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/types.h... (cached) yes 2024-03-07T07:33:02.093 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strings.h... (cached) yes 2024-03-07T07:33:02.130 INFO:teuthology.orchestra.run.smithi084.stdout:checking for err.h... yes 2024-03-07T07:33:02.168 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/falloc.h... yes 2024-03-07T07:33:02.209 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-07T07:33:02.249 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-07T07:33:02.301 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/platform_defs.h... no 2024-03-07T07:33:02.342 INFO:teuthology.orchestra.run.smithi084.stdout:checking for btrfs/ioctl.h... no 2024-03-07T07:33:02.383 INFO:teuthology.orchestra.run.smithi084.stdout:checking for cifs/ioctl.h... no 2024-03-07T07:33:02.422 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/mman.h... yes 2024-03-07T07:33:02.445 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xfs_log_format.h... no 2024-03-07T07:33:02.502 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid_compare... no 2024-03-07T07:33:02.550 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid_compare in -luuid... yes 2024-03-07T07:33:02.662 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xfs.h... yes 2024-03-07T07:33:02.685 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/libxfs.h... no 2024-03-07T07:33:02.734 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2024-03-07T07:33:02.765 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-07T07:33:02.812 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xqm.h... yes 2024-03-07T07:33:02.884 INFO:teuthology.orchestra.run.smithi084.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-07T07:33:02.924 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/handle.h... yes 2024-03-07T07:33:02.979 INFO:teuthology.orchestra.run.smithi084.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-07T07:33:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/acl.h... yes 2024-03-07T07:33:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:checking for acl/libacl.h... yes 2024-03-07T07:33:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:checking for acl_init in -lacl... yes 2024-03-07T07:33:03.174 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gdbm-ndbm.h... no 2024-03-07T07:33:03.215 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gdbm/ndbm.h... no 2024-03-07T07:33:03.255 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ndbm.h... no 2024-03-07T07:33:03.296 INFO:teuthology.orchestra.run.smithi084.stdout:checking for libaio.h... yes 2024-03-07T07:33:03.351 INFO:teuthology.orchestra.run.smithi084.stdout:checking for liburing.h... yes 2024-03-07T07:33:03.402 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/capability.h... yes 2024-03-07T07:33:03.440 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/fiemap.h... yes 2024-03-07T07:33:03.490 INFO:teuthology.orchestra.run.smithi084.stdout:checking for fallocate... yes 2024-03-07T07:33:03.543 INFO:teuthology.orchestra.run.smithi084.stdout:checking for open_by_handle_at... yes 2024-03-07T07:33:03.584 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/fs.h... yes 2024-03-07T07:33:03.625 INFO:teuthology.orchestra.run.smithi084.stdout:checking for btrfsutil.h... no 2024-03-07T07:33:03.682 INFO:teuthology.orchestra.run.smithi084.stdout:checking for copy_file_range... yes 2024-03-07T07:33:03.739 INFO:teuthology.orchestra.run.smithi084.stdout:checking for SEEK_DATA... yes 2024-03-07T07:33:03.814 INFO:teuthology.orchestra.run.smithi084.stdout:checking for BMV_OF_SHARED... yes 2024-03-07T07:33:03.869 INFO:teuthology.orchestra.run.smithi084.stdout:checking for nftw... yes 2024-03-07T07:33:03.923 INFO:teuthology.orchestra.run.smithi084.stdout:checking for RLIMIT_NOFILE... yes 2024-03-07T07:33:03.977 INFO:teuthology.orchestra.run.smithi084.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-07T07:33:04.028 INFO:teuthology.orchestra.run.smithi084.stdout:checking for FICLONE... yes 2024-03-07T07:33:04.080 INFO:teuthology.orchestra.run.smithi084.stdout:checking for renameat2... yes 2024-03-07T07:33:04.131 INFO:teuthology.orchestra.run.smithi084.stdout:checking for reallocarray... yes 2024-03-07T07:33:04.181 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct mount_attr... yes 2024-03-07T07:33:04.241 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-07T07:33:04.294 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-07T07:33:04.346 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-07T07:33:04.399 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-07T07:33:04.452 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-07T07:33:04.505 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-07T07:33:04.560 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-07T07:33:04.599 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/btrfs.h... yes 2024-03-07T07:33:04.639 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/btrfs_tree.h... yes 2024-03-07T07:33:04.668 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-07T07:33:04.708 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-07T07:33:04.737 INFO:teuthology.orchestra.run.smithi084.stdout:configure: creating ./config.status 2024-03-07T07:33:05.545 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: creating include/builddefs 2024-03-07T07:33:05.572 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: creating include/config.h 2024-03-07T07:33:05.596 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: executing libtool commands 2024-03-07T07:33:05.661 INFO:teuthology.orchestra.run.smithi084.stdout:Building include 2024-03-07T07:33:05.667 INFO:teuthology.orchestra.run.smithi084.stdout:Building lib 2024-03-07T07:33:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: [LTDEP] 2024-03-07T07:33:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dataascii.lo 2024-03-07T07:33:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] databin.lo 2024-03-07T07:33:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] datapid.lo 2024-03-07T07:33:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] file_lock.lo 2024-03-07T07:33:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] forker.lo 2024-03-07T07:33:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] pattern.lo 2024-03-07T07:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] open_flags.lo 2024-03-07T07:33:07.063 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] random_range.lo 2024-03-07T07:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] string_to_tokens.lo 2024-03-07T07:33:07.457 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] str_to_bytes.lo 2024-03-07T07:33:07.624 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] tlibio.lo 2024-03-07T07:33:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] write_log.lo 2024-03-07T07:33:07.999 INFO:teuthology.orchestra.run.smithi084.stderr:write_log.c: In function 'wlog_record_write': 2024-03-07T07:33:08.000 INFO:teuthology.orchestra.run.smithi084.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:08.000 INFO:teuthology.orchestra.run.smithi084.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2024-03-07T07:33:08.000 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:08.000 INFO:teuthology.orchestra.run.smithi084.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:08.000 INFO:teuthology.orchestra.run.smithi084.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2024-03-07T07:33:08.000 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:08.200 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] random.lo 2024-03-07T07:33:08.332 INFO:teuthology.orchestra.run.smithi084.stdout: [LD] 2024-03-07T07:33:08.472 INFO:teuthology.orchestra.run.smithi084.stdout:Building ltp 2024-03-07T07:33:08.478 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2024-03-07T07:33:08.667 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] doio 2024-03-07T07:33:09.384 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsstress 2024-03-07T07:33:10.961 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsx 2024-03-07T07:33:11.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:33:11.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:33:11.769 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] growfiles 2024-03-07T07:33:12.363 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] iogen 2024-03-07T07:33:12.529 INFO:teuthology.orchestra.run.smithi084.stderr:iogen.c: In function 'main': 2024-03-07T07:33:12.529 INFO:teuthology.orchestra.run.smithi084.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:12.529 INFO:teuthology.orchestra.run.smithi084.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2024-03-07T07:33:12.529 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:12.531 INFO:teuthology.orchestra.run.smithi084.stderr:iogen.c: In function 'parse_cmdline': 2024-03-07T07:33:12.531 INFO:teuthology.orchestra.run.smithi084.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:12.531 INFO:teuthology.orchestra.run.smithi084.stderr: 1535 | getcwd(fptr->f_path, 2024-03-07T07:33:12.531 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:12.531 INFO:teuthology.orchestra.run.smithi084.stderr: 1536 | sizeof(fptr->f_path)-1); 2024-03-07T07:33:12.531 INFO:teuthology.orchestra.run.smithi084.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:12.808 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-stress 2024-03-07T07:33:12.968 INFO:teuthology.orchestra.run.smithi084.stderr:aio-stress.c: In function 'setup_shared_mem': 2024-03-07T07:33:12.968 INFO:teuthology.orchestra.run.smithi084.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:12.968 INFO:teuthology.orchestra.run.smithi084.stderr: 1013 | ftruncate(fd, total_ram); 2024-03-07T07:33:12.969 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:13.286 INFO:teuthology.orchestra.run.smithi084.stdout:Building src 2024-03-07T07:33:13.295 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2024-03-07T07:33:15.733 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2024-03-07T07:33:15.781 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2024-03-07T07:33:15.793 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2024-03-07T07:33:16.118 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2024-03-07T07:33:16.153 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirstress 2024-03-07T07:33:16.444 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fill 2024-03-07T07:33:16.637 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fill2 2024-03-07T07:33:16.908 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] getpagesize 2024-03-07T07:33:17.081 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] holes 2024-03-07T07:33:17.319 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] lstat64 2024-03-07T07:33:17.544 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] nametest 2024-03-07T07:33:17.706 INFO:teuthology.orchestra.run.smithi084.stderr:nametest.c: In function 'main': 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr: 236 | write(1, "\n", 1); 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr: 238 | write(1, ".", 1); 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr: 288 | write(1, ".", 1); 2024-03-07T07:33:17.707 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:17.831 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] permname 2024-03-07T07:33:18.087 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] randholes 2024-03-07T07:33:18.402 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] runas 2024-03-07T07:33:18.620 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] truncfile 2024-03-07T07:33:18.856 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] usemem 2024-03-07T07:33:19.048 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmapcat 2024-03-07T07:33:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:mmapcat.c: In function 'main': 2024-03-07T07:33:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:19.193 INFO:teuthology.orchestra.run.smithi084.stderr: 29 | write(1,ptr2,ptr - ptr2); 2024-03-07T07:33:19.194 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:19.236 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] append_reader 2024-03-07T07:33:19.429 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] append_writer 2024-03-07T07:33:19.622 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirperf 2024-03-07T07:33:19.887 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] metaperf 2024-03-07T07:33:20.071 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 'crfiles': 2024-03-07T07:33:20.071 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:20.071 INFO:teuthology.orchestra.run.smithi084.stderr: 166 | write(fd, buf, fsize); 2024-03-07T07:33:20.071 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:20.071 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 't_linkun': 2024-03-07T07:33:20.071 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr: 454 | link("a", *fnp); 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~ 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 't_chown': 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr: 404 | chown(*fnp, 2, -1); 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr: 406 | chown(*fnp, 1, -1); 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 'i_chown': 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr: 291 | chown(*fnp, 1, -1); 2024-03-07T07:33:20.072 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:20.073 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 'main': 2024-03-07T07:33:20.073 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:20.073 INFO:teuthology.orchestra.run.smithi084.stderr: 152 | chdir(".."); 2024-03-07T07:33:20.073 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~ 2024-03-07T07:33:20.246 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] devzero 2024-03-07T07:33:20.476 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] feature 2024-03-07T07:33:20.759 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] alloc 2024-03-07T07:33:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:alloc.c: In function 'main': 2024-03-07T07:33:20.921 INFO:teuthology.orchestra.run.smithi084.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:20.921 INFO:teuthology.orchestra.run.smithi084.stderr: 247 | mkstemp(tmpfile); 2024-03-07T07:33:20.921 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fault 2024-03-07T07:33:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fstest 2024-03-07T07:33:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_access_root 2024-03-07T07:33:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:t_access_root.c: In function 'main': 2024-03-07T07:33:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:21.708 INFO:teuthology.orchestra.run.smithi084.stderr: 55 | system(cmd); 2024-03-07T07:33:21.708 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~ 2024-03-07T07:33:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] godown 2024-03-07T07:33:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] resvtest 2024-03-07T07:33:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] writemod 2024-03-07T07:33:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] writev_on_pagefault 2024-03-07T07:33:22.607 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] makeextents 2024-03-07T07:33:22.829 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] itrash 2024-03-07T07:33:23.023 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] rename 2024-03-07T07:33:23.233 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] multi_open_unlink 2024-03-07T07:33:23.444 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] unwritten_sync 2024-03-07T07:33:23.689 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] genhashnames 2024-03-07T07:33:23.917 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_holes 2024-03-07T07:33:24.131 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_writev 2024-03-07T07:33:24.320 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_truncate_cmtime 2024-03-07T07:33:24.518 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirhash_collide 2024-03-07T07:33:24.747 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_rename_overwrite 2024-03-07T07:33:24.943 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] holetest 2024-03-07T07:33:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:holetest.c: In function 'pt_write_marker': 2024-03-07T07:33:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:25.097 INFO:teuthology.orchestra.run.smithi084.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2024-03-07T07:33:25.098 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:25.213 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_truncate_self 2024-03-07T07:33:25.392 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] af_unix 2024-03-07T07:33:25.585 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_stale_pmd 2024-03-07T07:33:25.733 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_stale_pmd.c: In function 'main': 2024-03-07T07:33:25.733 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:25.733 INFO:teuthology.orchestra.run.smithi084.stderr: 42 | ftruncate(fd, 0); 2024-03-07T07:33:25.733 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:25.733 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:25.733 INFO:teuthology.orchestra.run.smithi084.stderr: 43 | ftruncate(fd, MiB(4)); 2024-03-07T07:33:25.733 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:25.734 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:25.734 INFO:teuthology.orchestra.run.smithi084.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2024-03-07T07:33:25.734 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:25.779 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_cow_race 2024-03-07T07:33:25.936 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_cow_race.c: In function 'main': 2024-03-07T07:33:25.936 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:25.936 INFO:teuthology.orchestra.run.smithi084.stderr: 61 | ftruncate(fd, 0); 2024-03-07T07:33:25.936 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:25.936 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:25.936 INFO:teuthology.orchestra.run.smithi084.stderr: 62 | ftruncate(fd, MiB(2)); 2024-03-07T07:33:25.936 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:25.992 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_fallocate 2024-03-07T07:33:26.182 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsync-err 2024-03-07T07:33:26.434 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_write_ro 2024-03-07T07:33:26.629 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-07T07:33:26.779 INFO:teuthology.orchestra.run.smithi084.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2024-03-07T07:33:26.780 INFO:teuthology.orchestra.run.smithi084.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:26.780 INFO:teuthology.orchestra.run.smithi084.stderr: 61 | ftruncate(fd, 0); 2024-03-07T07:33:26.780 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:26.833 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-07T07:33:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ofd_locks 2024-03-07T07:33:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_collision 2024-03-07T07:33:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmap-write-concurrent 2024-03-07T07:33:27.730 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_get_file_time 2024-03-07T07:33:27.919 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_create_short_dirs 2024-03-07T07:33:28.129 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_create_long_dirs 2024-03-07T07:33:28.354 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_enospc 2024-03-07T07:33:28.634 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_writev_overlap 2024-03-07T07:33:28.850 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] checkpoint_journal 2024-03-07T07:33:29.054 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmap-rw-fault 2024-03-07T07:33:29.279 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] allocstale 2024-03-07T07:33:29.491 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_cow_memory_failure 2024-03-07T07:33:29.703 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fake-dump-rootino 2024-03-07T07:33:29.902 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-buf-fault 2024-03-07T07:33:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] rewinddir-test 2024-03-07T07:33:30.315 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] readdir-while-renames 2024-03-07T07:33:30.520 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] xfsctl 2024-03-07T07:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bstat 2024-03-07T07:33:31.012 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mtab 2024-03-07T07:33:31.164 INFO:teuthology.orchestra.run.smithi084.stderr:t_mtab.c: In function 'update_mtab': 2024-03-07T07:33:31.164 INFO:teuthology.orchestra.run.smithi084.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:31.164 INFO:teuthology.orchestra.run.smithi084.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2024-03-07T07:33:31.164 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:31.244 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] getdevicesize 2024-03-07T07:33:31.427 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] preallo_rw_pattern_reader 2024-03-07T07:33:31.613 INFO:teuthology.orchestra.run.smithi084.stderr:In file included from preallo_rw_pattern_reader.c:2: 2024-03-07T07:33:31.613 INFO:teuthology.orchestra.run.smithi084.stderr:iopat.c: In function 'main': 2024-03-07T07:33:31.613 INFO:teuthology.orchestra.run.smithi084.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:31.614 INFO:teuthology.orchestra.run.smithi084.stderr: 38 | read(fd, &x, 1048576); 2024-03-07T07:33:31.614 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:31.658 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] preallo_rw_pattern_writer 2024-03-07T07:33:31.816 INFO:teuthology.orchestra.run.smithi084.stderr:In file included from preallo_rw_pattern_writer.c:2: 2024-03-07T07:33:31.817 INFO:teuthology.orchestra.run.smithi084.stderr:iopat.c: In function 'main': 2024-03-07T07:33:31.817 INFO:teuthology.orchestra.run.smithi084.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:31.817 INFO:teuthology.orchestra.run.smithi084.stderr: 34 | write(fd, &x, 1048576); 2024-03-07T07:33:31.817 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:31.859 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] ftrunc 2024-03-07T07:33:32.050 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] trunc 2024-03-07T07:33:32.274 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fs_perms 2024-03-07T07:33:32.459 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c: In function 'main': 2024-03-07T07:33:32.459 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:32.459 INFO:teuthology.orchestra.run.smithi084.stderr: 54 | system("rm -f test.file"); 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c: In function 'testsetup': 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr: 67 | system("cp testx.file test.file"); 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr: 69 | chown("test.file",cuserId,cgroupId); 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c: In function 'testfperm': 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr: 123 | seteuid(0); 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~ 2024-03-07T07:33:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:32.461 INFO:teuthology.orchestra.run.smithi084.stderr: 124 | setegid(0); 2024-03-07T07:33:32.461 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~ 2024-03-07T07:33:32.515 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] testx 2024-03-07T07:33:32.681 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] looptest 2024-03-07T07:33:32.920 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] locktest 2024-03-07T07:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] unwritten_mmap 2024-03-07T07:33:33.489 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_unlink_test 2024-03-07T07:33:33.672 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test.c: In function 'main': 2024-03-07T07:33:33.672 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:33.672 INFO:teuthology.orchestra.run.smithi084.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2024-03-07T07:33:33.672 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:33.672 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:33.672 INFO:teuthology.orchestra.run.smithi084.stderr: 178 | system(fname); 2024-03-07T07:33:33.672 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~ 2024-03-07T07:33:33.759 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] deduperace 2024-03-07T07:33:34.000 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_unlink_test_modified 2024-03-07T07:33:34.157 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr: 83 | write(fd, fname, sizeof(fname)); 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr: 139 | write(fd, fname, sizeof(fname)); 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr: 185 | system(fname); 2024-03-07T07:33:34.158 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~ 2024-03-07T07:33:34.240 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_offset 2024-03-07T07:33:34.427 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_futimens 2024-03-07T07:33:34.608 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_immutable 2024-03-07T07:33:34.781 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'create_test_area': 2024-03-07T07:33:34.781 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.781 INFO:teuthology.orchestra.run.smithi084.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2024-03-07T07:33:34.781 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.781 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.781 INFO:teuthology.orchestra.run.smithi084.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2024-03-07T07:33:34.781 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.782 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'remove_test_area': 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.783 INFO:teuthology.orchestra.run.smithi084.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2024-03-07T07:33:34.784 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.784 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.784 INFO:teuthology.orchestra.run.smithi084.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2024-03-07T07:33:34.784 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.784 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'check_test_area': 2024-03-07T07:33:34.784 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.784 INFO:teuthology.orchestra.run.smithi084.stderr: 1788 | asprintf(&path, "%s/", dir); 2024-03-07T07:33:34.784 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.787 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-03-07T07:33:34.788 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'test_immutable': 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr: 408 | chown(path, 0, 0); 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2024-03-07T07:33:34.789 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr: 553 | chown(path, 0, 0); 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2024-03-07T07:33:34.791 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: 653 | chown(path, 0, 0); 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: 705 | chown(path, 0, 0); 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.792 INFO:teuthology.orchestra.run.smithi084.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-03-07T07:33:34.793 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'test_append': 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr: 1051 | chown(path, 0, 0); 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: 1516 | chown(path, 0, 0); 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.796 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2024-03-07T07:33:34.797 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr: 1618 | chown(path, 0, 0); 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr: 1644 | chown(path, 0, 0); 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-03-07T07:33:34.798 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr: 1692 | chown(path, 0, 0); 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-03-07T07:33:34.799 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:35.339 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] stale_handle 2024-03-07T07:33:35.496 INFO:teuthology.orchestra.run.smithi084.stderr:stale_handle.c: In function 'main': 2024-03-07T07:33:35.496 INFO:teuthology.orchestra.run.smithi084.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:35.496 INFO:teuthology.orchestra.run.smithi084.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2024-03-07T07:33:35.496 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:35.553 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] pwrite_mmap_blocked 2024-03-07T07:33:35.748 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_offset2 2024-03-07T07:33:35.984 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] seek_sanity_test 2024-03-07T07:33:36.150 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c: In function 'test18': 2024-03-07T07:33:36.150 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:36.150 INFO:teuthology.orchestra.run.smithi084.stderr: 460 | ftruncate(fd, 0); 2024-03-07T07:33:36.150 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:36.152 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c: In function 'test_basic_support': 2024-03-07T07:33:36.152 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:36.152 INFO:teuthology.orchestra.run.smithi084.stderr: 1207 | ftruncate(fd, 0); 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: 1256 | ftruncate(fd, 0); 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: 88 | ftruncate(fd, 0); 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: 89 | pwrite(fd, "a", 1, offset); 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: 98 | ftruncate(fd, 0); 2024-03-07T07:33:36.153 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2024-03-07T07:33:36.154 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:36.154 INFO:teuthology.orchestra.run.smithi084.stderr: 99 | pwrite(fd, "a", 1, offset); 2024-03-07T07:33:36.154 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:36.467 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] seek_copy_test 2024-03-07T07:33:36.703 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_1 2024-03-07T07:33:36.861 INFO:teuthology.orchestra.run.smithi084.stderr:t_readdir_1.c: In function 'main': 2024-03-07T07:33:36.861 INFO:teuthology.orchestra.run.smithi084.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:36.861 INFO:teuthology.orchestra.run.smithi084.stderr: 30 | read(fd, buf, 100); 2024-03-07T07:33:36.861 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:36.904 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_2 2024-03-07T07:33:37.107 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsync-tester 2024-03-07T07:33:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c: In function 'main': 2024-03-07T07:33:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:37.256 INFO:teuthology.orchestra.run.smithi084.stderr: 391 | read(fd, &seed, sizeof(seed)); 2024-03-07T07:33:37.256 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:37.256 INFO:teuthology.orchestra.run.smithi084.stderr: 541 | system("reboot -fn"); 2024-03-07T07:33:37.256 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:37.257 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c: In function 'drop_all_caches': 2024-03-07T07:33:37.257 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:37.257 INFO:teuthology.orchestra.run.smithi084.stderr: 90 | write(fd, value, sizeof(value)-1); 2024-03-07T07:33:37.257 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:37.405 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] nsexec 2024-03-07T07:33:37.628 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] cloner 2024-03-07T07:33:37.851 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] renameat2 2024-03-07T07:33:38.060 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_getcwd 2024-03-07T07:33:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:t_getcwd.c: In function 'test_getcwd': 2024-03-07T07:33:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:38.209 INFO:teuthology.orchestra.run.smithi084.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2024-03-07T07:33:38.209 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:38.263 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] e4compact 2024-03-07T07:33:38.510 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] test-nextquota 2024-03-07T07:33:38.735 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] punch-alternating 2024-03-07T07:33:38.957 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-07T07:33:39.200 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] listxattr 2024-03-07T07:33:39.384 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-interleaved 2024-03-07T07:33:39.589 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_type 2024-03-07T07:33:39.808 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-invalidate-cache 2024-03-07T07:33:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:dio-invalidate-cache.c: In function 'main': 2024-03-07T07:33:39.985 INFO:teuthology.orchestra.run.smithi084.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:39.985 INFO:teuthology.orchestra.run.smithi084.stderr: 286 | write(fd, buf, blksz * nr_child); 2024-03-07T07:33:39.985 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:40.083 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] stat_test 2024-03-07T07:33:40.418 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_encrypted_d_revalidate 2024-03-07T07:33:40.625 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] attr_replace_test 2024-03-07T07:33:40.832 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] swapon 2024-03-07T07:33:41.042 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mkswap 2024-03-07T07:33:41.235 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_attr_corruption 2024-03-07T07:33:41.427 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_open_tmpfiles 2024-03-07T07:33:41.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:33:41.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:33:41.678 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fscrypt-crypt-util 2024-03-07T07:33:42.416 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_null_ocount 2024-03-07T07:33:42.652 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] splice-test 2024-03-07T07:33:42.877 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] chprojid_fail 2024-03-07T07:33:43.093 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] detached_mounts_propagation 2024-03-07T07:33:43.321 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] ext4_resize 2024-03-07T07:33:43.513 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_3 2024-03-07T07:33:43.750 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] splice2pipe 2024-03-07T07:33:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:splice2pipe.c: In function 'prepare_pipe': 2024-03-07T07:33:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:43.898 INFO:teuthology.orchestra.run.smithi084.stderr: 57 | write(p[1], buffer, n); 2024-03-07T07:33:43.898 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:43.899 INFO:teuthology.orchestra.run.smithi084.stderr: 65 | read(p[0], buffer, n); 2024-03-07T07:33:43.899 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:43.957 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] uuid_ioctl 2024-03-07T07:33:44.156 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-07T07:33:44.364 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fiemap-tester 2024-03-07T07:33:44.691 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_stripealign 2024-03-07T07:33:44.889 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] open_by_handle 2024-03-07T07:33:45.184 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_dio 2024-03-07T07:33:45.413 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] uring_read_fault 2024-03-07T07:33:45.645 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] xfsfind 2024-03-07T07:33:45.888 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_reflink_read_race 2024-03-07T07:33:46.154 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fssum 2024-03-07T07:33:46.654 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2024-03-07T07:33:46.662 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] replay-log 2024-03-07T07:33:47.040 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2024-03-07T07:33:47.046 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2024-03-07T07:33:47.056 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aiocp 2024-03-07T07:33:47.332 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-07T07:33:47.559 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-append-write-read-race 2024-03-07T07:33:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-cow-race 2024-03-07T07:33:48.018 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-cycle-write 2024-03-07T07:33:48.163 INFO:teuthology.orchestra.run.smithi084.stderr:aio-dio-cycle-write.c: In function 'init_test': 2024-03-07T07:33:48.163 INFO:teuthology.orchestra.run.smithi084.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:48.163 INFO:teuthology.orchestra.run.smithi084.stderr: 83 | ftruncate(fd, buf_size); 2024-03-07T07:33:48.164 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:48.254 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-eof-race 2024-03-07T07:33:48.487 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-extend-stat 2024-03-07T07:33:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-fcntl-race 2024-03-07T07:33:48.910 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-hole-filling-race 2024-03-07T07:33:49.150 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-invalidate-failure 2024-03-07T07:33:49.362 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-invalidate-readahead 2024-03-07T07:33:49.576 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aiodio_sparse2 2024-03-07T07:33:49.749 INFO:teuthology.orchestra.run.smithi084.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2024-03-07T07:33:49.749 INFO:teuthology.orchestra.run.smithi084.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:49.750 INFO:teuthology.orchestra.run.smithi084.stderr: 111 | ftruncate(fd, filesize); 2024-03-07T07:33:49.750 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:49.750 INFO:teuthology.orchestra.run.smithi084.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2024-03-07T07:33:49.750 INFO:teuthology.orchestra.run.smithi084.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-03-07T07:33:49.750 INFO:teuthology.orchestra.run.smithi084.stderr: 274 | ftruncate(fd, size); 2024-03-07T07:33:49.750 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-07T07:33:49.872 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-subblock-eof-read 2024-03-07T07:33:50.064 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-write-verify 2024-03-07T07:33:50.313 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-07T07:33:50.493 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-07T07:33:50.680 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-last-ref-held-by-io 2024-03-07T07:33:50.905 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2024-03-07T07:33:50.914 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] vfstest 2024-03-07T07:33:55.238 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mount-idmapped 2024-03-07T07:33:55.710 INFO:teuthology.orchestra.run.smithi084.stdout:Building m4 2024-03-07T07:33:55.717 INFO:teuthology.orchestra.run.smithi084.stdout:Building common 2024-03-07T07:33:55.723 INFO:teuthology.orchestra.run.smithi084.stdout:Building tests 2024-03-07T07:33:55.734 INFO:teuthology.orchestra.run.smithi084.stdout:Building btrfs 2024-03-07T07:33:55.741 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/btrfs/group.list 2024-03-07T07:33:55.871 INFO:teuthology.orchestra.run.smithi084.stdout:Building ceph 2024-03-07T07:33:55.880 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ceph/group.list 2024-03-07T07:33:55.911 INFO:teuthology.orchestra.run.smithi084.stdout:Building cifs 2024-03-07T07:33:55.920 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/cifs/group.list 2024-03-07T07:33:55.947 INFO:teuthology.orchestra.run.smithi084.stdout:Building ext4 2024-03-07T07:33:55.955 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ext4/group.list 2024-03-07T07:33:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:Building f2fs 2024-03-07T07:33:56.045 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/f2fs/group.list 2024-03-07T07:33:56.082 INFO:teuthology.orchestra.run.smithi084.stdout:Building generic 2024-03-07T07:33:56.094 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/generic/group.list 2024-03-07T07:33:56.301 INFO:teuthology.orchestra.run.smithi084.stdout:Building nfs 2024-03-07T07:33:56.309 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/nfs/group.list 2024-03-07T07:33:56.340 INFO:teuthology.orchestra.run.smithi084.stdout:Building ocfs2 2024-03-07T07:33:56.349 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ocfs2/group.list 2024-03-07T07:33:56.378 INFO:teuthology.orchestra.run.smithi084.stdout:Building overlay 2024-03-07T07:33:56.387 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/overlay/group.list 2024-03-07T07:33:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2024-03-07T07:33:56.482 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/perf/group.list 2024-03-07T07:33:56.509 INFO:teuthology.orchestra.run.smithi084.stdout:Building selftest 2024-03-07T07:33:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/selftest/group.list 2024-03-07T07:33:56.544 INFO:teuthology.orchestra.run.smithi084.stdout:Building shared 2024-03-07T07:33:56.552 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/shared/group.list 2024-03-07T07:33:56.591 INFO:teuthology.orchestra.run.smithi084.stdout:Building tmpfs 2024-03-07T07:33:56.600 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/tmpfs/group.list 2024-03-07T07:33:56.631 INFO:teuthology.orchestra.run.smithi084.stdout:Building udf 2024-03-07T07:33:56.639 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/udf/group.list 2024-03-07T07:33:56.664 INFO:teuthology.orchestra.run.smithi084.stdout:Building xfs 2024-03-07T07:33:56.675 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/xfs/group.list 2024-03-07T07:33:56.889 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.NNXPT5PfHFxfstests-dev && exec sudo make install) 2024-03-07T07:33:56.931 INFO:teuthology.orchestra.run.smithi084.stdout:Building include 2024-03-07T07:33:56.937 INFO:teuthology.orchestra.run.smithi084.stdout:Building lib 2024-03-07T07:33:56.944 INFO:teuthology.orchestra.run.smithi084.stdout:Building ltp 2024-03-07T07:33:56.952 INFO:teuthology.orchestra.run.smithi084.stdout:Building src 2024-03-07T07:33:57.009 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2024-03-07T07:33:57.015 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2024-03-07T07:33:57.021 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2024-03-07T07:33:57.029 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2024-03-07T07:33:57.035 INFO:teuthology.orchestra.run.smithi084.stdout:Building m4 2024-03-07T07:33:57.041 INFO:teuthology.orchestra.run.smithi084.stdout:Building common 2024-03-07T07:33:57.048 INFO:teuthology.orchestra.run.smithi084.stdout:Building tests 2024-03-07T07:33:57.057 INFO:teuthology.orchestra.run.smithi084.stdout:Building btrfs 2024-03-07T07:33:57.066 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/btrfs/group.list 2024-03-07T07:33:57.197 INFO:teuthology.orchestra.run.smithi084.stdout:Building ceph 2024-03-07T07:33:57.205 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ceph/group.list 2024-03-07T07:33:57.237 INFO:teuthology.orchestra.run.smithi084.stdout:Building cifs 2024-03-07T07:33:57.245 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/cifs/group.list 2024-03-07T07:33:57.272 INFO:teuthology.orchestra.run.smithi084.stdout:Building ext4 2024-03-07T07:33:57.281 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ext4/group.list 2024-03-07T07:33:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Building f2fs 2024-03-07T07:33:57.371 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/f2fs/group.list 2024-03-07T07:33:57.409 INFO:teuthology.orchestra.run.smithi084.stdout:Building generic 2024-03-07T07:33:57.420 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/generic/group.list 2024-03-07T07:33:57.623 INFO:teuthology.orchestra.run.smithi084.stdout:Building nfs 2024-03-07T07:33:57.631 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/nfs/group.list 2024-03-07T07:33:57.663 INFO:teuthology.orchestra.run.smithi084.stdout:Building ocfs2 2024-03-07T07:33:57.672 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ocfs2/group.list 2024-03-07T07:33:57.701 INFO:teuthology.orchestra.run.smithi084.stdout:Building overlay 2024-03-07T07:33:57.709 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/overlay/group.list 2024-03-07T07:33:57.796 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2024-03-07T07:33:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/perf/group.list 2024-03-07T07:33:57.830 INFO:teuthology.orchestra.run.smithi084.stdout:Building selftest 2024-03-07T07:33:57.838 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/selftest/group.list 2024-03-07T07:33:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:Building shared 2024-03-07T07:33:57.874 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/shared/group.list 2024-03-07T07:33:57.911 INFO:teuthology.orchestra.run.smithi084.stdout:Building tmpfs 2024-03-07T07:33:57.919 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/tmpfs/group.list 2024-03-07T07:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout:Building udf 2024-03-07T07:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/udf/group.list 2024-03-07T07:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:Building xfs 2024-03-07T07:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/xfs/group.list 2024-03-07T07:33:58.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-07T07:33:58.201 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-07T07:33:58.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-07T07:33:58.205 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-07T07:33:58.205 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-07T07:33:58.210 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-07T07:33:58.230 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-07T07:33:58.384 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-07T07:33:58.404 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-07T07:33:58.433 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2024-03-07T07:33:58.439 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2024-03-07T07:33:58.445 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2024-03-07T07:33:58.452 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2024-03-07T07:33:58.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C log-writes install 2024-03-07T07:33:58.461 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-07T07:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-07T07:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C perf install 2024-03-07T07:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-07T07:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-07T07:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-07T07:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-07T07:33:58.596 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-07T07:33:58.708 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C vfs install 2024-03-07T07:33:58.711 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-07T07:33:58.731 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-07T07:33:58.761 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-07T07:33:58.781 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-07T07:34:01.615 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-07T07:34:01.835 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-07T07:34:01.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-07T07:34:01.884 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-07T07:34:01.885 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-07T07:34:01.888 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-07T07:34:01.908 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-07T07:34:02.198 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-07T07:34:02.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/btrfs/ install 2024-03-07T07:34:02.206 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-07T07:34:02.226 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 304 305 306 307 308 309 310 /var/lib/xfstests/tests/btrfs 2024-03-07T07:34:03.970 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-07T07:34:03.990 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out /var/lib/xfstests/tests/btrfs 2024-03-07T07:34:05.747 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ceph/ install 2024-03-07T07:34:05.750 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-07T07:34:05.771 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-07T07:34:05.812 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-07T07:34:05.833 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-07T07:34:05.875 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/cifs/ install 2024-03-07T07:34:05.879 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-07T07:34:05.899 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-07T07:34:05.919 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-07T07:34:05.939 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-07T07:34:05.959 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ext4/ install 2024-03-07T07:34:05.963 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-07T07:34:05.983 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-07T07:34:06.371 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-07T07:34:06.391 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-07T07:34:06.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/f2fs/ install 2024-03-07T07:34:06.806 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-07T07:34:06.828 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-07T07:34:06.853 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-07T07:34:06.873 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-07T07:34:06.899 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/generic/ install 2024-03-07T07:34:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-07T07:34:06.927 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-07T07:34:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-07T07:34:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-07T07:34:11.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:34:11.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:34:15.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/nfs/ install 2024-03-07T07:34:15.469 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-07T07:34:15.488 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-07T07:34:15.508 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-07T07:34:15.528 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-07T07:34:15.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/ocfs2/ install 2024-03-07T07:34:15.552 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-07T07:34:15.572 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-07T07:34:15.592 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-07T07:34:15.612 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-07T07:34:15.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/overlay/ install 2024-03-07T07:34:15.636 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-07T07:34:15.655 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-07T07:34:16.255 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-07T07:34:16.275 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-07T07:34:16.891 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/perf/ install 2024-03-07T07:34:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-07T07:34:16.915 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-07T07:34:16.937 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-07T07:34:16.957 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-07T07:34:16.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/selftest/ install 2024-03-07T07:34:16.981 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-07T07:34:17.002 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-07T07:34:17.049 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-07T07:34:17.069 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-07T07:34:17.116 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/shared/ install 2024-03-07T07:34:17.120 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-07T07:34:17.140 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-07T07:34:17.171 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-07T07:34:17.223 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-07T07:34:17.223 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/tmpfs/ install 2024-03-07T07:34:17.226 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-07T07:34:17.245 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-07T07:34:17.265 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-07T07:34:17.285 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-07T07:34:17.305 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/udf/ install 2024-03-07T07:34:17.308 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-07T07:34:17.328 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-07T07:34:17.348 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-07T07:34:17.368 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-07T07:34:17.388 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.NNXPT5PfHFxfstests-dev/tests/xfs/ install 2024-03-07T07:34:17.395 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-07T07:34:17.415 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-07T07:34:21.452 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-07T07:34:21.471 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-07T07:34:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-07T07:34:25.562 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-07T07:34:25.581 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-07T07:34:25.601 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-07T07:34:25.623 INFO:tasks.cephfs.test_acls:client is kernel mounted 2024-03-07T07:34:25.624 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-07T07:34:25.624 DEBUG:teuthology.orchestra.run.smithi084:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.NNXPT5PfHFxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-07T07:34:26.026 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2024-03-07T07:34:26.036 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 6.8.0-rc7-gdd5c1cd17167 #1 SMP PREEMPT_DYNAMIC Wed Mar 6 16:08:22 UTC 2024 2024-03-07T07:34:26.038 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2024-03-07T07:34:26.040 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAFbellfpmFBRAAxfDauhaAh5SVVEtgkfskOA== 172.21.15.84:6789:/scratch /tmp/tmp.jXK0QJcBgFscratch 2024-03-07T07:34:26.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.252 INFO:teuthology.orchestra.run.smithi084.stdout:generic/099 - output mismatch (see /tmp/tmp.NNXPT5PfHFxfstests-dev/results//generic/099.out.bad) 2024-03-07T07:34:27.258 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/099.out 2024-03-07 07:32:22.053063564 +0000 2024-03-07T07:34:27.258 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.NNXPT5PfHFxfstests-dev/results//generic/099.out.bad 2024-03-07 07:34:27.242622665 +0000 2024-03-07T07:34:27.258 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -9,42 +9,47 @@ 2024-03-07T07:34:27.258 INFO:teuthology.orchestra.run.smithi084.stdout: file1 [u::rwx,g::rw-,o::r--] 2024-03-07T07:34:27.258 INFO:teuthology.orchestra.run.smithi084.stdout: Try using single colon separator 2024-03-07T07:34:27.258 INFO:teuthology.orchestra.run.smithi084.stdout: Note: Old interface FAILed because of single colon - new one allows it 2024-03-07T07:34:27.258 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "file1": No data available 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to PASS 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: -file1 [u::r--,g::rwx,o::rw-] 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "file1": No data available 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: +file1 [u::rwx,g::rw-,o::r--] 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: --- Test sync of ACL with std permissions --- 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: --r--rwxrw- id1 id2 file1 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: --rw-rwxrw- id1 id2 file1 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: -file1 [u::rw-,g::rwx,o::rw-] 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: +-rwxrw-r-- id1 id2 file1 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: +-rwxrw-r-- id1 id2 file1 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: +file1 [u::rwx,g::rw-,o::r--] 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: --- Test owner permissions --- 2024-03-07T07:34:27.260 INFO:teuthology.orchestra.run.smithi084.stdout: -file1 [u::r-x,g::---,o::---] 2024-03-07T07:34:27.260 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "file1": No data available 2024-03-07T07:34:27.260 INFO:teuthology.orchestra.run.smithi084.stdout: +file1 [u::rwx,g::rw-,o::r--] 2024-03-07T07:34:27.260 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to PASS 2024-03-07T07:34:27.260 INFO:teuthology.orchestra.run.smithi084.stdout: Test was executed 2024-03-07T07:34:27.260 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to FAIL 2024-03-07T07:34:27.260 INFO:teuthology.orchestra.run.smithi084.stdout: ./file1: Permission denied 2024-03-07T07:34:27.260 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: --- Test group permissions --- 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: -file1 [u::---,g::r-x,o::---] 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "file1": No data available 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: +file1 [u::rwx,g::rw-,o::r--] 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to FAIL - acl1 is owner 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: -./file1: Permission denied 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: -Expect to PASS - acl2 matches group 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: Test was executed 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: +Expect to PASS - acl2 matches group 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: +./file1: Permission denied 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to PASS - acl2 matches sup group 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: -Test was executed 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: +./file1: Permission denied 2024-03-07T07:34:27.261 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to FAIL - acl3 is not in group 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: ./file1: Permission denied 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: --- Test other permissions --- 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: -file1 [u::---,g::---,o::r-x] 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "file1": No data available 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: +file1 [u::rwx,g::rw-,o::r--] 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to FAIL - acl1 is owner 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: -./file1: Permission denied 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: +Test was executed 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to FAIL - acl2 is in group 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: ./file1: Permission denied 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to FAIL - acl2 is in sup. group 2024-03-07T07:34:27.262 INFO:teuthology.orchestra.run.smithi084.stdout: ./file1: Permission denied 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to PASS - acl3 is not owner or in group 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: -Test was executed 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: +./file1: Permission denied 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: === Test Extended ACLs === 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -52,7 +57,7 @@ 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to FAIL as no MASK provided 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: chacl: access ACL 'u::---,g::---,o::---,u:id2:r-x': Missing or wrong entry at entry 3 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: Ensure that ACL has not been changed 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: -file1 [u::---,g::---,o::r-x] 2024-03-07T07:34:27.263 INFO:teuthology.orchestra.run.smithi084.stdout: +file1 [u::rwx,g::rw-,o::r--] 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: Expect to PASS - USER ACE matches user 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: file1 [u::---,u:id2:r-x,g::---,m::rwx,o::---] 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: Test was executed 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -91,6 +96,7 @@ 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: file1 [u::---,g::---,o::---] 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: === Test Default ACLs === 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "acldir": No data available 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: acldir [u::rwx,g::rwx,o::rwx/u::r-x,g::r--,o::---] 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: -r--r----- 0 0 file2 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: file2 [u::r--,g::r--,o::---] 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -102,6 +108,8 @@ 2024-03-07T07:34:27.264 INFO:teuthology.orchestra.run.smithi084.stdout: acldir [u::rwx,g::rwx,o::rwx/u::r-x,g::r--,o::---] 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: acldir/file2 [u::r--,g::r--,o::---] 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: Remove ACLs... 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: error removing access acl on "file1": No data available 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: error removing access acl on "acldir/file2": No data available 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: Note: Old interface would mean empty ACLs - now we show mode ACLs 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: file1 [u::---,g::---,o::---] 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: acldir [u::rwx,g::rwx,o::rwx] 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -109,93 +117,133 @@ 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: === Recursive change ACL === 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: Change #1... 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c5/5": No data available 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c0/0": No data available 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c7/7": No data available 2024-03-07T07:34:27.265 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c1/1": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c8/8": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c6/6": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c4/4": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c3/3": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c9/9": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c2/2": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/8/mumble": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/3/mumble": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/9/mumble": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/2/mumble": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/4/mumble": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/1/mumble": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/0/mumble": No data available 2024-03-07T07:34:27.266 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/5/mumble": No data available 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/7/mumble": No data available 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/6/mumble": No data available 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: root [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: root/a [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/0 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/0/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/0/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/1 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/1/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/1/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/2 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.267 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/2/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/2/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/3 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/3/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/3/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/4 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/4/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/4/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/5 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/5/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/5/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.268 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/6 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.269 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/6/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.269 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/6/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.269 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/7 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.269 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/7/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.269 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/7/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.269 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/8 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.269 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/8/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/8/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/9 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/9/mumble [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/9/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: root/b [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c0 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c0/0 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c0/0 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c1 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c1/1 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c1/1 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.270 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c2 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c2/2 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c2/2 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c3 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c3/3 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c3/3 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c4 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c4/4 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c4/4 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c5 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c5/5 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c5/5 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c6 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c6/6 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c6/6 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.271 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c7 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c7/7 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c7/7 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c8 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c8/8 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c8/8 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c9 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c9/9 [u::rwx,g::-w-,o::--x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c9/9 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: Change #2... 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c5/5": No data available 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c0/0": No data available 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c7/7": No data available 2024-03-07T07:34:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c1/1": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c8/8": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c6/6": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c4/4": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c3/3": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c9/9": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/b/c2/2": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/8/mumble": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/3/mumble": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/9/mumble": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/2/mumble": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/4/mumble": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/1/mumble": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/0/mumble": No data available 2024-03-07T07:34:27.273 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/5/mumble": No data available 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/7/mumble": No data available 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: +chacl: cannot set access acl on "root/a/6/mumble": No data available 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: root [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: root/a [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/0 [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/0/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/0/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/1 [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/1/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/1/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/2 [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/2/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/2/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/3 [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/3/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/3/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/4 [u::---,g::---,o::---] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/4/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/4/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/5 [u::---,g::---,o::---] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/5/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/5/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/6 [u::---,g::---,o::---] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/6/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/6/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/7 [u::---,g::---,o::---] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/7/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.275 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/7/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/8 [u::---,g::---,o::---] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/8/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/8/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: root/a/9 [u::---,g::---,o::---] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: -root/a/9/mumble [u::---,g::---,o::---] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: +root/a/9/mumble [u::rw-,g::r--,o::r--] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: root/b [u::---,g::---,o::---] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c0 [u::---,g::---,o::---] 2024-03-07T07:34:27.276 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c0/0 [u::---,g::---,o::---] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c0/0 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c1 [u::---,g::---,o::---] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c1/1 [u::---,g::---,o::---] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c1/1 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c2 [u::---,g::---,o::---] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c2/2 [u::---,g::---,o::---] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c2/2 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c3 [u::---,g::---,o::---] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c3/3 [u::---,g::---,o::---] 2024-03-07T07:34:27.277 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c3/3 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c4 [u::---,g::---,o::---] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c4/4 [u::---,g::---,o::---] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c4/4 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c5 [u::---,g::---,o::---] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c5/5 [u::---,g::---,o::---] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c5/5 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c6 [u::---,g::---,o::---] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c6/6 [u::---,g::---,o::---] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c6/6 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c7 [u::---,g::---,o::---] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c7/7 [u::---,g::---,o::---] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c7/7 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c8 [u::---,g::---,o::---] 2024-03-07T07:34:27.279 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c8/8 [u::---,g::---,o::---] 2024-03-07T07:34:27.279 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c8/8 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.279 INFO:teuthology.orchestra.run.smithi084.stdout: root/b/c9 [u::---,g::---,o::---] 2024-03-07T07:34:27.279 INFO:teuthology.orchestra.run.smithi084.stdout: -root/b/c9/9 [u::---,g::---,o::---] 2024-03-07T07:34:27.279 INFO:teuthology.orchestra.run.smithi084.stdout: +root/b/c9/9 [u::rwx,g::r-x,o::r-x] 2024-03-07T07:34:27.279 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.279 INFO:teuthology.orchestra.run.smithi084.stdout: === Test out error messages for ACL text parsing === 2024-03-07T07:34:27.279 INFO:teuthology.orchestra.run.smithi084.stdout: Note: Old interface gave more informative error msgs 2024-03-07T07:34:27.280 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/099 2024-03-07T07:34:27.280 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/099 2024-03-07T07:34:27.280 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2024-03-07T07:34:27.280 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:27.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:34:27.347 INFO:tasks.cephfs.test_acls:Command failed. 2024-03-07T07:34:27.347 INFO:tasks.cephfs.test_acls:Command return value: 1 2024-03-07T07:34:27.347 INFO:tasks.cephfs.test_acls:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi084 6.8.0-rc7-gdd5c1cd17167 #1 SMP PREEMPT_DYNAMIC Wed Mar 6 16:08:22 UTC 2024 MKFS_OPTIONS -- 172.21.15.84:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQAFbellfpmFBRAAxfDauhaAh5SVVEtgkfskOA== 172.21.15.84:6789:/scratch /tmp/tmp.jXK0QJcBgFscratch generic/099 - output mismatch (see /tmp/tmp.NNXPT5PfHFxfstests-dev/results//generic/099.out.bad) --- tests/generic/099.out 2024-03-07 07:32:22.053063564 +0000 +++ /tmp/tmp.NNXPT5PfHFxfstests-dev/results//generic/099.out.bad 2024-03-07 07:34:27.242622665 +0000 @@ -9,42 +9,47 @@ file1 [u::rwx,g::rw-,o::r--] Try using single colon separator Note: Old interface FAILed because of single colon - new one allows it +chacl: cannot set access acl on "file1": No data available Expect to PASS -file1 [u::r--,g::rwx,o::rw-] +chacl: cannot set access acl on "file1": No data available +file1 [u::rwx,g::rw-,o::r--] --- Test sync of ACL with std permissions --- --r--rwxrw- id1 id2 file1 --rw-rwxrw- id1 id2 file1 -file1 [u::rw-,g::rwx,o::rw-] +-rwxrw-r-- id1 id2 file1 +-rwxrw-r-- id1 id2 file1 +file1 [u::rwx,g::rw-,o::r--] --- Test owner permissions --- -file1 [u::r-x,g::---,o::---] +chacl: cannot set access acl on "file1": No data available +file1 [u::rwx,g::rw-,o::r--] Expect to PASS Test was executed Expect to FAIL ./file1: Permission denied --- Test group permissions --- -file1 [u::---,g::r-x,o::---] +chacl: cannot set access acl on "file1": No data available +file1 [u::rwx,g::rw-,o::r--] Expect to FAIL - acl1 is owner -./file1: Permission denied -Expect to PASS - acl2 matches group Test was executed +Expect to PASS - acl2 matches group +./file1: Permission denied Expect to PASS - acl2 matches sup group -Test was executed +./file1: Permission denied Expect to FAIL - acl3 is not in group ./file1: Permission denied --- Test other permissions --- -file1 [u::---,g::---,o::r-x] +chacl: cannot set access acl on "file1": No data available +file1 [u::rwx,g::rw-,o::r--] Expect to FAIL - acl1 is owner -./file1: Permission denied +Test was executed Expect to FAIL - acl2 is in group ./file1: Permission denied Expect to FAIL - acl2 is in sup. group ./file1: Permission denied Expect to PASS - acl3 is not owner or in group -Test was executed +./file1: Permission denied === Test Extended ACLs === @@ -52,7 +57,7 @@ Expect to FAIL as no MASK provided chacl: access ACL 'u::---,g::---,o::---,u:id2:r-x': Missing or wrong entry at entry 3 Ensure that ACL has not been changed -file1 [u::---,g::---,o::r-x] +file1 [u::rwx,g::rw-,o::r--] Expect to PASS - USER ACE matches user file1 [u::---,u:id2:r-x,g::---,m::rwx,o::---] Test was executed @@ -91,6 +96,7 @@ file1 [u::---,g::---,o::---] === Test Default ACLs === +chacl: cannot set access acl on "acldir": No data available acldir [u::rwx,g::rwx,o::rwx/u::r-x,g::r--,o::---] -r--r----- 0 0 file2 file2 [u::r--,g::r--,o::---] @@ -102,6 +108,8 @@ acldir [u::rwx,g::rwx,o::rwx/u::r-x,g::r--,o::---] acldir/file2 [u::r--,g::r--,o::---] Remove ACLs... +chacl: error removing access acl on "file1": No data available +chacl: error removing access acl on "acldir/file2": No data available Note: Old interface would mean empty ACLs - now we show mode ACLs file1 [u::---,g::---,o::---] acldir [u::rwx,g::rwx,o::rwx] @@ -109,93 +117,133 @@ === Recursive change ACL === Change #1... +chacl: cannot set access acl on "root/b/c5/5": No data available +chacl: cannot set access acl on "root/b/c0/0": No data available +chacl: cannot set access acl on "root/b/c7/7": No data available +chacl: cannot set access acl on "root/b/c1/1": No data available +chacl: cannot set access acl on "root/b/c8/8": No data available +chacl: cannot set access acl on "root/b/c6/6": No data available +chacl: cannot set access acl on "root/b/c4/4": No data available +chacl: cannot set access acl on "root/b/c3/3": No data available +chacl: cannot set access acl on "root/b/c9/9": No data available +chacl: cannot set access acl on "root/b/c2/2": No data available +chacl: cannot set access acl on "root/a/8/mumble": No data available +chacl: cannot set access acl on "root/a/3/mumble": No data available +chacl: cannot set access acl on "root/a/9/mumble": No data available +chacl: cannot set access acl on "root/a/2/mumble": No data available +chacl: cannot set access acl on "root/a/4/mumble": No data available +chacl: cannot set access acl on "root/a/1/mumble": No data available +chacl: cannot set access acl on "root/a/0/mumble": No data available +chacl: cannot set access acl on "root/a/5/mumble": No data available +chacl: cannot set access acl on "root/a/7/mumble": No data available +chacl: cannot set access acl on "root/a/6/mumble": No data available root [u::rwx,g::-w-,o::--x] root/a [u::rwx,g::-w-,o::--x] root/a/0 [u::rwx,g::-w-,o::--x] -root/a/0/mumble [u::rwx,g::-w-,o::--x] +root/a/0/mumble [u::rw-,g::r--,o::r--] root/a/1 [u::rwx,g::-w-,o::--x] -root/a/1/mumble [u::rwx,g::-w-,o::--x] +root/a/1/mumble [u::rw-,g::r--,o::r--] root/a/2 [u::rwx,g::-w-,o::--x] -root/a/2/mumble [u::rwx,g::-w-,o::--x] +root/a/2/mumble [u::rw-,g::r--,o::r--] root/a/3 [u::rwx,g::-w-,o::--x] -root/a/3/mumble [u::rwx,g::-w-,o::--x] +root/a/3/mumble [u::rw-,g::r--,o::r--] root/a/4 [u::rwx,g::-w-,o::--x] -root/a/4/mumble [u::rwx,g::-w-,o::--x] +root/a/4/mumble [u::rw-,g::r--,o::r--] root/a/5 [u::rwx,g::-w-,o::--x] -root/a/5/mumble [u::rwx,g::-w-,o::--x] +root/a/5/mumble [u::rw-,g::r--,o::r--] root/a/6 [u::rwx,g::-w-,o::--x] -root/a/6/mumble [u::rwx,g::-w-,o::--x] +root/a/6/mumble [u::rw-,g::r--,o::r--] root/a/7 [u::rwx,g::-w-,o::--x] -root/a/7/mumble [u::rwx,g::-w-,o::--x] +root/a/7/mumble [u::rw-,g::r--,o::r--] root/a/8 [u::rwx,g::-w-,o::--x] -root/a/8/mumble [u::rwx,g::-w-,o::--x] +root/a/8/mumble [u::rw-,g::r--,o::r--] root/a/9 [u::rwx,g::-w-,o::--x] -root/a/9/mumble [u::rwx,g::-w-,o::--x] +root/a/9/mumble [u::rw-,g::r--,o::r--] root/b [u::rwx,g::-w-,o::--x] root/b/c0 [u::rwx,g::-w-,o::--x] -root/b/c0/0 [u::rwx,g::-w-,o::--x] +root/b/c0/0 [u::rwx,g::r-x,o::r-x] root/b/c1 [u::rwx,g::-w-,o::--x] -root/b/c1/1 [u::rwx,g::-w-,o::--x] +root/b/c1/1 [u::rwx,g::r-x,o::r-x] root/b/c2 [u::rwx,g::-w-,o::--x] -root/b/c2/2 [u::rwx,g::-w-,o::--x] +root/b/c2/2 [u::rwx,g::r-x,o::r-x] root/b/c3 [u::rwx,g::-w-,o::--x] -root/b/c3/3 [u::rwx,g::-w-,o::--x] +root/b/c3/3 [u::rwx,g::r-x,o::r-x] root/b/c4 [u::rwx,g::-w-,o::--x] -root/b/c4/4 [u::rwx,g::-w-,o::--x] +root/b/c4/4 [u::rwx,g::r-x,o::r-x] root/b/c5 [u::rwx,g::-w-,o::--x] -root/b/c5/5 [u::rwx,g::-w-,o::--x] +root/b/c5/5 [u::rwx,g::r-x,o::r-x] root/b/c6 [u::rwx,g::-w-,o::--x] -root/b/c6/6 [u::rwx,g::-w-,o::--x] +root/b/c6/6 [u::rwx,g::r-x,o::r-x] root/b/c7 [u::rwx,g::-w-,o::--x] -root/b/c7/7 [u::rwx,g::-w-,o::--x] +root/b/c7/7 [u::rwx,g::r-x,o::r-x] root/b/c8 [u::rwx,g::-w-,o::--x] -root/b/c8/8 [u::rwx,g::-w-,o::--x] +root/b/c8/8 [u::rwx,g::r-x,o::r-x] root/b/c9 [u::rwx,g::-w-,o::--x] -root/b/c9/9 [u::rwx,g::-w-,o::--x] +root/b/c9/9 [u::rwx,g::r-x,o::r-x] Change #2... +chacl: cannot set access acl on "root/b/c5/5": No data available +chacl: cannot set access acl on "root/b/c0/0": No data available +chacl: cannot set access acl on "root/b/c7/7": No data available +chacl: cannot set access acl on "root/b/c1/1": No data available +chacl: cannot set access acl on "root/b/c8/8": No data available +chacl: cannot set access acl on "root/b/c6/6": No data available +chacl: cannot set access acl on "root/b/c4/4": No data available +chacl: cannot set access acl on "root/b/c3/3": No data available +chacl: cannot set access acl on "root/b/c9/9": No data available +chacl: cannot set access acl on "root/b/c2/2": No data available +chacl: cannot set access acl on "root/a/8/mumble": No data available +chacl: cannot set access acl on "root/a/3/mumble": No data available +chacl: cannot set access acl on "root/a/9/mumble": No data available +chacl: cannot set access acl on "root/a/2/mumble": No data available +chacl: cannot set access acl on "root/a/4/mumble": No data available +chacl: cannot set access acl on "root/a/1/mumble": No data available +chacl: cannot set access acl on "root/a/0/mumble": No data available +chacl: cannot set access acl on "root/a/5/mumble": No data available +chacl: cannot set access acl on "root/a/7/mumble": No data available +chacl: cannot set access acl on "root/a/6/mumble": No data available root [u::---,g::---,o::---] root/a [u::---,g::---,o::---] root/a/0 [u::---,g::---,o::---] -root/a/0/mumble [u::---,g::---,o::---] +root/a/0/mumble [u::rw-,g::r--,o::r--] root/a/1 [u::---,g::---,o::---] -root/a/1/mumble [u::---,g::---,o::---] +root/a/1/mumble [u::rw-,g::r--,o::r--] root/a/2 [u::---,g::---,o::---] -root/a/2/mumble [u::---,g::---,o::---] +root/a/2/mumble [u::rw-,g::r--,o::r--] root/a/3 [u::---,g::---,o::---] -root/a/3/mumble [u::---,g::---,o::---] +root/a/3/mumble [u::rw-,g::r--,o::r--] root/a/4 [u::---,g::---,o::---] -root/a/4/mumble [u::---,g::---,o::---] +root/a/4/mumble [u::rw-,g::r--,o::r--] root/a/5 [u::---,g::---,o::---] -root/a/5/mumble [u::---,g::---,o::---] +root/a/5/mumble [u::rw-,g::r--,o::r--] root/a/6 [u::---,g::---,o::---] -root/a/6/mumble [u::---,g::---,o::---] +root/a/6/mumble [u::rw-,g::r--,o::r--] root/a/7 [u::---,g::---,o::---] -root/a/7/mumble [u::---,g::---,o::---] +root/a/7/mumble [u::rw-,g::r--,o::r--] root/a/8 [u::---,g::---,o::---] -root/a/8/mumble [u::---,g::---,o::---] +root/a/8/mumble [u::rw-,g::r--,o::r--] root/a/9 [u::---,g::---,o::---] -root/a/9/mumble [u::---,g::---,o::---] +root/a/9/mumble [u::rw-,g::r--,o::r--] root/b [u::---,g::---,o::---] root/b/c0 [u::---,g::---,o::---] -root/b/c0/0 [u::---,g::---,o::---] +root/b/c0/0 [u::rwx,g::r-x,o::r-x] root/b/c1 [u::---,g::---,o::---] -root/b/c1/1 [u::---,g::---,o::---] +root/b/c1/1 [u::rwx,g::r-x,o::r-x] root/b/c2 [u::---,g::---,o::---] -root/b/c2/2 [u::---,g::---,o::---] +root/b/c2/2 [u::rwx,g::r-x,o::r-x] root/b/c3 [u::---,g::---,o::---] -root/b/c3/3 [u::---,g::---,o::---] +root/b/c3/3 [u::rwx,g::r-x,o::r-x] root/b/c4 [u::---,g::---,o::---] -root/b/c4/4 [u::---,g::---,o::---] +root/b/c4/4 [u::rwx,g::r-x,o::r-x] root/b/c5 [u::---,g::---,o::---] -root/b/c5/5 [u::---,g::---,o::---] +root/b/c5/5 [u::rwx,g::r-x,o::r-x] root/b/c6 [u::---,g::---,o::---] -root/b/c6/6 [u::---,g::---,o::---] +root/b/c6/6 [u::rwx,g::r-x,o::r-x] root/b/c7 [u::---,g::---,o::---] -root/b/c7/7 [u::---,g::---,o::---] +root/b/c7/7 [u::rwx,g::r-x,o::r-x] root/b/c8 [u::---,g::---,o::---] -root/b/c8/8 [u::---,g::---,o::---] +root/b/c8/8 [u::rwx,g::r-x,o::r-x] root/b/c9 [u::---,g::---,o::---] -root/b/c9/9 [u::---,g::---,o::---] +root/b/c9/9 [u::rwx,g::r-x,o::r-x] === Test out error messages for ACL text parsing === Note: Old interface gave more informative error msgs Ran: generic/099 Failures: generic/099 Failed 1 of 1 tests 2024-03-07T07:34:27.347 INFO:tasks.cephfs.test_acls:Command stderr - 2024-03-07T07:34:27.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo userdel --force --remove fsgqa 2024-03-07T07:34:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2024-03-07T07:34:27.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo userdel --force --remove 123456-fsgqa 2024-03-07T07:34:28.189 INFO:teuthology.orchestra.run.smithi084.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2024-03-07T07:34:28.189 INFO:teuthology.orchestra.run.smithi084.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2024-03-07T07:34:28.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo groupdel fsgqa 2024-03-07T07:34:28.572 INFO:teuthology.orchestra.run.smithi084.stderr:groupdel: group 'fsgqa' does not exist 2024-03-07T07:34:28.574 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-03-07T07:34:28.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:28.574 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.NNXPT5PfHFxfstests-dev/results) 2024-03-07T07:34:28.634 INFO:teuthology.orchestra.run.smithi084.stdout: File: /tmp/tmp.NNXPT5PfHFxfstests-dev/results 2024-03-07T07:34:28.635 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-03-07T07:34:28.635 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 801h/2049d Inode: 688113 Links: 3 2024-03-07T07:34:28.635 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T07:34:28.635 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-07 07:34:25.978634181 +0000 2024-03-07T07:34:28.635 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-07 07:34:27.254622557 +0000 2024-03-07T07:34:28.635 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-07 07:34:27.254622557 +0000 2024-03-07T07:34:28.635 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-07 07:34:25.978634181 +0000 2024-03-07T07:34:28.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:28.637 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-03-07T07:34:28.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:28.696 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.NNXPT5PfHFxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-03-07T07:34:28.757 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.NNXPT5PfHFxfstests-dev to /var/log/ceph. 2024-03-07T07:34:28.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf /tmp/tmp.NNXPT5PfHFxfstests-dev 2024-03-07T07:34:29.018 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-07T07:34:29.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-07T07:34:29.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-07T07:34:29.188 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-07T07:34:29.189 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:34:29.189 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:29.198 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:34:29.198 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:29.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:34:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.426+0000 7f6343400640 1 Processor -- start 2024-03-07T07:34:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.426+0000 7f6343400640 1 -- start start 2024-03-07T07:34:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f6343400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c071600 0x7f633c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f6343400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c0724f0 con 0x7f633c147d10 2024-03-07T07:34:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f6343400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c0b0f80 con 0x7f633c0b08d0 2024-03-07T07:34:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f6343400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c1480f0 con 0x7f633c071600 2024-03-07T07:34:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f6340a00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f633c147d10 0x7f633c0b01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55738/0 (socket says 172.21.15.84:55738) 2024-03-07T07:34:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f6340a00640 1 -- 172.21.15.84:0/3027949443 learned_addr learned my addr 172.21.15.84:0/3027949443 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f6341400640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c071600 0x7f633c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568501121 0 0) 0x7f6330001120 con 0x7f633c147d10 2024-03-07T07:34:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6324003530 con 0x7f633c147d10 2024-03-07T07:34:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3091587299 0 0) 0x7f6324003530 con 0x7f633c147d10 2024-03-07T07:34:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c071600 msgr2=0x7f633c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c071600 0x7f633c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 >> v1:172.21.15.161:6789/0 conn(0x7f633c0b08d0 legacy=0x7f633c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0732f0 con 0x7f633c147d10 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f6330001850 con 0x7f633c147d10 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 >> v1:172.21.15.84:6789/0 conn(0x7f633c147d10 legacy=0x7f633c0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c071600 0x7f63240039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f6324004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6324004d50 0x7f63240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c1480f0 con 0x7f6324003f30 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632400ba30 con 0x7f6324004d50 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632400bc30 con 0x7f633c071600 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633be00640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f6324004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633be00640 1 -- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c071600 msgr2=0x7f63240039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633be00640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c071600 0x7f63240039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633be00640 1 -- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6324004d50 msgr2=0x7f63240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633be00640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6324004d50 0x7f63240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.430+0000 7f633be00640 1 -- 172.21.15.84:0/3027949443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6324003530 con 0x7f6324003f30 2024-03-07T07:34:29.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f633be00640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f6324004810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6328001860 tx=0x7f632801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ecbca3e8f8c34 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280b0070 con 0x7f6324003f30 2024-03-07T07:34:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63280ab600 con 0x7f6324003f30 2024-03-07T07:34:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f633b400640 1 -- 172.21.15.84:0/3027949443 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328001460 con 0x7f6324003f30 2024-03-07T07:34:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f6343400640 1 -- 172.21.15.84:0/3027949443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 msgr2=0x7f6324004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f6343400640 1 --2- 172.21.15.84:0/3027949443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f6324004810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6328001860 tx=0x7f632801c410 comp rx=0 tx=0).stop 2024-03-07T07:34:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f6341400640 1 -- 172.21.15.84:0/3027949443 reap_dead start 2024-03-07T07:34:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f6343400640 1 -- 172.21.15.84:0/3027949443 shutdown_connections 2024-03-07T07:34:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f6343400640 1 -- 172.21.15.84:0/3027949443 >> 172.21.15.84:0/3027949443 conn(0x7f633c0b1ed0 msgr2=0x7f633c0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f6343400640 1 -- 172.21.15.84:0/3027949443 shutdown_connections 2024-03-07T07:34:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f6343400640 1 -- 172.21.15.84:0/3027949443 wait complete. 2024-03-07T07:34:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.434+0000 7f6343400640 1 Processor -- start 2024-03-07T07:34:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 -- start start 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f633c148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c15d560 0x7f633c13ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b43e0 0x7f633c0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0d06d0 con 0x7f6324003f30 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c073010 con 0x7f633c15d560 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0d0850 con 0x7f633c0b43e0 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f633c148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f633c148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40352/0 (socket says 172.21.15.84:40352) 2024-03-07T07:34:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 -- 172.21.15.84:0/1959005829 learned_addr learned my addr 172.21.15.84:0/1959005829 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 -- 172.21.15.84:0/1959005829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b43e0 msgr2=0x7f633c0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b43e0 0x7f633c0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 -- 172.21.15.84:0/1959005829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c15d560 msgr2=0x7f633c13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c15d560 0x7f633c13ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 -- 172.21.15.84:0/1959005829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c148850 con 0x7f6324003f30 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6340a00640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f633c148270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6330000f70 tx=0x7f633000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6338c00640 1 -- 172.21.15.84:0/1959005829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330018070 con 0x7f6324003f30 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6338c00640 1 -- 172.21.15.84:0/1959005829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633000ce50 con 0x7f6324003f30 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c148b30 con 0x7f6324003f30 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6338c00640 1 -- 172.21.15.84:0/1959005829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300047f0 con 0x7f6324003f30 2024-03-07T07:34:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c1490f0 con 0x7f6324003f30 2024-03-07T07:34:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.438+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c062d40 con 0x7f6324003f30 2024-03-07T07:34:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.442+0000 7f6338c00640 1 -- 172.21.15.84:0/1959005829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f633001b070 con 0x7f6324003f30 2024-03-07T07:34:29.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.442+0000 7f6338c00640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f631c066f60 0x7f631c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.442+0000 7f6338c00640 1 -- 172.21.15.84:0/1959005829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6330084620 con 0x7f6324003f30 2024-03-07T07:34:29.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.442+0000 7f633be00640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f631c066f60 0x7f631c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.442+0000 7f633be00640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f631c066f60 0x7f631c069420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63280ad000 tx=0x7f6328001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.446+0000 7f6338c00640 1 -- 172.21.15.84:0/1959005829 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f633c0724f0 con 0x7f6324003f30 2024-03-07T07:34:29.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.602+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f633c0cfc60 con 0x7f6324003f30 2024-03-07T07:34:29.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.602+0000 7f6338c00640 1 -- 172.21.15.84:0/1959005829 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16822 (secure 0 0 0) 0x7f6330055510 con 0x7f6324003f30 2024-03-07T07:34:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:29.609 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:32:54.985899+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:32:07.581845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-07T07:32:08.085165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.5","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:34:29.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f631c066f60 msgr2=0x7f631c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f631c066f60 0x7f631c069420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63280ad000 tx=0x7f6328001240 comp rx=0 tx=0).stop 2024-03-07T07:34:29.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 msgr2=0x7f633c148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f633c148270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6330000f70 tx=0x7f633000cc00 comp rx=0 tx=0).stop 2024-03-07T07:34:29.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 shutdown_connections 2024-03-07T07:34:29.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f631c066f60 0x7f631c069420 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b43e0 0x7f633c0b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c15d560 0x7f633c13ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 --2- 172.21.15.84:0/1959005829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6324003f30 0x7f633c148270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 >> 172.21.15.84:0/1959005829 conn(0x7f633c0b1ed0 msgr2=0x7f633c06ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:29.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 shutdown_connections 2024-03-07T07:34:29.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.606+0000 7f6343400640 1 -- 172.21.15.84:0/1959005829 wait complete. 2024-03-07T07:34:29.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:32:07.581845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:32:08.085165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:34:29.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:34:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.782+0000 7f23c5000640 1 Processor -- start 2024-03-07T07:34:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.782+0000 7f23c5000640 1 -- start start 2024-03-07T07:34:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.782+0000 7f23c5000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23c01472d0 0x7f23c01625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.782+0000 7f23c5000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c0162b30 con 0x7f23c0147940 2024-03-07T07:34:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.782+0000 7f23c5000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c00ae270 con 0x7f23c00b4990 2024-03-07T07:34:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.782+0000 7f23c5000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c00ae510 con 0x7f23c01472d0 2024-03-07T07:34:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23b5400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f23c0147940 0x7f23c00719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55752/0 (socket says 172.21.15.84:55752) 2024-03-07T07:34:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23b5400640 1 -- 172.21.15.84:0/2837336668 learned_addr learned my addr 172.21.15.84:0/2837336668 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23bde00640 1 --2- 172.21.15.84:0/2837336668 >> v2:172.21.15.161:3300/0 conn(0x7f23c01472d0 0x7f23c01625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23bd400640 1 -- 172.21.15.84:0/2837336668 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213910688 0 0) 0x7f23a8001120 con 0x7f23c0147940 2024-03-07T07:34:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23bd400640 1 -- 172.21.15.84:0/2837336668 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a4003530 con 0x7f23c0147940 2024-03-07T07:34:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23bde00640 1 -- 172.21.15.84:0/2837336668 >> v1:172.21.15.161:6789/0 conn(0x7f23c00b4990 legacy=0x7f23c006e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23bde00640 1 -- 172.21.15.84:0/2837336668 >> v1:172.21.15.84:6789/0 conn(0x7f23c0147940 legacy=0x7f23c00719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23bde00640 1 -- 172.21.15.84:0/2837336668 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00ae7f0 con 0x7f23c01472d0 2024-03-07T07:34:29.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.786+0000 7f23bde00640 1 --2- 172.21.15.84:0/2837336668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 0x7f23c01625f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009d90 tx=0x7f23b001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be9f209b07b1d02c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:29.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23bd400640 1 -- 172.21.15.84:0/2837336668 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00b2070 con 0x7f23c01472d0 2024-03-07T07:34:29.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23bd400640 1 -- 172.21.15.84:0/2837336668 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b00a5920 con 0x7f23c01472d0 2024-03-07T07:34:29.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23bd400640 1 -- 172.21.15.84:0/2837336668 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00a5cd0 con 0x7f23c01472d0 2024-03-07T07:34:29.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- 172.21.15.84:0/2837336668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 msgr2=0x7f23c01625f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 --2- 172.21.15.84:0/2837336668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 0x7f23c01625f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009d90 tx=0x7f23b001c970 comp rx=0 tx=0).stop 2024-03-07T07:34:29.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- 172.21.15.84:0/2837336668 shutdown_connections 2024-03-07T07:34:29.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 --2- 172.21.15.84:0/2837336668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 0x7f23c01625f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- 172.21.15.84:0/2837336668 >> 172.21.15.84:0/2837336668 conn(0x7f23c00b1c50 msgr2=0x7f23c00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:29.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- 172.21.15.84:0/2837336668 shutdown_connections 2024-03-07T07:34:29.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- 172.21.15.84:0/2837336668 wait complete. 2024-03-07T07:34:29.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 Processor -- start 2024-03-07T07:34:29.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- start start 2024-03-07T07:34:29.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c00b4990 0x7f23c0168480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 0x7f23c01f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23c01f6bf0 0x7f23c0161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00720d0 con 0x7f23c00b4990 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c006eb60 con 0x7f23c01472d0 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23c5000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c013f110 con 0x7f23c01f6bf0 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23bde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c00b4990 0x7f23c0168480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23bde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c00b4990 0x7f23c0168480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40368/0 (socket says 172.21.15.84:40368) 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23bde00640 1 -- 172.21.15.84:0/1478996430 learned_addr learned my addr 172.21.15.84:0/1478996430 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23b5400640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 0x7f23c01f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.790+0000 7f23be800640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23c01f6bf0 0x7f23c0161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23bde00640 1 -- 172.21.15.84:0/1478996430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23c01f6bf0 msgr2=0x7f23c0161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23bde00640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23c01f6bf0 0x7f23c0161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23bde00640 1 -- 172.21.15.84:0/1478996430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 msgr2=0x7f23c01f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23bde00640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 0x7f23c01f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23bde00640 1 -- 172.21.15.84:0/1478996430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c013ee30 con 0x7f23c00b4990 2024-03-07T07:34:29.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23bde00640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c00b4990 0x7f23c0168480 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f23b00b0040 tx=0x7f23b0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:29.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23b6a00640 1 -- 172.21.15.84:0/1478996430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00bd070 con 0x7f23c00b4990 2024-03-07T07:34:29.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23b6a00640 1 -- 172.21.15.84:0/1478996430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0003bc0 con 0x7f23c00b4990 2024-03-07T07:34:29.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23b6a00640 1 -- 172.21.15.84:0/1478996430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00b2040 con 0x7f23c00b4990 2024-03-07T07:34:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c013f730 con 0x7f23c00b4990 2024-03-07T07:34:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c01689c0 con 0x7f23c00b4990 2024-03-07T07:34:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c0062d40 con 0x7f23c00b4990 2024-03-07T07:34:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23b6a00640 1 -- 172.21.15.84:0/1478996430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f23b0003fd0 con 0x7f23c00b4990 2024-03-07T07:34:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23b6a00640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f239c066f60 0x7f239c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.794+0000 7f23b6a00640 1 -- 172.21.15.84:0/1478996430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f23b011ff00 con 0x7f23c00b4990 2024-03-07T07:34:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.798+0000 7f23b5400640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f239c066f60 0x7f239c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.798+0000 7f23b5400640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f239c066f60 0x7f239c069420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f23c0145e40 tx=0x7f23a8007b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.798+0000 7f23b6a00640 1 -- 172.21.15.84:0/1478996430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f23b0016560 con 0x7f23c00b4990 2024-03-07T07:34:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.954+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23c00682a0 con 0x7f23c00b4990 2024-03-07T07:34:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.954+0000 7f23b6a00640 1 -- 172.21.15.84:0/1478996430 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23b00f0830 con 0x7f23c00b4990 2024-03-07T07:34:29.960 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:34:29.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f239c066f60 msgr2=0x7f239c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f239c066f60 0x7f239c069420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f23c0145e40 tx=0x7f23a8007b80 comp rx=0 tx=0).stop 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c00b4990 msgr2=0x7f23c0168480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c00b4990 0x7f23c0168480 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f23b00b0040 tx=0x7f23b0019710 comp rx=0 tx=0).stop 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 shutdown_connections 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f239c066f60 0x7f239c069420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23c01f6bf0 0x7f23c0161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23c01472d0 0x7f23c01f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 --2- 172.21.15.84:0/1478996430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23c00b4990 0x7f23c0168480 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 >> 172.21.15.84:0/1478996430 conn(0x7f23c00b1c50 msgr2=0x7f23c00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 shutdown_connections 2024-03-07T07:34:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:29.958+0000 7f23c5000640 1 -- 172.21.15.84:0/1478996430 wait complete. 2024-03-07T07:34:29.981 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:34:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f9a00640 1 Processor -- start 2024-03-07T07:34:30.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f9a00640 1 -- start start 2024-03-07T07:34:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f9a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6f409b0f0 0x7fa6f406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f9a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6f40b46c0 0x7fa6f406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f9a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f4071a60 con 0x7fa6f41618e0 2024-03-07T07:34:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f9a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40b17b0 con 0x7fa6f409b0f0 2024-03-07T07:34:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f9a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f4072390 con 0x7fa6f40b46c0 2024-03-07T07:34:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f2a00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa6f41618e0 0x7fa6f409a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55762/0 (socket says 172.21.15.84:55762) 2024-03-07T07:34:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6ebe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6f409b0f0 0x7fa6f406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f2a00640 1 -- 172.21.15.84:0/3121561464 learned_addr learned my addr 172.21.15.84:0/3121561464 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:30.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f3400640 1 --2- 172.21.15.84:0/3121561464 >> v2:172.21.15.161:3300/0 conn(0x7fa6f40b46c0 0x7fa6f406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6ebe00640 1 -- 172.21.15.84:0/3121561464 >> v2:172.21.15.161:3300/0 conn(0x7fa6f40b46c0 msgr2=0x7fa6f406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:30.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6ebe00640 1 --2- 172.21.15.84:0/3121561464 >> v2:172.21.15.161:3300/0 conn(0x7fa6f40b46c0 0x7fa6f406bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6ebe00640 1 -- 172.21.15.84:0/3121561464 >> v1:172.21.15.84:6789/0 conn(0x7fa6f41618e0 legacy=0x7fa6f409a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6ebe00640 1 -- 172.21.15.84:0/3121561464 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4071d40 con 0x7fa6f409b0f0 2024-03-07T07:34:30.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.118+0000 7fa6f2000640 1 -- 172.21.15.84:0/3121561464 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454853974 0 0) 0x7fa6f4071a60 con 0x7fa6f41618e0 2024-03-07T07:34:30.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6ebe00640 1 --2- 172.21.15.84:0/3121561464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f409b0f0 0x7fa6f406b6e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa6f406fb30 tx=0x7fa6dc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80133744dad85637 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f2000640 1 -- 172.21.15.84:0/3121561464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0b1070 con 0x7fa6f409b0f0 2024-03-07T07:34:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f2000640 1 -- 172.21.15.84:0/3121561464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc0ac5f0 con 0x7fa6f409b0f0 2024-03-07T07:34:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f2000640 1 -- 172.21.15.84:0/3121561464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0ac9c0 con 0x7fa6f409b0f0 2024-03-07T07:34:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f9a00640 1 -- 172.21.15.84:0/3121561464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f409b0f0 msgr2=0x7fa6f406b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/3121561464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f409b0f0 0x7fa6f406b6e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa6f406fb30 tx=0x7fa6dc01c480 comp rx=0 tx=0).stop 2024-03-07T07:34:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f9a00640 1 -- 172.21.15.84:0/3121561464 shutdown_connections 2024-03-07T07:34:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/3121561464 >> v2:172.21.15.161:3300/0 conn(0x7fa6f40b46c0 0x7fa6f406bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/3121561464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f409b0f0 0x7fa6f406b6e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f9a00640 1 -- 172.21.15.84:0/3121561464 >> 172.21.15.84:0/3121561464 conn(0x7fa6f40b3ba0 msgr2=0x7fa6f40b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f9a00640 1 -- 172.21.15.84:0/3121561464 shutdown_connections 2024-03-07T07:34:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.122+0000 7fa6f9a00640 1 -- 172.21.15.84:0/3121561464 wait complete. 2024-03-07T07:34:30.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 Processor -- start 2024-03-07T07:34:30.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 -- start start 2024-03-07T07:34:30.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6f409b0f0 0x7fa6f415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f40b46c0 0x7fa6f414c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6f41618e0 0x7fa6f40b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f416b2b0 con 0x7fa6f40b46c0 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f416b130 con 0x7fa6f409b0f0 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f416b430 con 0x7fa6f41618e0 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f40b46c0 0x7fa6f414c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f40b46c0 0x7fa6f414c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40384/0 (socket says 172.21.15.84:40384) 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 -- 172.21.15.84:0/698852659 learned_addr learned my addr 172.21.15.84:0/698852659 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 -- 172.21.15.84:0/698852659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6f41618e0 msgr2=0x7fa6f40b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6f41618e0 0x7fa6f40b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 -- 172.21.15.84:0/698852659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6f409b0f0 msgr2=0x7fa6f415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6f409b0f0 0x7fa6f415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 -- 172.21.15.84:0/698852659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40b0c90 con 0x7fa6f40b46c0 2024-03-07T07:34:30.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6ebe00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f40b46c0 0x7fa6f414c160 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc01c960 tx=0x7fa6dc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6eaa00640 1 -- 172.21.15.84:0/698852659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0b1040 con 0x7fa6f40b46c0 2024-03-07T07:34:30.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6eaa00640 1 -- 172.21.15.84:0/698852659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc0ba070 con 0x7fa6f40b46c0 2024-03-07T07:34:30.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6eaa00640 1 -- 172.21.15.84:0/698852659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0b5670 con 0x7fa6f40b46c0 2024-03-07T07:34:30.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f40b5050 con 0x7fa6f40b46c0 2024-03-07T07:34:30.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.126+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f40b09b0 con 0x7fa6f40b46c0 2024-03-07T07:34:30.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.130+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f4062d40 con 0x7fa6f40b46c0 2024-03-07T07:34:30.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.130+0000 7fa6eaa00640 1 -- 172.21.15.84:0/698852659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa6dc0b5810 con 0x7fa6f40b46c0 2024-03-07T07:34:30.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.130+0000 7fa6eaa00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa6d0066f90 0x7fa6d0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.130+0000 7fa6eaa00640 1 -- 172.21.15.84:0/698852659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa6dc11ee90 con 0x7fa6f40b46c0 2024-03-07T07:34:30.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.130+0000 7fa6f2a00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa6d0066f90 0x7fa6d0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.130+0000 7fa6f2a00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa6d0066f90 0x7fa6d0069450 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40015a0 tx=0x7fa6e4007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.134+0000 7fa6eaa00640 1 -- 172.21.15.84:0/698852659 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa6dc0a9070 con 0x7fa6f40b46c0 2024-03-07T07:34:30.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.286+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6f406d420 con 0x7fa6f40b46c0 2024-03-07T07:34:30.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.286+0000 7fa6eaa00640 1 -- 172.21.15.84:0/698852659 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6dc016070 con 0x7fa6f40b46c0 2024-03-07T07:34:30.293 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:34:30.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa6d0066f90 msgr2=0x7fa6d0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa6d0066f90 0x7fa6d0069450 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40015a0 tx=0x7fa6e4007970 comp rx=0 tx=0).stop 2024-03-07T07:34:30.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f40b46c0 msgr2=0x7fa6f414c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f40b46c0 0x7fa6f414c160 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc01c960 tx=0x7fa6dc019220 comp rx=0 tx=0).stop 2024-03-07T07:34:30.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 shutdown_connections 2024-03-07T07:34:30.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa6d0066f90 0x7fa6d0069450 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6f41618e0 0x7fa6f40b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f40b46c0 0x7fa6f414c160 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 --2- 172.21.15.84:0/698852659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6f409b0f0 0x7fa6f415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 >> 172.21.15.84:0/698852659 conn(0x7fa6f40b3ba0 msgr2=0x7fa6f409a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:30.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 shutdown_connections 2024-03-07T07:34:30.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.290+0000 7fa6f9a00640 1 -- 172.21.15.84:0/698852659 wait complete. 2024-03-07T07:34:30.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:34:30.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.446+0000 7f99df200640 1 Processor -- start 2024-03-07T07:34:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.446+0000 7f99df200640 1 -- start start 2024-03-07T07:34:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99df200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e01476e0 0x7f99e006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99df200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99e006d550 0x7f99e015e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99df200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e006be10 con 0x7f99e00b4b40 2024-03-07T07:34:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99df200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e00719b0 con 0x7f99e01476e0 2024-03-07T07:34:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99df200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e0071c90 con 0x7f99e006d550 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99dde00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e01476e0 0x7f99e006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99de800640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f99e00b4b40 0x7f99e0072490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55776/0 (socket says 172.21.15.84:55776) 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99de800640 1 -- 172.21.15.84:0/3725233148 learned_addr learned my addr 172.21.15.84:0/3725233148 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99dd400640 1 --2- 172.21.15.84:0/3725233148 >> v2:172.21.15.161:3300/0 conn(0x7f99e006d550 0x7f99e015e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99dde00640 1 -- 172.21.15.84:0/3725233148 >> v2:172.21.15.161:3300/0 conn(0x7f99e006d550 msgr2=0x7f99e015e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99dde00640 1 --2- 172.21.15.84:0/3725233148 >> v2:172.21.15.161:3300/0 conn(0x7f99e006d550 0x7f99e015e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99dde00640 1 -- 172.21.15.84:0/3725233148 >> v1:172.21.15.84:6789/0 conn(0x7f99e00b4b40 legacy=0x7f99e0072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99dde00640 1 -- 172.21.15.84:0/3725233148 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0071f70 con 0x7f99e01476e0 2024-03-07T07:34:30.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.450+0000 7f99dca00640 1 -- 172.21.15.84:0/3725233148 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593491818 0 0) 0x7f99e006be10 con 0x7f99e00b4b40 2024-03-07T07:34:30.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99dde00640 1 --2- 172.21.15.84:0/3725233148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e006b5c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f99e004fae0 tx=0x7f99d001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335ea54c47f2a59b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99dca00640 1 -- 172.21.15.84:0/3725233148 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00b0070 con 0x7f99e01476e0 2024-03-07T07:34:30.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99dca00640 1 -- 172.21.15.84:0/3725233148 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d00ab600 con 0x7f99e01476e0 2024-03-07T07:34:30.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99dca00640 1 -- 172.21.15.84:0/3725233148 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00ab9d0 con 0x7f99e01476e0 2024-03-07T07:34:30.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 -- 172.21.15.84:0/3725233148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 msgr2=0x7f99e006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 --2- 172.21.15.84:0/3725233148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e006b5c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f99e004fae0 tx=0x7f99d001c3f0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 -- 172.21.15.84:0/3725233148 shutdown_connections 2024-03-07T07:34:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 --2- 172.21.15.84:0/3725233148 >> v2:172.21.15.161:3300/0 conn(0x7f99e006d550 0x7f99e015e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 --2- 172.21.15.84:0/3725233148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e006b5c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 -- 172.21.15.84:0/3725233148 >> 172.21.15.84:0/3725233148 conn(0x7f99e00b3840 msgr2=0x7f99e00b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 -- 172.21.15.84:0/3725233148 shutdown_connections 2024-03-07T07:34:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 -- 172.21.15.84:0/3725233148 wait complete. 2024-03-07T07:34:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 Processor -- start 2024-03-07T07:34:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.454+0000 7f99df200640 1 -- start start 2024-03-07T07:34:30.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e006d550 0x7f99e015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e00b4b40 0x7f99e00cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00b5360 con 0x7f99e01476e0 2024-03-07T07:34:30.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0147ac0 con 0x7f99e00b4b40 2024-03-07T07:34:30.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e013ec40 con 0x7f99e006d550 2024-03-07T07:34:30.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e00caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40408/0 (socket says 172.21.15.84:40408) 2024-03-07T07:34:30.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 -- 172.21.15.84:0/2150308284 learned_addr learned my addr 172.21.15.84:0/2150308284 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:30.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99dd400640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e00b4b40 0x7f99e00cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99dde00640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e006d550 0x7f99e015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 -- 172.21.15.84:0/2150308284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e006d550 msgr2=0x7f99e015ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e006d550 0x7f99e015ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 -- 172.21.15.84:0/2150308284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e00b4b40 msgr2=0x7f99e00cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e00b4b40 0x7f99e00cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 -- 172.21.15.84:0/2150308284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e00cb980 con 0x7f99e01476e0 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99de800640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e00caec0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c700 tx=0x7f99d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99d6000640 1 -- 172.21.15.84:0/2150308284 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8018070 con 0x7f99e01476e0 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99d6000640 1 -- 172.21.15.84:0/2150308284 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d800ce10 con 0x7f99e01476e0 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99d6000640 1 -- 172.21.15.84:0/2150308284 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800a860 con 0x7f99e01476e0 2024-03-07T07:34:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e00cbc60 con 0x7f99e01476e0 2024-03-07T07:34:30.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e013e8d0 con 0x7f99e01476e0 2024-03-07T07:34:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0062d40 con 0x7f99e01476e0 2024-03-07T07:34:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.458+0000 7f99d6000640 1 -- 172.21.15.84:0/2150308284 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f99d800aa00 con 0x7f99e01476e0 2024-03-07T07:34:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.462+0000 7f99d6000640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f99c0066f60 0x7f99c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.462+0000 7f99d6000640 1 -- 172.21.15.84:0/2150308284 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f99d8084670 con 0x7f99e01476e0 2024-03-07T07:34:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.462+0000 7f99dde00640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f99c0066f60 0x7f99c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.462+0000 7f99dde00640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f99c0066f60 0x7f99c0069420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d00ad000 tx=0x7f99d00a4f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.466+0000 7f99d6000640 1 -- 172.21.15.84:0/2150308284 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f99d8054f10 con 0x7f99e01476e0 2024-03-07T07:34:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99e00b3060 con 0x7f99e01476e0 2024-03-07T07:34:30.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99d6000640 1 -- 172.21.15.84:0/2150308284 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99d8058fb0 con 0x7f99e01476e0 2024-03-07T07:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:34:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f99c0066f60 msgr2=0x7f99c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f99c0066f60 0x7f99c0069420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d00ad000 tx=0x7f99d00a4f90 comp rx=0 tx=0).stop 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 msgr2=0x7f99e00caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e00caec0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c700 tx=0x7f99d800cbc0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 shutdown_connections 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f99c0066f60 0x7f99c0069420 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e01476e0 0x7f99e00caec0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99e00b4b40 0x7f99e00cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 --2- 172.21.15.84:0/2150308284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99e006d550 0x7f99e015ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 >> 172.21.15.84:0/2150308284 conn(0x7f99e00b3840 msgr2=0x7f99e00b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 shutdown_connections 2024-03-07T07:34:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.622+0000 7f99df200640 1 -- 172.21.15.84:0/2150308284 wait complete. 2024-03-07T07:34:30.649 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-07T07:34:30.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2677600640 1 Processor -- start 2024-03-07T07:34:30.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2677600640 1 -- start start 2024-03-07T07:34:30.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2677600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2670147a40 0x7f26700d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2677600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26700d1180 0x7f26700d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2677600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2670147e20 con 0x7f26700cf460 2024-03-07T07:34:30.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2677600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26700d0a10 con 0x7f2670147a40 2024-03-07T07:34:30.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2677600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2670072060 con 0x7f26700d1180 2024-03-07T07:34:30.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f266fe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26700cf460 0x7f26700ccae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55780/0 (socket says 172.21.15.84:55780) 2024-03-07T07:34:30.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f266fe00640 1 -- 172.21.15.84:0/391209231 learned_addr learned my addr 172.21.15.84:0/391209231 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2675600640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26700d1180 0x7f26700d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f2674c00640 1 --2- 172.21.15.84:0/391209231 >> v2:172.21.15.161:3300/0 conn(0x7f2670147a40 0x7f26700d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.782+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680395616 0 0) 0x7f2670147e20 con 0x7f26700cf460 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2658003530 con 0x7f26700cf460 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3512020967 0 0) 0x7f2658003530 con 0x7f26700cf460 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26700d1180 msgr2=0x7f26700d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26700d1180 0x7f26700d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 >> v2:172.21.15.161:3300/0 conn(0x7f2670147a40 msgr2=0x7f26700d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 --2- 172.21.15.84:0/391209231 >> v2:172.21.15.161:3300/0 conn(0x7f2670147a40 0x7f26700d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2670071730 con 0x7f26700cf460 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f265c001680 con 0x7f26700cf460 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 >> v1:172.21.15.84:6789/0 conn(0x7f26700cf460 legacy=0x7f26700ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26580039c0 0x7f2658003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26700d1180 0x7f2658004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2658004d50 0x7f26580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700d0a10 con 0x7f2658004d50 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670072060 con 0x7f26580039c0 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265800ba00 con 0x7f26700d1180 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f2675600640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2658004d50 0x7f26580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f2674c00640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26580039c0 0x7f2658003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f266fe00640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26700d1180 0x7f2658004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f2675600640 1 -- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26700d1180 msgr2=0x7f2658004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f2675600640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26700d1180 0x7f2658004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f2675600640 1 -- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26580039c0 msgr2=0x7f2658003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f2675600640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26580039c0 0x7f2658003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.786+0000 7f2675600640 1 -- 172.21.15.84:0/391209231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658003530 con 0x7f2658004d50 2024-03-07T07:34:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2675600640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2658004d50 0x7f26580051d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2668009fc0 tx=0x7f266801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57918c1ecac7be62 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680b0070 con 0x7f2658004d50 2024-03-07T07:34:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26680ab600 con 0x7f2658004d50 2024-03-07T07:34:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f266f400640 1 -- 172.21.15.84:0/391209231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668009c10 con 0x7f2658004d50 2024-03-07T07:34:30.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2677600640 1 -- 172.21.15.84:0/391209231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2658004d50 msgr2=0x7f26580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2677600640 1 --2- 172.21.15.84:0/391209231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2658004d50 0x7f26580051d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2668009fc0 tx=0x7f266801c930 comp rx=0 tx=0).stop 2024-03-07T07:34:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2675600640 1 -- 172.21.15.84:0/391209231 reap_dead start 2024-03-07T07:34:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2677600640 1 -- 172.21.15.84:0/391209231 shutdown_connections 2024-03-07T07:34:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2677600640 1 -- 172.21.15.84:0/391209231 >> 172.21.15.84:0/391209231 conn(0x7f26700704b0 msgr2=0x7f26700708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2677600640 1 -- 172.21.15.84:0/391209231 shutdown_connections 2024-03-07T07:34:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2677600640 1 -- 172.21.15.84:0/391209231 wait complete. 2024-03-07T07:34:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2677600640 1 Processor -- start 2024-03-07T07:34:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.790+0000 7f2677600640 1 -- start start 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2658004d50 0x7f26700b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f267013df80 0x7f26700b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26700b6310 0x7f26700b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700d19a0 con 0x7f26700b6310 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700728e0 con 0x7f2658004d50 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26700b7d80 con 0x7f267013df80 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26700b6310 0x7f26700b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2674c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2658004d50 0x7f26700b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26700b6310 0x7f26700b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40414/0 (socket says 172.21.15.84:40414) 2024-03-07T07:34:30.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 -- 172.21.15.84:0/3128779888 learned_addr learned my addr 172.21.15.84:0/3128779888 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f266fe00640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f267013df80 0x7f26700b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 -- 172.21.15.84:0/3128779888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f267013df80 msgr2=0x7f26700b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f267013df80 0x7f26700b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 -- 172.21.15.84:0/3128779888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2658004d50 msgr2=0x7f26700b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2658004d50 0x7f26700b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 -- 172.21.15.84:0/3128779888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267013e400 con 0x7f26700b6310 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2675600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26700b6310 0x7f26700b6790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f266801ba30 tx=0x7f2668009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f266cc00640 1 -- 172.21.15.84:0/3128779888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680be070 con 0x7f26700b6310 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f266cc00640 1 -- 172.21.15.84:0/3128779888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26680ab400 con 0x7f26700b6310 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267013ff10 con 0x7f26700b6310 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f266cc00640 1 -- 172.21.15.84:0/3128779888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680b0040 con 0x7f26700b6310 2024-03-07T07:34:30.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26701401d0 con 0x7f26700b6310 2024-03-07T07:34:30.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2670067d30 con 0x7f26700b6310 2024-03-07T07:34:30.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.794+0000 7f266cc00640 1 -- 172.21.15.84:0/3128779888 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f26680c1070 con 0x7f26700b6310 2024-03-07T07:34:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.798+0000 7f266cc00640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2650066f60 0x7f2650069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.798+0000 7f266cc00640 1 -- 172.21.15.84:0/3128779888 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f266811e670 con 0x7f26700b6310 2024-03-07T07:34:30.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.798+0000 7f2674c00640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2650066f60 0x7f2650069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:30.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.798+0000 7f2674c00640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2650066f60 0x7f2650069420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2664009be0 tx=0x7f2664009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:30.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.802+0000 7f266cc00640 1 -- 172.21.15.84:0/3128779888 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f2668016990 con 0x7f26700b6310 2024-03-07T07:34:30.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2670062d40 con 0x7f26700b6310 2024-03-07T07:34:30.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f266cc00640 1 -- 172.21.15.84:0/3128779888 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f26680eef40 con 0x7f26700b6310 2024-03-07T07:34:30.978 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-03-07T07:34:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2650066f60 msgr2=0x7f2650069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2650066f60 0x7f2650069420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2664009be0 tx=0x7f2664009190 comp rx=0 tx=0).stop 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26700b6310 msgr2=0x7f26700b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26700b6310 0x7f26700b6790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f266801ba30 tx=0x7f2668009750 comp rx=0 tx=0).stop 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 shutdown_connections 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2650066f60 0x7f2650069420 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26700b6310 0x7f26700b6790 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f267013df80 0x7f26700b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 --2- 172.21.15.84:0/3128779888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2658004d50 0x7f26700b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 >> 172.21.15.84:0/3128779888 conn(0x7f26700704b0 msgr2=0x7f2670141bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 shutdown_connections 2024-03-07T07:34:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:30.974+0000 7f2677600640 1 -- 172.21.15.84:0/3128779888 wait complete. 2024-03-07T07:34:31.000 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-07T07:34:31.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:31.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-07T07:34:31.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:34:31.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:31.032 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-07T07:34:31.081 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:34:31.081 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:31.091 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354612k,nr_inodes=4088653,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1434 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-07T07:34:31.092 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:34:31.092 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:31.133 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354604k,nr_inodes=4088651,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1097 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-07T07:34:31.133 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:34:31.133 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:31.142 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354612k,nr_inodes=4088653,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1434 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-07T07:34:31.142 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:34:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4b0200640 1 Processor -- start 2024-03-07T07:34:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4b0200640 1 -- start start 2024-03-07T07:34:31.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4b0200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa4a815c1f0 0x7fa4a80b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4b0200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a80b3a00 0x7fa4a80aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4b0200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a80b0290 con 0x7fa4a80cf100 2024-03-07T07:34:31.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4b0200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a80b1d40 con 0x7fa4a815c1f0 2024-03-07T07:34:31.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4b0200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80b0570 con 0x7fa4a80b3a00 2024-03-07T07:34:31.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4ace00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa4a80cf100 0x7fa4a80d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55784/0 (socket says 172.21.15.84:55784) 2024-03-07T07:34:31.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4ace00640 1 -- 172.21.15.84:0/2358693678 learned_addr learned my addr 172.21.15.84:0/2358693678 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4ad800640 1 --2- 172.21.15.84:0/2358693678 >> v2:172.21.15.161:3300/0 conn(0x7fa4a815c1f0 0x7fa4a80b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4ae200640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a80b3a00 0x7fa4a80aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700451681 0 0) 0x7fa4a80b0290 con 0x7fa4a80cf100 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa490003530 con 0x7fa4a80cf100 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43725401 0 0) 0x7fa490003530 con 0x7fa4a80cf100 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a80b3a00 msgr2=0x7fa4a80aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a80b3a00 0x7fa4a80aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 >> v2:172.21.15.161:3300/0 conn(0x7fa4a815c1f0 msgr2=0x7fa4a80b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 --2- 172.21.15.84:0/2358693678 >> v2:172.21.15.161:3300/0 conn(0x7fa4a815c1f0 0x7fa4a80b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a80b0850 con 0x7fa4a80cf100 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.302+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7fa494001680 con 0x7fa4a80cf100 2024-03-07T07:34:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 >> v1:172.21.15.84:6789/0 conn(0x7fa4a80cf100 legacy=0x7fa4a80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4a7e00640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4900039c0 0x7fa490003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4a7e00640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a80b3a00 0x7fa490004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4a7e00640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490004d50 0x7fa4900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80b0570 con 0x7fa490004d50 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49000fde0 con 0x7fa4900039c0 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49000ff90 con 0x7fa4a80b3a00 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ae200640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490004d50 0x7fa4900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ace00640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a80b3a00 0x7fa490004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ad800640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4900039c0 0x7fa490003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ae200640 1 -- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a80b3a00 msgr2=0x7fa490004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ae200640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a80b3a00 0x7fa490004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ae200640 1 -- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4900039c0 msgr2=0x7fa490003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ae200640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4900039c0 0x7fa490003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ae200640 1 -- 172.21.15.84:0/2358693678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa490003530 con 0x7fa490004d50 2024-03-07T07:34:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.306+0000 7fa4ae200640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490004d50 0x7fa4900051d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009fc0 tx=0x7fa4a001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf984afaf08e7d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00b2070 con 0x7fa490004d50 2024-03-07T07:34:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a00a5c90 con 0x7fa490004d50 2024-03-07T07:34:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4a7e00640 1 -- 172.21.15.84:0/2358693678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0009c10 con 0x7fa490004d50 2024-03-07T07:34:31.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- 172.21.15.84:0/2358693678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490004d50 msgr2=0x7fa4900051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 --2- 172.21.15.84:0/2358693678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490004d50 0x7fa4900051d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009fc0 tx=0x7fa4a001cc80 comp rx=0 tx=0).stop 2024-03-07T07:34:31.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4ae200640 1 -- 172.21.15.84:0/2358693678 reap_dead start 2024-03-07T07:34:31.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- 172.21.15.84:0/2358693678 shutdown_connections 2024-03-07T07:34:31.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- 172.21.15.84:0/2358693678 >> 172.21.15.84:0/2358693678 conn(0x7fa4a80b1ed0 msgr2=0x7fa4a80b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:31.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- 172.21.15.84:0/2358693678 shutdown_connections 2024-03-07T07:34:31.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- 172.21.15.84:0/2358693678 wait complete. 2024-03-07T07:34:31.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 Processor -- start 2024-03-07T07:34:31.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- start start 2024-03-07T07:34:31.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a814a1e0 0x7fa4a814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a814a5c0 0x7fa4a81f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4a8154510 0x7fa4a81549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80d1d70 con 0x7fa4a814a1e0 2024-03-07T07:34:31.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80d1bf0 con 0x7fa4a8154510 2024-03-07T07:34:31.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4b0200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80d1ef0 con 0x7fa4a814a5c0 2024-03-07T07:34:31.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4ad800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a814a1e0 0x7fa4a814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4ad800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a814a1e0 0x7fa4a814dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40434/0 (socket says 172.21.15.84:40434) 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4ad800640 1 -- 172.21.15.84:0/2147994667 learned_addr learned my addr 172.21.15.84:0/2147994667 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4ae200640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4a8154510 0x7fa4a81549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.310+0000 7fa4ace00640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a814a5c0 0x7fa4a81f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4ad800640 1 -- 172.21.15.84:0/2147994667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a814a5c0 msgr2=0x7fa4a81f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4ad800640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a814a5c0 0x7fa4a81f3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4ad800640 1 -- 172.21.15.84:0/2147994667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4a8154510 msgr2=0x7fa4a81549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4ad800640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4a8154510 0x7fa4a81549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4ad800640 1 -- 172.21.15.84:0/2147994667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a814e650 con 0x7fa4a814a1e0 2024-03-07T07:34:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4ad800640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a814a1e0 0x7fa4a814dfc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa49c011aa0 tx=0x7fa49c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4a5600640 1 -- 172.21.15.84:0/2147994667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00fb80 con 0x7fa4a814a1e0 2024-03-07T07:34:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4a5600640 1 -- 172.21.15.84:0/2147994667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c00fd20 con 0x7fa4a814a1e0 2024-03-07T07:34:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4a5600640 1 -- 172.21.15.84:0/2147994667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c014680 con 0x7fa4a814a1e0 2024-03-07T07:34:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a814e930 con 0x7fa4a814a1e0 2024-03-07T07:34:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a814eef0 con 0x7fa4a814a1e0 2024-03-07T07:34:31.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a814f2d0 con 0x7fa4a814a1e0 2024-03-07T07:34:31.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4a5600640 1 -- 172.21.15.84:0/2147994667 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa49c012040 con 0x7fa4a814a1e0 2024-03-07T07:34:31.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4a5600640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa488066f60 0x7fa488069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4a5600640 1 -- 172.21.15.84:0/2147994667 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa49c0857d0 con 0x7fa4a814a1e0 2024-03-07T07:34:31.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.314+0000 7fa4ace00640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa488066f60 0x7fa488069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.318+0000 7fa4ace00640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa488066f60 0x7fa488069420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa494000fc0 tx=0x7fa494009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:31.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.318+0000 7fa4a5600640 1 -- 172.21.15.84:0/2147994667 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa4a814f2d0 con 0x7fa4a814a1e0 2024-03-07T07:34:31.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.506+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4a8062d40 con 0x7fa4a814a1e0 2024-03-07T07:34:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.506+0000 7fa4a5600640 1 -- 172.21.15.84:0/2147994667 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4980 (secure 0 0 0) 0x7fa49c019030 con 0x7fa4a814a1e0 2024-03-07T07:34:31.512 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:31.513 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/2371752160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2371752160},{"type":"v1","addr":"172.21.15.161:6834","nonce":2371752160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/850187244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":850187244},{"type":"v1","addr":"172.21.15.161:6835","nonce":850187244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3878293455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3878293455},{"type":"v1","addr":"172.21.15.84:6836","nonce":3878293455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:32:09.092583+0000","modified":"2024-03-07T07:32:12.103936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2828752085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2828752085},{"type":"v1","addr":"172.21.15.84:6837","nonce":2828752085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4995,"qdb_cluster":[4995]},"id":2}]} 2024-03-07T07:34:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa488066f60 msgr2=0x7fa488069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa488066f60 0x7fa488069420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa494000fc0 tx=0x7fa494009040 comp rx=0 tx=0).stop 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a814a1e0 msgr2=0x7fa4a814dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a814a1e0 0x7fa4a814dfc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa49c011aa0 tx=0x7fa49c011f60 comp rx=0 tx=0).stop 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 shutdown_connections 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa488066f60 0x7fa488069420 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4a8154510 0x7fa4a81549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4a814a5c0 0x7fa4a81f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 --2- 172.21.15.84:0/2147994667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a814a1e0 0x7fa4a814dfc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 >> 172.21.15.84:0/2147994667 conn(0x7fa4a80b1ed0 msgr2=0x7fa4a80719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 shutdown_connections 2024-03-07T07:34:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.510+0000 7fa4b0200640 1 -- 172.21.15.84:0/2147994667 wait complete. 2024-03-07T07:34:31.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:34:31.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.662+0000 7f8155a00640 1 Processor -- start 2024-03-07T07:34:31.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.662+0000 7f8155a00640 1 -- start start 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f8155a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815015e450 0x7f81500cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f8155a00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f81500b1260 0x7f81500b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f8155a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f815006b6f0 0x7f815006bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f8155a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81500cbe10 con 0x7f815006b6f0 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f8155a00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81500b1be0 con 0x7f81500b1260 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f8155a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81500d0e20 con 0x7f815015e450 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f814f400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f815006b6f0 0x7f815006bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f814f400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f815006b6f0 0x7f815006bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33662/0 (socket says 172.21.15.84:33662) 2024-03-07T07:34:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f814f400640 1 -- 172.21.15.84:0/2620741938 learned_addr learned my addr 172.21.15.84:0/2620741938 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:31.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f8147e00640 1 --2- 172.21.15.84:0/2620741938 >> v2:172.21.15.161:3300/0 conn(0x7f81500b1260 0x7f81500b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f814f400640 1 -- 172.21.15.84:0/2620741938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815015e450 msgr2=0x7f81500cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:31.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f814f400640 1 --2- 172.21.15.84:0/2620741938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815015e450 0x7f81500cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f814f400640 1 -- 172.21.15.84:0/2620741938 >> v2:172.21.15.161:3300/0 conn(0x7f81500b1260 msgr2=0x7f81500b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:31.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f814f400640 1 --2- 172.21.15.84:0/2620741938 >> v2:172.21.15.161:3300/0 conn(0x7f81500b1260 0x7f81500b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f814f400640 1 -- 172.21.15.84:0/2620741938 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81500ce010 con 0x7f815006b6f0 2024-03-07T07:34:31.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.666+0000 7f8147e00640 1 --2- 172.21.15.84:0/2620741938 >> v2:172.21.15.161:3300/0 conn(0x7f81500b1260 0x7f81500b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:31.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f814f400640 1 --2- 172.21.15.84:0/2620741938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815006bb80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f815006f340 tx=0x7f814801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500690937de29dd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f814e000640 1 -- 172.21.15.84:0/2620741938 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480a5840 con 0x7f815006b6f0 2024-03-07T07:34:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f814e000640 1 -- 172.21.15.84:0/2620741938 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81480a59e0 con 0x7f815006b6f0 2024-03-07T07:34:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f814e000640 1 -- 172.21.15.84:0/2620741938 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480a5db0 con 0x7f815006b6f0 2024-03-07T07:34:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 -- 172.21.15.84:0/2620741938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 msgr2=0x7f815006bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 --2- 172.21.15.84:0/2620741938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815006bb80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f815006f340 tx=0x7f814801c9c0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 -- 172.21.15.84:0/2620741938 shutdown_connections 2024-03-07T07:34:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 --2- 172.21.15.84:0/2620741938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815006bb80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 --2- 172.21.15.84:0/2620741938 >> v2:172.21.15.161:3300/0 conn(0x7f81500b1260 0x7f81500b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 --2- 172.21.15.84:0/2620741938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f815015e450 0x7f81500cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 -- 172.21.15.84:0/2620741938 >> 172.21.15.84:0/2620741938 conn(0x7f81500b4400 msgr2=0x7f81500b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 -- 172.21.15.84:0/2620741938 shutdown_connections 2024-03-07T07:34:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 -- 172.21.15.84:0/2620741938 wait complete. 2024-03-07T07:34:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 Processor -- start 2024-03-07T07:34:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.670+0000 7f8155a00640 1 -- start start 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81500b1260 0x7f81500b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f815015e450 0x7f8150153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815015e9b0 con 0x7f815006b6f0 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815015e830 con 0x7f815015e450 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81500cea20 con 0x7f81500b1260 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815014bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33668/0 (socket says 172.21.15.84:33668) 2024-03-07T07:34:31.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 -- 172.21.15.84:0/2021458900 learned_addr learned my addr 172.21.15.84:0/2021458900 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8147e00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81500b1260 0x7f81500b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814f400640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f815015e450 0x7f8150153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 -- 172.21.15.84:0/2021458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81500b1260 msgr2=0x7f81500b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81500b1260 0x7f81500b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 -- 172.21.15.84:0/2021458900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f815015e450 msgr2=0x7f8150153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f815015e450 0x7f8150153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 -- 172.21.15.84:0/2021458900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8150152af0 con 0x7f815006b6f0 2024-03-07T07:34:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f814ea00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815014bfd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f814000b550 tx=0x7f814000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:31.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8146a00640 1 -- 172.21.15.84:0/2021458900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140014070 con 0x7f815006b6f0 2024-03-07T07:34:31.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8146a00640 1 -- 172.21.15.84:0/2021458900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8140010610 con 0x7f815006b6f0 2024-03-07T07:34:31.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8150152dd0 con 0x7f815006b6f0 2024-03-07T07:34:31.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8146a00640 1 -- 172.21.15.84:0/2021458900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400109e0 con 0x7f815006b6f0 2024-03-07T07:34:31.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8150153670 con 0x7f815006b6f0 2024-03-07T07:34:31.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8150152fa0 con 0x7f815006b6f0 2024-03-07T07:34:31.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.674+0000 7f8146a00640 1 -- 172.21.15.84:0/2021458900 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f8140017070 con 0x7f815006b6f0 2024-03-07T07:34:31.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.678+0000 7f8146a00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f812c066f60 0x7f812c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:31.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.678+0000 7f8146a00640 1 -- 172.21.15.84:0/2021458900 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8140084b00 con 0x7f815006b6f0 2024-03-07T07:34:31.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.678+0000 7f8147e00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f812c066f60 0x7f812c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:31.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.678+0000 7f8147e00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f812c066f60 0x7f812c069420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8150155e50 tx=0x7f8138008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:31.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.682+0000 7f8146a00640 1 -- 172.21.15.84:0/2021458900 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f81400553a0 con 0x7f815006b6f0 2024-03-07T07:34:31.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8150155850 con 0x7f815006b6f0 2024-03-07T07:34:31.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8146a00640 1 -- 172.21.15.84:0/2021458900 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16822 (secure 0 0 0) 0x7f8140059440 con 0x7f815006b6f0 2024-03-07T07:34:31.859 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:31.859 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:32:54.985899+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:32:07.581845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-07T07:32:08.085165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.5","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:34:31.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f812c066f60 msgr2=0x7f812c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f812c066f60 0x7f812c069420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8150155e50 tx=0x7f8138008040 comp rx=0 tx=0).stop 2024-03-07T07:34:31.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 msgr2=0x7f815014bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:31.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815014bfd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f814000b550 tx=0x7f814000ba10 comp rx=0 tx=0).stop 2024-03-07T07:34:31.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 shutdown_connections 2024-03-07T07:34:31.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f812c066f60 0x7f812c069420 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f815015e450 0x7f8150153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81500b1260 0x7f81500b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 --2- 172.21.15.84:0/2021458900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f815006b6f0 0x7f815014bfd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:31.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 >> 172.21.15.84:0/2021458900 conn(0x7f81500b4400 msgr2=0x7f8150072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:31.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 shutdown_connections 2024-03-07T07:34:31.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:31.854+0000 7f8155a00640 1 -- 172.21.15.84:0/2021458900 wait complete. 2024-03-07T07:34:31.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T07:30:59.018143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-07T07:32:07.581845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-07T07:32:08.085165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T07:34:31.881 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T07:34:32.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d87800640 1 Processor -- start 2024-03-07T07:34:32.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d87800640 1 -- start start 2024-03-07T07:34:32.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d87800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d8015e1b0 0x7f4d800ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d87800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d800704f0 0x7f4d80070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d87800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8015f6a0 con 0x7f4d8015e590 2024-03-07T07:34:32.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d87800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d80070e80 con 0x7f4d8015e1b0 2024-03-07T07:34:32.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d87800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8015ea20 con 0x7f4d800704f0 2024-03-07T07:34:32.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d7fe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d8015e590 0x7f4d800affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57356/0 (socket says 172.21.15.84:57356) 2024-03-07T07:34:32.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d84e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d8015e1b0 0x7f4d800ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d7fe00640 1 -- 172.21.15.84:0/2580593440 learned_addr learned my addr 172.21.15.84:0/2580593440 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:32.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.014+0000 7f4d85800640 1 --2- 172.21.15.84:0/2580593440 >> v2:172.21.15.161:3300/0 conn(0x7f4d800704f0 0x7f4d80070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d84e00640 1 -- 172.21.15.84:0/2580593440 >> v2:172.21.15.161:3300/0 conn(0x7f4d800704f0 msgr2=0x7f4d80070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:32.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d84e00640 1 --2- 172.21.15.84:0/2580593440 >> v2:172.21.15.161:3300/0 conn(0x7f4d800704f0 0x7f4d80070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d84e00640 1 -- 172.21.15.84:0/2580593440 >> v1:172.21.15.84:6789/0 conn(0x7f4d8015e590 legacy=0x7f4d800affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d84e00640 1 -- 172.21.15.84:0/2580593440 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8015ed00 con 0x7f4d8015e1b0 2024-03-07T07:34:32.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d84e00640 1 --2- 172.21.15.84:0/2580593440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d8015e1b0 0x7f4d800ae510 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4d800b2be0 tx=0x7f4d7401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fbf5b7a79497a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d7f400640 1 -- 172.21.15.84:0/2580593440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740ab5f0 con 0x7f4d8015e1b0 2024-03-07T07:34:32.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d7f400640 1 -- 172.21.15.84:0/2580593440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d740b0070 con 0x7f4d8015e1b0 2024-03-07T07:34:32.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d7f400640 1 -- 172.21.15.84:0/2580593440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740ab9b0 con 0x7f4d8015e1b0 2024-03-07T07:34:32.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d87800640 1 -- 172.21.15.84:0/2580593440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d8015e1b0 msgr2=0x7f4d800ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d87800640 1 --2- 172.21.15.84:0/2580593440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d8015e1b0 0x7f4d800ae510 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4d800b2be0 tx=0x7f4d7401c3f0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d87800640 1 -- 172.21.15.84:0/2580593440 shutdown_connections 2024-03-07T07:34:32.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d87800640 1 --2- 172.21.15.84:0/2580593440 >> v2:172.21.15.161:3300/0 conn(0x7f4d800704f0 0x7f4d80070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d87800640 1 --2- 172.21.15.84:0/2580593440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d8015e1b0 0x7f4d800ae510 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d87800640 1 -- 172.21.15.84:0/2580593440 >> 172.21.15.84:0/2580593440 conn(0x7f4d80071600 msgr2=0x7f4d80071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:32.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d87800640 1 -- 172.21.15.84:0/2580593440 shutdown_connections 2024-03-07T07:34:32.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.018+0000 7f4d87800640 1 -- 172.21.15.84:0/2580593440 wait complete. 2024-03-07T07:34:32.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 Processor -- start 2024-03-07T07:34:32.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 -- start start 2024-03-07T07:34:32.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d800704f0 0x7f4d80159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d8015e1b0 0x7f4d80158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d8013a710 0x7f4d80157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8006ef90 con 0x7f4d800704f0 2024-03-07T07:34:32.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8006ee10 con 0x7f4d8013a710 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8006f110 con 0x7f4d8015e1b0 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d800704f0 0x7f4d80159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d800704f0 0x7f4d80159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33688/0 (socket says 172.21.15.84:33688) 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 -- 172.21.15.84:0/1823829269 learned_addr learned my addr 172.21.15.84:0/1823829269 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d85800640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d8013a710 0x7f4d80157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d7fe00640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d8015e1b0 0x7f4d80158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 -- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d8015e1b0 msgr2=0x7f4d80158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d8015e1b0 0x7f4d80158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 -- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d8013a710 msgr2=0x7f4d80157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d8013a710 0x7f4d80157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 -- 172.21.15.84:0/1823829269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8014bd30 con 0x7f4d800704f0 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d85800640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d8013a710 0x7f4d80157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d7fe00640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d8015e1b0 0x7f4d80158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d84e00640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d800704f0 0x7f4d80159f10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4d7401a020 tx=0x7f4d7401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d7cc00640 1 -- 172.21.15.84:0/1823829269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740bf610 con 0x7f4d800704f0 2024-03-07T07:34:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d7cc00640 1 -- 172.21.15.84:0/1823829269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d740bf7d0 con 0x7f4d800704f0 2024-03-07T07:34:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8014c010 con 0x7f4d800704f0 2024-03-07T07:34:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d7cc00640 1 -- 172.21.15.84:0/1823829269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740bfbc0 con 0x7f4d800704f0 2024-03-07T07:34:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.022+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8014c5d0 con 0x7f4d800704f0 2024-03-07T07:34:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.026+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d80062d40 con 0x7f4d800704f0 2024-03-07T07:34:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.026+0000 7f4d7cc00640 1 -- 172.21.15.84:0/1823829269 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f4d740bd020 con 0x7f4d800704f0 2024-03-07T07:34:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.026+0000 7f4d7cc00640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4d60066f60 0x7f4d60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.026+0000 7f4d7cc00640 1 -- 172.21.15.84:0/1823829269 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4d7411f790 con 0x7f4d800704f0 2024-03-07T07:34:32.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.026+0000 7f4d7fe00640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4d60066f60 0x7f4d60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.026+0000 7f4d7fe00640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4d60066f60 0x7f4d60069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c007fd0 tx=0x7f4d6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.034+0000 7f4d7cc00640 1 -- 172.21.15.84:0/1823829269 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f4d74016070 con 0x7f4d800704f0 2024-03-07T07:34:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.190+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d8015abe0 con 0x7f4d800704f0 2024-03-07T07:34:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.190+0000 7f4d7cc00640 1 -- 172.21.15.84:0/1823829269 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d740f07a0 con 0x7f4d800704f0 2024-03-07T07:34:32.196 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-07T07:34:32.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4d60066f60 msgr2=0x7f4d60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4d60066f60 0x7f4d60069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c007fd0 tx=0x7f4d6c009040 comp rx=0 tx=0).stop 2024-03-07T07:34:32.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d800704f0 msgr2=0x7f4d80159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d800704f0 0x7f4d80159f10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4d7401a020 tx=0x7f4d7401ac30 comp rx=0 tx=0).stop 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 shutdown_connections 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4d60066f60 0x7f4d60069420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d8013a710 0x7f4d80157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d8015e1b0 0x7f4d80158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 --2- 172.21.15.84:0/1823829269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d800704f0 0x7f4d80159f10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 >> 172.21.15.84:0/1823829269 conn(0x7f4d80071600 msgr2=0x7f4d800b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 shutdown_connections 2024-03-07T07:34:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.194+0000 7f4d87800640 1 -- 172.21.15.84:0/1823829269 wait complete. 2024-03-07T07:34:32.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-07T07:34:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.350+0000 7fa0b1600640 1 Processor -- start 2024-03-07T07:34:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.350+0000 7fa0b1600640 1 -- start start 2024-03-07T07:34:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.350+0000 7fa0b1600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa0ac1618e0 0x7fa0ac09a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.350+0000 7fa0b1600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa0ac0b46c0 0x7fa0ac09af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.350+0000 7fa0b1600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0d1ae0 0x7fa0ac0cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.350+0000 7fa0b1600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac0b17b0 con 0x7fa0ac0b46c0 2024-03-07T07:34:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.350+0000 7fa0b1600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac072390 con 0x7fa0ac1618e0 2024-03-07T07:34:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.350+0000 7fa0b1600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0b1310 con 0x7fa0ac0d1ae0 2024-03-07T07:34:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa0ac0b46c0 0x7fa0ac09af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa0ac0b46c0 0x7fa0ac09af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33694/0 (socket says 172.21.15.84:33694) 2024-03-07T07:34:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 -- 172.21.15.84:0/3855370730 learned_addr learned my addr 172.21.15.84:0/3855370730 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0ab400640 1 --2- 172.21.15.84:0/3855370730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0d1ae0 0x7fa0ac0cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aaa00640 1 --2- 172.21.15.84:0/3855370730 >> v2:172.21.15.161:3300/0 conn(0x7fa0ac1618e0 0x7fa0ac09a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 -- 172.21.15.84:0/3855370730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0d1ae0 msgr2=0x7fa0ac0cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 --2- 172.21.15.84:0/3855370730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0d1ae0 0x7fa0ac0cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 -- 172.21.15.84:0/3855370730 >> v2:172.21.15.161:3300/0 conn(0x7fa0ac1618e0 msgr2=0x7fa0ac09a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 --2- 172.21.15.84:0/3855370730 >> v2:172.21.15.161:3300/0 conn(0x7fa0ac1618e0 0x7fa0ac09a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 -- 172.21.15.84:0/3855370730 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac071a60 con 0x7fa0ac0b46c0 2024-03-07T07:34:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0aa000640 1 --2- 172.21.15.84:0/3855370730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac0b46c0 0x7fa0ac09af20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac06e720 tx=0x7fa09801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c6fc081c7d9f70 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0a9600640 1 -- 172.21.15.84:0/3855370730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0980aa610 con 0x7fa0ac0b46c0 2024-03-07T07:34:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0a9600640 1 -- 172.21.15.84:0/3855370730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0980af070 con 0x7fa0ac0b46c0 2024-03-07T07:34:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.354+0000 7fa0a9600640 1 -- 172.21.15.84:0/3855370730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0980aa9d0 con 0x7fa0ac0b46c0 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- 172.21.15.84:0/3855370730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac0b46c0 msgr2=0x7fa0ac09af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 --2- 172.21.15.84:0/3855370730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac0b46c0 0x7fa0ac09af20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac06e720 tx=0x7fa09801c4f0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- 172.21.15.84:0/3855370730 shutdown_connections 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 --2- 172.21.15.84:0/3855370730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0d1ae0 0x7fa0ac0cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 --2- 172.21.15.84:0/3855370730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac0b46c0 0x7fa0ac09af20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 --2- 172.21.15.84:0/3855370730 >> v2:172.21.15.161:3300/0 conn(0x7fa0ac1618e0 0x7fa0ac09a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- 172.21.15.84:0/3855370730 >> 172.21.15.84:0/3855370730 conn(0x7fa0ac0b3ba0 msgr2=0x7fa0ac0b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- 172.21.15.84:0/3855370730 shutdown_connections 2024-03-07T07:34:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- 172.21.15.84:0/3855370730 wait complete. 2024-03-07T07:34:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 Processor -- start 2024-03-07T07:34:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- start start 2024-03-07T07:34:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0b46c0 0x7fa0ac156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0ac0d1ae0 0x7fa0ac15d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac1618e0 0x7fa0ac15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac161e40 con 0x7fa0ac1618e0 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac161cc0 con 0x7fa0ac0d1ae0 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0b1600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac06b6e0 con 0x7fa0ac0b46c0 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac1618e0 0x7fa0ac15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac1618e0 0x7fa0ac15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33706/0 (socket says 172.21.15.84:33706) 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 -- 172.21.15.84:0/2494084395 learned_addr learned my addr 172.21.15.84:0/2494084395 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0aaa00640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0b46c0 0x7fa0ac156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0aa000640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0ac0d1ae0 0x7fa0ac15d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 -- 172.21.15.84:0/2494084395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0b46c0 msgr2=0x7fa0ac156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0b46c0 0x7fa0ac156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 -- 172.21.15.84:0/2494084395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0ac0d1ae0 msgr2=0x7fa0ac15d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0ac0d1ae0 0x7fa0ac15d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 -- 172.21.15.84:0/2494084395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac0cc6a0 con 0x7fa0ac1618e0 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.358+0000 7fa0ab400640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac1618e0 0x7fa0ac15d950 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400eed0 tx=0x7fa0a400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.362+0000 7fa0a2a00640 1 -- 172.21.15.84:0/2494084395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4018020 con 0x7fa0ac1618e0 2024-03-07T07:34:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.362+0000 7fa0a2a00640 1 -- 172.21.15.84:0/2494084395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a4014400 con 0x7fa0ac1618e0 2024-03-07T07:34:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.362+0000 7fa0a2a00640 1 -- 172.21.15.84:0/2494084395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40147f0 con 0x7fa0ac1618e0 2024-03-07T07:34:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.362+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac0cc980 con 0x7fa0ac1618e0 2024-03-07T07:34:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.362+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac0ccf40 con 0x7fa0ac1618e0 2024-03-07T07:34:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.362+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac062d40 con 0x7fa0ac1618e0 2024-03-07T07:34:32.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.362+0000 7fa0a2a00640 1 -- 172.21.15.84:0/2494084395 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fa0a401b020 con 0x7fa0ac1618e0 2024-03-07T07:34:32.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.366+0000 7fa0a2a00640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa08c066f90 0x7fa08c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.366+0000 7fa0a2a00640 1 -- 172.21.15.84:0/2494084395 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa0a40855f0 con 0x7fa0ac1618e0 2024-03-07T07:34:32.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.366+0000 7fa0aaa00640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa08c066f90 0x7fa08c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.366+0000 7fa0aaa00640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa08c066f90 0x7fa08c069450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009ac0 tx=0x7fa09c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.370+0000 7fa0a2a00640 1 -- 172.21.15.84:0/2494084395 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fa0a4022070 con 0x7fa0ac1618e0 2024-03-07T07:34:32.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.522+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0ac0b3f80 con 0x7fa0ac1618e0 2024-03-07T07:34:32.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.522+0000 7fa0a2a00640 1 -- 172.21.15.84:0/2494084395 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0a4083e20 con 0x7fa0ac1618e0 2024-03-07T07:34:32.529 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa08c066f90 msgr2=0x7fa08c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa08c066f90 0x7fa08c069450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009ac0 tx=0x7fa09c009190 comp rx=0 tx=0).stop 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac1618e0 msgr2=0x7fa0ac15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac1618e0 0x7fa0ac15d950 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400eed0 tx=0x7fa0a400b480 comp rx=0 tx=0).stop 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 shutdown_connections 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fa08c066f90 0x7fa08c069450 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0ac1618e0 0x7fa0ac15d950 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0ac0d1ae0 0x7fa0ac15d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 --2- 172.21.15.84:0/2494084395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0ac0b46c0 0x7fa0ac156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 >> 172.21.15.84:0/2494084395 conn(0x7fa0ac0b3ba0 msgr2=0x7fa0ac0728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:32.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 shutdown_connections 2024-03-07T07:34:32.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.526+0000 7fa0b1600640 1 -- 172.21.15.84:0/2494084395 wait complete. 2024-03-07T07:34:32.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-07T07:34:32.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff703e00640 1 Processor -- start 2024-03-07T07:34:32.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff703e00640 1 -- start start 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff703e00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff6fc09ac40 0x7ff6fc0cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff703e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6fc0b46c0 0x7ff6fc15f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff703e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc15f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff703e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0d0ce0 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff703e00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc06b6e0 con 0x7ff6fc09ac40 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff703e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc06bca0 con 0x7ff6fc09b020 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff700a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6fc0b46c0 0x7ff6fc15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff700a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6fc0b46c0 0x7ff6fc15f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33720/0 (socket says 172.21.15.84:33720) 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff700a00640 1 -- 172.21.15.84:0/1776660702 learned_addr learned my addr 172.21.15.84:0/1776660702 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff701400640 1 --2- 172.21.15.84:0/1776660702 >> v2:172.21.15.161:3300/0 conn(0x7ff6fc09ac40 0x7ff6fc0cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff701e00640 1 --2- 172.21.15.84:0/1776660702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc15f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff700a00640 1 -- 172.21.15.84:0/1776660702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 msgr2=0x7ff6fc15f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:32.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff700a00640 1 --2- 172.21.15.84:0/1776660702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc15f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff700a00640 1 -- 172.21.15.84:0/1776660702 >> v2:172.21.15.161:3300/0 conn(0x7ff6fc09ac40 msgr2=0x7ff6fc0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:32.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff700a00640 1 --2- 172.21.15.84:0/1776660702 >> v2:172.21.15.161:3300/0 conn(0x7ff6fc09ac40 0x7ff6fc0cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.682+0000 7ff700a00640 1 -- 172.21.15.84:0/1776660702 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0d0720 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff700a00640 1 --2- 172.21.15.84:0/1776660702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc15f340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009870 tx=0x7ff6e801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6875f2088d2efe8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff6fbe00640 1 -- 172.21.15.84:0/1776660702 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80b0070 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff6fbe00640 1 -- 172.21.15.84:0/1776660702 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e80ab600 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff6fbe00640 1 -- 172.21.15.84:0/1776660702 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80ab9d0 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- 172.21.15.84:0/1776660702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 msgr2=0x7ff6fc15f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 --2- 172.21.15.84:0/1776660702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc15f340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009870 tx=0x7ff6e801c520 comp rx=0 tx=0).stop 2024-03-07T07:34:32.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- 172.21.15.84:0/1776660702 shutdown_connections 2024-03-07T07:34:32.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 --2- 172.21.15.84:0/1776660702 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc15f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 --2- 172.21.15.84:0/1776660702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc15f340 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 --2- 172.21.15.84:0/1776660702 >> v2:172.21.15.161:3300/0 conn(0x7ff6fc09ac40 0x7ff6fc0cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- 172.21.15.84:0/1776660702 >> 172.21.15.84:0/1776660702 conn(0x7ff6fc0b3ba0 msgr2=0x7ff6fc0b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:32.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- 172.21.15.84:0/1776660702 shutdown_connections 2024-03-07T07:34:32.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- 172.21.15.84:0/1776660702 wait complete. 2024-03-07T07:34:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 Processor -- start 2024-03-07T07:34:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- start start 2024-03-07T07:34:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc09ac40 0x7ff6fc165b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc0b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0cd190 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0cd010 con 0x7ff6fc09ac40 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.690+0000 7ff703e00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0cd310 con 0x7ff6fc09b020 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc0b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc0b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33734/0 (socket says 172.21.15.84:33734) 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 -- 172.21.15.84:0/1309773251 learned_addr learned my addr 172.21.15.84:0/1309773251 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff700a00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701400640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc09ac40 0x7ff6fc165b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 -- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 msgr2=0x7ff6fc156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 -- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc09ac40 msgr2=0x7ff6fc165b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc09ac40 0x7ff6fc165b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 -- 172.21.15.84:0/1309773251 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc1572c0 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff700a00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701400640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc09ac40 0x7ff6fc165b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff701e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc0b4c90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400efc0 tx=0x7ff6f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff6f9600640 1 -- 172.21.15.84:0/1309773251 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4018020 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff6f9600640 1 -- 172.21.15.84:0/1309773251 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f4014480 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff6f9600640 1 -- 172.21.15.84:0/1309773251 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4014870 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc1642f0 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc072390 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc062d40 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.694+0000 7ff6f9600640 1 -- 172.21.15.84:0/1309773251 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7ff6f401b020 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.698+0000 7ff6f9600640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff6dc066f90 0x7ff6dc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:32.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.698+0000 7ff6f9600640 1 -- 172.21.15.84:0/1309773251 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff6f4085b00 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.698+0000 7ff701400640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff6dc066f90 0x7ff6dc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:32.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.698+0000 7ff701400640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff6dc066f90 0x7ff6dc069450 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc1579b0 tx=0x7ff6f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:32.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.702+0000 7ff6f9600640 1 -- 172.21.15.84:0/1309773251 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7ff6f4022070 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.858+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6fc158b70 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.858+0000 7ff6f9600640 1 -- 172.21.15.84:0/1309773251 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6f4085e20 con 0x7ff6fc0b46c0 2024-03-07T07:34:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-07T07:34:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff6dc066f90 msgr2=0x7ff6dc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff6dc066f90 0x7ff6dc069450 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc1579b0 tx=0x7ff6f0008040 comp rx=0 tx=0).stop 2024-03-07T07:34:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 msgr2=0x7ff6fc0b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc0b4c90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400efc0 tx=0x7ff6f400c490 comp rx=0 tx=0).stop 2024-03-07T07:34:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 shutdown_connections 2024-03-07T07:34:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff6dc066f90 0x7ff6dc069450 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6fc0b46c0 0x7ff6fc0b4c90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6fc09b020 0x7ff6fc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 --2- 172.21.15.84:0/1309773251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc09ac40 0x7ff6fc165b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 >> 172.21.15.84:0/1309773251 conn(0x7ff6fc0b3ba0 msgr2=0x7ff6fc157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 shutdown_connections 2024-03-07T07:34:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:32.862+0000 7ff703e00640 1 -- 172.21.15.84:0/1309773251 wait complete. 2024-03-07T07:34:32.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:34:33.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c8d200640 1 Processor -- start 2024-03-07T07:34:33.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c8d200640 1 -- start start 2024-03-07T07:34:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c8d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c880b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c8d200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c880b0290 con 0x7f9c8815c1f0 2024-03-07T07:34:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c8d200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c880b0570 con 0x7f9c880cf100 2024-03-07T07:34:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c8d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880b1d40 con 0x7f9c880b3a00 2024-03-07T07:34:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c85e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9c8815c1f0 0x7f9c880d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57358/0 (socket says 172.21.15.84:57358) 2024-03-07T07:34:33.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c85e00640 1 -- 172.21.15.84:0/849041847 learned_addr learned my addr 172.21.15.84:0/849041847 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c86800640 1 --2- 172.21.15.84:0/849041847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c880b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c85400640 1 -- 172.21.15.84:0/849041847 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242726820 0 0) 0x7f9c880b0290 con 0x7f9c8815c1f0 2024-03-07T07:34:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c85400640 1 -- 172.21.15.84:0/849041847 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c003530 con 0x7f9c8815c1f0 2024-03-07T07:34:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c85400640 1 -- 172.21.15.84:0/849041847 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389621719 0 0) 0x7f9c880b0570 con 0x7f9c880cf100 2024-03-07T07:34:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c85400640 1 -- 172.21.15.84:0/849041847 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c880b0290 con 0x7f9c880cf100 2024-03-07T07:34:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c86800640 1 -- 172.21.15.84:0/849041847 >> v1:172.21.15.161:6789/0 conn(0x7f9c880cf100 legacy=0x7f9c880aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c86800640 1 -- 172.21.15.84:0/849041847 >> v1:172.21.15.84:6789/0 conn(0x7f9c8815c1f0 legacy=0x7f9c880d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.022+0000 7f9c86800640 1 -- 172.21.15.84:0/849041847 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c880b0850 con 0x7f9c880b3a00 2024-03-07T07:34:33.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c86800640 1 --2- 172.21.15.84:0/849041847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c880b1330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009dc0 tx=0x7f9c8001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cf614922bab0456 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c85400640 1 -- 172.21.15.84:0/849041847 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800b2070 con 0x7f9c880b3a00 2024-03-07T07:34:33.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c85400640 1 -- 172.21.15.84:0/849041847 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c800a58d0 con 0x7f9c880b3a00 2024-03-07T07:34:33.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c85400640 1 -- 172.21.15.84:0/849041847 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800a5c80 con 0x7f9c880b3a00 2024-03-07T07:34:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c8d200640 1 -- 172.21.15.84:0/849041847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 msgr2=0x7f9c880b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c8d200640 1 --2- 172.21.15.84:0/849041847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c880b1330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009dc0 tx=0x7f9c8001c900 comp rx=0 tx=0).stop 2024-03-07T07:34:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c8d200640 1 -- 172.21.15.84:0/849041847 shutdown_connections 2024-03-07T07:34:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c8d200640 1 --2- 172.21.15.84:0/849041847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c880b1330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c8d200640 1 -- 172.21.15.84:0/849041847 >> 172.21.15.84:0/849041847 conn(0x7f9c880b1ed0 msgr2=0x7f9c880b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c8d200640 1 -- 172.21.15.84:0/849041847 shutdown_connections 2024-03-07T07:34:33.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.026+0000 7f9c8d200640 1 -- 172.21.15.84:0/849041847 wait complete. 2024-03-07T07:34:33.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 Processor -- start 2024-03-07T07:34:33.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 -- start start 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c88072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880cf100 0x7f9c881517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c8815c1f0 0x7f9c88154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8816a080 con 0x7f9c8815c1f0 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88169f00 con 0x7f9c880cf100 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8816a200 con 0x7f9c880b3a00 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c8815c1f0 0x7f9c88154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c8815c1f0 0x7f9c88154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33748/0 (socket says 172.21.15.84:33748) 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 -- 172.21.15.84:0/199039829 learned_addr learned my addr 172.21.15.84:0/199039829 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c85e00640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c88072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c7fe00640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880cf100 0x7f9c881517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 -- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 msgr2=0x7f9c88072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c88072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 -- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880cf100 msgr2=0x7f9c881517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880cf100 0x7f9c881517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 -- 172.21.15.84:0/199039829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88071600 con 0x7f9c8815c1f0 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c7fe00640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880cf100 0x7f9c881517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c86800640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c8815c1f0 0x7f9c88154000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9c8001a530 tx=0x7f9c800196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c7e000640 1 -- 172.21.15.84:0/199039829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800b2050 con 0x7f9c8815c1f0 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c7e000640 1 -- 172.21.15.84:0/199039829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c800be070 con 0x7f9c8815c1f0 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c880718a0 con 0x7f9c8815c1f0 2024-03-07T07:34:33.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c7e000640 1 -- 172.21.15.84:0/199039829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80009450 con 0x7f9c8815c1f0 2024-03-07T07:34:33.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.030+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c88071e60 con 0x7f9c8815c1f0 2024-03-07T07:34:33.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.034+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c88062d40 con 0x7f9c8815c1f0 2024-03-07T07:34:33.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.034+0000 7f9c7e000640 1 -- 172.21.15.84:0/199039829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f9c800adc40 con 0x7f9c8815c1f0 2024-03-07T07:34:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.034+0000 7f9c7e000640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9c64066f60 0x7f9c64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.034+0000 7f9c7e000640 1 -- 172.21.15.84:0/199039829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9c80120180 con 0x7f9c8815c1f0 2024-03-07T07:34:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.034+0000 7f9c85e00640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9c64066f60 0x7f9c64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.034+0000 7f9c85e00640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9c64066f60 0x7f9c64069420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c78007fd0 tx=0x7f9c78007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.042+0000 7f9c7e000640 1 -- 172.21.15.84:0/199039829 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f9c80016580 con 0x7f9c8815c1f0 2024-03-07T07:34:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.230+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c880b3040 con 0x7f9c8815c1f0 2024-03-07T07:34:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.230+0000 7f9c7e000640 1 -- 172.21.15.84:0/199039829 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4980 (secure 0 0 0) 0x7f9c800f1130 con 0x7f9c8815c1f0 2024-03-07T07:34:33.237 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:33.237 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/2371752160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2371752160},{"type":"v1","addr":"172.21.15.161:6834","nonce":2371752160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/850187244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":850187244},{"type":"v1","addr":"172.21.15.161:6835","nonce":850187244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3878293455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3878293455},{"type":"v1","addr":"172.21.15.84:6836","nonce":3878293455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:32:09.092583+0000","modified":"2024-03-07T07:32:12.103936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2828752085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2828752085},{"type":"v1","addr":"172.21.15.84:6837","nonce":2828752085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4995,"qdb_cluster":[4995]},"id":2}]} 2024-03-07T07:34:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-03-07T07:34:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9c64066f60 msgr2=0x7f9c64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9c64066f60 0x7f9c64069420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c78007fd0 tx=0x7f9c78007d80 comp rx=0 tx=0).stop 2024-03-07T07:34:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c8815c1f0 msgr2=0x7f9c88154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c8815c1f0 0x7f9c88154000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9c8001a530 tx=0x7f9c800196a0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 shutdown_connections 2024-03-07T07:34:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9c64066f60 0x7f9c64069420 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c8815c1f0 0x7f9c88154000 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880cf100 0x7f9c881517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 --2- 172.21.15.84:0/199039829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c880b3a00 0x7f9c88072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 >> 172.21.15.84:0/199039829 conn(0x7f9c880b1ed0 msgr2=0x7f9c880b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 shutdown_connections 2024-03-07T07:34:33.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.234+0000 7f9c8d200640 1 -- 172.21.15.84:0/199039829 wait complete. 2024-03-07T07:34:33.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:34:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.386+0000 7f5108c00640 1 Processor -- start 2024-03-07T07:34:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.386+0000 7f5108c00640 1 -- start start 2024-03-07T07:34:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5108c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f510415c1f0 0x7f51040b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5108c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51040cf100 0x7f51040d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5108c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51040b0290 con 0x7f51040b3a00 2024-03-07T07:34:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5108c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040b1d40 con 0x7f51040cf100 2024-03-07T07:34:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5108c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51040b0570 con 0x7f510415c1f0 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f510415c1f0 0x7f51040b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51040cf100 0x7f51040d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51040cf100 0x7f51040d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:56244/0 (socket says 172.21.15.84:56244) 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f510415c1f0 0x7f51040b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:34624/0 (socket says 172.21.15.84:34624) 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101400640 1 -- 172.21.15.84:0/1048735583 learned_addr learned my addr 172.21.15.84:0/1048735583 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5102800640 1 --1- 172.21.15.84:0/1048735583 >> v1:172.21.15.161:6789/0 conn(0x7f51040b3a00 0x7f510415c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:56016/0 (socket says 172.21.15.84:56016) 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101400640 1 -- 172.21.15.84:0/1048735583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f510415c1f0 msgr2=0x7f51040b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101400640 1 --2- 172.21.15.84:0/1048735583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f510415c1f0 0x7f51040b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101400640 1 -- 172.21.15.84:0/1048735583 >> v1:172.21.15.161:6789/0 conn(0x7f51040b3a00 legacy=0x7f510415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.390+0000 7f5101400640 1 -- 172.21.15.84:0/1048735583 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040b0850 con 0x7f51040cf100 2024-03-07T07:34:33.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5101400640 1 --2- 172.21.15.84:0/1048735583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 0x7f51040d14e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3959d90f8e0c6b1b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5100a00640 1 -- 172.21.15.84:0/1048735583 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00b0070 con 0x7f51040cf100 2024-03-07T07:34:33.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5100a00640 1 -- 172.21.15.84:0/1048735583 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00ab600 con 0x7f51040cf100 2024-03-07T07:34:33.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5100a00640 1 -- 172.21.15.84:0/1048735583 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00ab9d0 con 0x7f51040cf100 2024-03-07T07:34:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 -- 172.21.15.84:0/1048735583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 msgr2=0x7f51040d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 --2- 172.21.15.84:0/1048735583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 0x7f51040d14e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f001c4d0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 -- 172.21.15.84:0/1048735583 shutdown_connections 2024-03-07T07:34:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 --2- 172.21.15.84:0/1048735583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 0x7f51040d14e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 --2- 172.21.15.84:0/1048735583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f510415c1f0 0x7f51040b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 -- 172.21.15.84:0/1048735583 >> 172.21.15.84:0/1048735583 conn(0x7f51040b1ed0 msgr2=0x7f51040b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 -- 172.21.15.84:0/1048735583 shutdown_connections 2024-03-07T07:34:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 -- 172.21.15.84:0/1048735583 wait complete. 2024-03-07T07:34:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 Processor -- start 2024-03-07T07:34:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.394+0000 7f5108c00640 1 -- start start 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51040b3a00 0x7f510414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 0x7f5104153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f510415c1f0 0x7f510414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5104168e60 con 0x7f510415c1f0 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5104168ce0 con 0x7f51040cf100 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5104168fe0 con 0x7f51040b3a00 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f510415c1f0 0x7f510414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f510415c1f0 0x7f510414cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33754/0 (socket says 172.21.15.84:33754) 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 -- 172.21.15.84:0/1146880384 learned_addr learned my addr 172.21.15.84:0/1146880384 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:33.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5101e00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51040b3a00 0x7f510414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5101400640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 0x7f5104153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 -- 172.21.15.84:0/1146880384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51040b3a00 msgr2=0x7f510414de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51040b3a00 0x7f510414de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 -- 172.21.15.84:0/1146880384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 msgr2=0x7f5104153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 0x7f5104153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 -- 172.21.15.84:0/1146880384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104155010 con 0x7f510415c1f0 2024-03-07T07:34:33.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5102800640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f510415c1f0 0x7f510414cc60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00c7a0 tx=0x7f50fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f50fa000640 1 -- 172.21.15.84:0/1146880384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc017070 con 0x7f510415c1f0 2024-03-07T07:34:33.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f50fa000640 1 -- 172.21.15.84:0/1146880384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc00a640 con 0x7f510415c1f0 2024-03-07T07:34:33.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51041552f0 con 0x7f510415c1f0 2024-03-07T07:34:33.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f50fa000640 1 -- 172.21.15.84:0/1146880384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00a9f0 con 0x7f510415c1f0 2024-03-07T07:34:33.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51041558b0 con 0x7f510415c1f0 2024-03-07T07:34:33.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5104062d40 con 0x7f510415c1f0 2024-03-07T07:34:33.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.398+0000 7f50fa000640 1 -- 172.21.15.84:0/1146880384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f50fc01a070 con 0x7f510415c1f0 2024-03-07T07:34:33.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.402+0000 7f50fa000640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f50e4066f60 0x7f50e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.402+0000 7f50fa000640 1 -- 172.21.15.84:0/1146880384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f50fc0846e0 con 0x7f510415c1f0 2024-03-07T07:34:33.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.402+0000 7f5101e00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f50e4066f60 0x7f50e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.402+0000 7f5101e00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f50e4066f60 0x7f50e4069420 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009ac0 tx=0x7f50f4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.406+0000 7f50fa000640 1 -- 172.21.15.84:0/1146880384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f50fc054f80 con 0x7f510415c1f0 2024-03-07T07:34:33.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.602+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51040b1630 con 0x7f510415c1f0 2024-03-07T07:34:33.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.602+0000 7f50fa000640 1 -- 172.21.15.84:0/1146880384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16822 (secure 0 0 0) 0x7f50fc059020 con 0x7f510415c1f0 2024-03-07T07:34:33.609 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:33.609 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:32:54.985899+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:32:07.581845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-07T07:32:08.085165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.5","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f50e4066f60 msgr2=0x7f50e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f50e4066f60 0x7f50e4069420 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009ac0 tx=0x7f50f4009190 comp rx=0 tx=0).stop 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f510415c1f0 msgr2=0x7f510414cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f510415c1f0 0x7f510414cc60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00c7a0 tx=0x7f50fc00cc60 comp rx=0 tx=0).stop 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 shutdown_connections 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f50e4066f60 0x7f50e4069420 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f510415c1f0 0x7f510414cc60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51040cf100 0x7f5104153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 --2- 172.21.15.84:0/1146880384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51040b3a00 0x7f510414de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 >> 172.21.15.84:0/1146880384 conn(0x7f51040b1ed0 msgr2=0x7f51040cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:33.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 shutdown_connections 2024-03-07T07:34:33.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.606+0000 7f5108c00640 1 -- 172.21.15.84:0/1146880384 wait complete. 2024-03-07T07:34:33.631 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-07T07:34:33.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:34:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f0611c00640 1 Processor -- start 2024-03-07T07:34:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f0611c00640 1 -- start start 2024-03-07T07:34:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f0611c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f060c145a30 0x7f060c0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f0611c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0cf9a0 con 0x7f060c0a9540 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f0611c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c06d780 con 0x7f060c06d230 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f0611c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c06da60 con 0x7f060c145a30 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f060aa00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f060c145a30 0x7f060c0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f060a000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f060c0a9540 0x7f060c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57374/0 (socket says 172.21.15.84:57374) 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f060a000640 1 -- 172.21.15.84:0/1309453315 learned_addr learned my addr 172.21.15.84:0/1309453315 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f060aa00640 1 -- 172.21.15.84:0/1309453315 >> v1:172.21.15.161:6789/0 conn(0x7f060c06d230 legacy=0x7f060c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f060aa00640 1 -- 172.21.15.84:0/1309453315 >> v1:172.21.15.84:6789/0 conn(0x7f060c0a9540 legacy=0x7f060c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f060aa00640 1 -- 172.21.15.84:0/1309453315 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c06dd40 con 0x7f060c145a30 2024-03-07T07:34:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.766+0000 7f0609600640 1 -- 172.21.15.84:0/1309453315 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666430273 0 0) 0x7f060c0cf9a0 con 0x7f060c0a9540 2024-03-07T07:34:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f060aa00640 1 --2- 172.21.15.84:0/1309453315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0729d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0097c0 tx=0x7f05fc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdf82cbce8c4c57 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0609600640 1 -- 172.21.15.84:0/1309453315 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0b0070 con 0x7f060c145a30 2024-03-07T07:34:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0609600640 1 -- 172.21.15.84:0/1309453315 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc0ab600 con 0x7f060c145a30 2024-03-07T07:34:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0609600640 1 -- 172.21.15.84:0/1309453315 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0ab9d0 con 0x7f060c145a30 2024-03-07T07:34:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0611c00640 1 -- 172.21.15.84:0/1309453315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 msgr2=0x7f060c0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0611c00640 1 --2- 172.21.15.84:0/1309453315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0729d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0097c0 tx=0x7f05fc01c380 comp rx=0 tx=0).stop 2024-03-07T07:34:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0611c00640 1 -- 172.21.15.84:0/1309453315 shutdown_connections 2024-03-07T07:34:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0611c00640 1 --2- 172.21.15.84:0/1309453315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0729d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0611c00640 1 -- 172.21.15.84:0/1309453315 >> 172.21.15.84:0/1309453315 conn(0x7f060c0704b0 msgr2=0x7f060c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0611c00640 1 -- 172.21.15.84:0/1309453315 shutdown_connections 2024-03-07T07:34:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.770+0000 7f0611c00640 1 -- 172.21.15.84:0/1309453315 wait complete. 2024-03-07T07:34:33.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 Processor -- start 2024-03-07T07:34:33.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 -- start start 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f060c06d230 0x7f060c0ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f060c142900 0x7f060c1f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c16a400 con 0x7f060c145a30 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c073320 con 0x7f060c06d230 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c16a580 con 0x7f060c142900 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33778/0 (socket says 172.21.15.84:33778) 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 -- 172.21.15.84:0/3105900028 learned_addr learned my addr 172.21.15.84:0/3105900028 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060aa00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f060c06d230 0x7f060c0ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060b400640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f060c142900 0x7f060c1f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 -- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f060c142900 msgr2=0x7f060c1f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f060c142900 0x7f060c1f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 -- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f060c06d230 msgr2=0x7f060c0ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f060c06d230 0x7f060c0ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 -- 172.21.15.84:0/3105900028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c0aebd0 con 0x7f060c145a30 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060b400640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f060c142900 0x7f060c1f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f060a000640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0ac7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f05f800c4a0 tx=0x7f05f800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0602a00640 1 -- 172.21.15.84:0/3105900028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8018070 con 0x7f060c145a30 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0602a00640 1 -- 172.21.15.84:0/3105900028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f80074e0 con 0x7f060c145a30 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c142d90 con 0x7f060c145a30 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0602a00640 1 -- 172.21.15.84:0/3105900028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8004a30 con 0x7f060c145a30 2024-03-07T07:34:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.774+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c1425f0 con 0x7f060c145a30 2024-03-07T07:34:33.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.778+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c142140 con 0x7f060c145a30 2024-03-07T07:34:33.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.778+0000 7f0602a00640 1 -- 172.21.15.84:0/3105900028 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f05f801b070 con 0x7f060c145a30 2024-03-07T07:34:33.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.778+0000 7f0602a00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ec066f60 0x7f05ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:33.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.778+0000 7f0602a00640 1 -- 172.21.15.84:0/3105900028 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f05f8084230 con 0x7f060c145a30 2024-03-07T07:34:33.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.778+0000 7f060aa00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ec066f60 0x7f05ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:33.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.778+0000 7f060aa00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ec066f60 0x7f05ec069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0ad000 tx=0x7f05fc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:33.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.782+0000 7f0602a00640 1 -- 172.21.15.84:0/3105900028 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f05f8054c00 con 0x7f060c145a30 2024-03-07T07:34:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.982+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f060c062d40 con 0x7f060c145a30 2024-03-07T07:34:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.982+0000 7f0602a00640 1 -- 172.21.15.84:0/3105900028 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4980 (secure 0 0 0) 0x7f05f8058ca0 con 0x7f060c145a30 2024-03-07T07:34:33.988 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:33.988 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/2371752160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2371752160},{"type":"v1","addr":"172.21.15.161:6834","nonce":2371752160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/850187244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":850187244},{"type":"v1","addr":"172.21.15.161:6835","nonce":850187244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3878293455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3878293455},{"type":"v1","addr":"172.21.15.84:6836","nonce":3878293455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:32:09.092583+0000","modified":"2024-03-07T07:32:12.103936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2828752085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2828752085},{"type":"v1","addr":"172.21.15.84:6837","nonce":2828752085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4995,"qdb_cluster":[4995]},"id":2}]} 2024-03-07T07:34:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-03-07T07:34:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ec066f60 msgr2=0x7f05ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ec066f60 0x7f05ec069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0ad000 tx=0x7f05fc0a6000 comp rx=0 tx=0).stop 2024-03-07T07:34:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 msgr2=0x7f060c0ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0ac7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f05f800c4a0 tx=0x7f05f800c960 comp rx=0 tx=0).stop 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 shutdown_connections 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f05ec066f60 0x7f05ec069420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f060c142900 0x7f060c1f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f060c145a30 0x7f060c0ac7a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 --2- 172.21.15.84:0/3105900028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f060c06d230 0x7f060c0ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 >> 172.21.15.84:0/3105900028 conn(0x7f060c0704b0 msgr2=0x7f060c13e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 shutdown_connections 2024-03-07T07:34:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:33.986+0000 7f0611c00640 1 -- 172.21.15.84:0/3105900028 wait complete. 2024-03-07T07:34:34.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:34:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.138+0000 7f39e0400640 1 Processor -- start 2024-03-07T07:34:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.138+0000 7f39e0400640 1 -- start start 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39e0400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80ced60 0x7f39d80d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39e0400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39d80b6610 0x7f39d80b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39e0400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d8070740 con 0x7f39d80cd5b0 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39e0400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d80b2f20 con 0x7f39d80b6610 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39e0400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80b6fa0 con 0x7f39d80ced60 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39de400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39d80b6610 0x7f39d80b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39de400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39d80b6610 0x7f39d80b6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33786/0 (socket says 172.21.15.84:33786) 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39de400640 1 -- 172.21.15.84:0/3356181344 learned_addr learned my addr 172.21.15.84:0/3356181344 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39dd000640 1 --2- 172.21.15.84:0/3356181344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80ced60 0x7f39d80d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39de400640 1 -- 172.21.15.84:0/3356181344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80ced60 msgr2=0x7f39d80d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39de400640 1 --2- 172.21.15.84:0/3356181344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80ced60 0x7f39d80d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39de400640 1 -- 172.21.15.84:0/3356181344 >> v1:172.21.15.161:6789/0 conn(0x7f39d80cd5b0 legacy=0x7f39d815fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39de400640 1 -- 172.21.15.84:0/3356181344 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d8070a20 con 0x7f39d80b6610 2024-03-07T07:34:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39de400640 1 --2- 172.21.15.84:0/3356181344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80b6610 0x7f39d80b6a60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009e50 tx=0x7f39d001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbddbf55472a4dd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.142+0000 7f39d7e00640 1 -- 172.21.15.84:0/3356181344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00a5700 con 0x7f39d80b6610 2024-03-07T07:34:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39d7e00640 1 -- 172.21.15.84:0/3356181344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00a58a0 con 0x7f39d80b6610 2024-03-07T07:34:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39d7e00640 1 -- 172.21.15.84:0/3356181344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00a5c70 con 0x7f39d80b6610 2024-03-07T07:34:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- 172.21.15.84:0/3356181344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80b6610 msgr2=0x7f39d80b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 --2- 172.21.15.84:0/3356181344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80b6610 0x7f39d80b6a60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009e50 tx=0x7f39d001ca30 comp rx=0 tx=0).stop 2024-03-07T07:34:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- 172.21.15.84:0/3356181344 shutdown_connections 2024-03-07T07:34:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 --2- 172.21.15.84:0/3356181344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80b6610 0x7f39d80b6a60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 --2- 172.21.15.84:0/3356181344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80ced60 0x7f39d80d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- 172.21.15.84:0/3356181344 >> 172.21.15.84:0/3356181344 conn(0x7f39d806b0f0 msgr2=0x7f39d806b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- 172.21.15.84:0/3356181344 shutdown_connections 2024-03-07T07:34:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- 172.21.15.84:0/3356181344 wait complete. 2024-03-07T07:34:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 Processor -- start 2024-03-07T07:34:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- start start 2024-03-07T07:34:34.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d80b6610 0x7f39d8166520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80cd5b0 0x7f39d813c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80ced60 0x7f39d81525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d815cfb0 con 0x7f39d80ced60 2024-03-07T07:34:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80cd990 con 0x7f39d80b6610 2024-03-07T07:34:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39e0400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d815d130 con 0x7f39d80cd5b0 2024-03-07T07:34:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39de400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80ced60 0x7f39d81525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39de400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80ced60 0x7f39d81525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33792/0 (socket says 172.21.15.84:33792) 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39de400640 1 -- 172.21.15.84:0/2672431120 learned_addr learned my addr 172.21.15.84:0/2672431120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39dda00640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d80b6610 0x7f39d8166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.146+0000 7f39dd000640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80cd5b0 0x7f39d813c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39de400640 1 -- 172.21.15.84:0/2672431120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80cd5b0 msgr2=0x7f39d813c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39de400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80cd5b0 0x7f39d813c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39de400640 1 -- 172.21.15.84:0/2672431120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d80b6610 msgr2=0x7f39d8166520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39de400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d80b6610 0x7f39d8166520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39de400640 1 -- 172.21.15.84:0/2672431120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d813cfe0 con 0x7f39d80ced60 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39de400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80ced60 0x7f39d81525d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f39d001a660 tx=0x7f39d00197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39d5600640 1 -- 172.21.15.84:0/2672431120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00b8670 con 0x7f39d80ced60 2024-03-07T07:34:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39d5600640 1 -- 172.21.15.84:0/2672431120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00be070 con 0x7f39d80ced60 2024-03-07T07:34:34.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39d5600640 1 -- 172.21.15.84:0/2672431120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00b8a70 con 0x7f39d80ced60 2024-03-07T07:34:34.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d813d2c0 con 0x7f39d80ced60 2024-03-07T07:34:34.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d813d880 con 0x7f39d80ced60 2024-03-07T07:34:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d8062d40 con 0x7f39d80ced60 2024-03-07T07:34:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39d5600640 1 -- 172.21.15.84:0/2672431120 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f39d00b8c10 con 0x7f39d80ced60 2024-03-07T07:34:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39d5600640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39b8066f60 0x7f39b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39d5600640 1 -- 172.21.15.84:0/2672431120 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f39d01201e0 con 0x7f39d80ced60 2024-03-07T07:34:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.150+0000 7f39dda00640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39b8066f60 0x7f39b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.154+0000 7f39dda00640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39b8066f60 0x7f39b8069420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39cc001810 tx=0x7f39cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.154+0000 7f39d5600640 1 -- 172.21.15.84:0/2672431120 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f39d0016620 con 0x7f39d80ced60 2024-03-07T07:34:34.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.342+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39d80b19f0 con 0x7f39d80ced60 2024-03-07T07:34:34.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.342+0000 7f39d5600640 1 -- 172.21.15.84:0/2672431120 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4980 (secure 0 0 0) 0x7f39d00f0c70 con 0x7f39d80ced60 2024-03-07T07:34:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:34.349 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/2371752160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2371752160},{"type":"v1","addr":"172.21.15.161:6834","nonce":2371752160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/850187244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":850187244},{"type":"v1","addr":"172.21.15.161:6835","nonce":850187244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3878293455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3878293455},{"type":"v1","addr":"172.21.15.84:6836","nonce":3878293455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T07:32:09.092583+0000","modified":"2024-03-07T07:32:12.103936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2828752085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2828752085},{"type":"v1","addr":"172.21.15.84:6837","nonce":2828752085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4995,"qdb_cluster":[4995]},"id":2}]} 2024-03-07T07:34:34.350 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-03-07T07:34:34.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39b8066f60 msgr2=0x7f39b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39b8066f60 0x7f39b8069420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39cc001810 tx=0x7f39cc009040 comp rx=0 tx=0).stop 2024-03-07T07:34:34.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80ced60 msgr2=0x7f39d81525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80ced60 0x7f39d81525d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f39d001a660 tx=0x7f39d00197d0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 shutdown_connections 2024-03-07T07:34:34.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f39b8066f60 0x7f39b8069420 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d80ced60 0x7f39d81525d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39d80cd5b0 0x7f39d813c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 --2- 172.21.15.84:0/2672431120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d80b6610 0x7f39d8166520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 >> 172.21.15.84:0/2672431120 conn(0x7f39d806b0f0 msgr2=0x7f39d815fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:34.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 shutdown_connections 2024-03-07T07:34:34.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.346+0000 7f39e0400640 1 -- 172.21.15.84:0/2672431120 wait complete. 2024-03-07T07:34:34.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:34:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e3800640 1 Processor -- start 2024-03-07T07:34:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e3800640 1 -- start start 2024-03-07T07:34:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e3800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89dc15bca0 0x7f89dc0b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e3800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15c080 0x7f89dc15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e3800640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f89dc15ff70 0x7f89dc0b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e3800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc0d1c50 con 0x7f89dc15bca0 2024-03-07T07:34:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e3800640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc0d1970 con 0x7f89dc15ff70 2024-03-07T07:34:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e3800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0b6010 con 0x7f89dc15c080 2024-03-07T07:34:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e0e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89dc15bca0 0x7f89dc0b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e0e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89dc15bca0 0x7f89dc0b7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33796/0 (socket says 172.21.15.84:33796) 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e0e00640 1 -- 172.21.15.84:0/1456589824 learned_addr learned my addr 172.21.15.84:0/1456589824 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89dbe00640 1 --2- 172.21.15.84:0/1456589824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15c080 0x7f89dc15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e1800640 1 --2- 172.21.15.84:0/1456589824 >> v2:172.21.15.161:3300/0 conn(0x7f89dc15ff70 0x7f89dc0b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e0e00640 1 -- 172.21.15.84:0/1456589824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15c080 msgr2=0x7f89dc15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e0e00640 1 --2- 172.21.15.84:0/1456589824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15c080 0x7f89dc15fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e0e00640 1 -- 172.21.15.84:0/1456589824 >> v2:172.21.15.161:3300/0 conn(0x7f89dc15ff70 msgr2=0x7f89dc0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e0e00640 1 --2- 172.21.15.84:0/1456589824 >> v2:172.21.15.161:3300/0 conn(0x7f89dc15ff70 0x7f89dc0b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e0e00640 1 -- 172.21.15.84:0/1456589824 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0b62f0 con 0x7f89dc15bca0 2024-03-07T07:34:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.502+0000 7f89e1800640 1 --2- 172.21.15.84:0/1456589824 >> v2:172.21.15.161:3300/0 conn(0x7f89dc15ff70 0x7f89dc0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e0e00640 1 --2- 172.21.15.84:0/1456589824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15bca0 0x7f89dc0b7bd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0b1bf0 tx=0x7f89d001c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df0d6c50585965e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89db400640 1 -- 172.21.15.84:0/1456589824 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00b0070 con 0x7f89dc15bca0 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89db400640 1 -- 172.21.15.84:0/1456589824 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d00ab600 con 0x7f89dc15bca0 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89db400640 1 -- 172.21.15.84:0/1456589824 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00ab9d0 con 0x7f89dc15bca0 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 -- 172.21.15.84:0/1456589824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15bca0 msgr2=0x7f89dc0b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 --2- 172.21.15.84:0/1456589824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15bca0 0x7f89dc0b7bd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0b1bf0 tx=0x7f89d001c1d0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 -- 172.21.15.84:0/1456589824 shutdown_connections 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 --2- 172.21.15.84:0/1456589824 >> v2:172.21.15.161:3300/0 conn(0x7f89dc15ff70 0x7f89dc0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 --2- 172.21.15.84:0/1456589824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15c080 0x7f89dc15fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 --2- 172.21.15.84:0/1456589824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15bca0 0x7f89dc0b7bd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 -- 172.21.15.84:0/1456589824 >> 172.21.15.84:0/1456589824 conn(0x7f89dc0704b0 msgr2=0x7f89dc0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 -- 172.21.15.84:0/1456589824 shutdown_connections 2024-03-07T07:34:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.506+0000 7f89e3800640 1 -- 172.21.15.84:0/1456589824 wait complete. 2024-03-07T07:34:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 Processor -- start 2024-03-07T07:34:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 -- start start 2024-03-07T07:34:34.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15bca0 0x7f89dc157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89dc15c080 0x7f89dc155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15ff70 0x7f89dc155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0ced40 con 0x7f89dc15ff70 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0cebc0 con 0x7f89dc15c080 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0ceec0 con 0x7f89dc15bca0 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15ff70 0x7f89dc155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e0e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15bca0 0x7f89dc157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15ff70 0x7f89dc155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33802/0 (socket says 172.21.15.84:33802) 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 -- 172.21.15.84:0/3106673442 learned_addr learned my addr 172.21.15.84:0/3106673442 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e0e00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15bca0 0x7f89dc157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:34662/0 (socket says 172.21.15.84:34662) 2024-03-07T07:34:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89dbe00640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89dc15c080 0x7f89dc155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 -- 172.21.15.84:0/3106673442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15bca0 msgr2=0x7f89dc157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15bca0 0x7f89dc157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 -- 172.21.15.84:0/3106673442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89dc15c080 msgr2=0x7f89dc155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89dc15c080 0x7f89dc155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 -- 172.21.15.84:0/3106673442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc144e60 con 0x7f89dc15ff70 2024-03-07T07:34:34.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e1800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15ff70 0x7f89dc155e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f89d400cd50 tx=0x7f89d400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89d8c00640 1 -- 172.21.15.84:0/3106673442 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400f680 con 0x7f89dc15ff70 2024-03-07T07:34:34.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89d8c00640 1 -- 172.21.15.84:0/3106673442 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400f840 con 0x7f89dc15ff70 2024-03-07T07:34:34.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc159110 con 0x7f89dc15ff70 2024-03-07T07:34:34.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89d8c00640 1 -- 172.21.15.84:0/3106673442 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400fc30 con 0x7f89dc15ff70 2024-03-07T07:34:34.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.510+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc166580 con 0x7f89dc15ff70 2024-03-07T07:34:34.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.514+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc067d30 con 0x7f89dc15ff70 2024-03-07T07:34:34.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.514+0000 7f89d8c00640 1 -- 172.21.15.84:0/3106673442 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f89d40213f0 con 0x7f89dc15ff70 2024-03-07T07:34:34.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.514+0000 7f89d8c00640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f89bc066f60 0x7f89bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.514+0000 7f89d8c00640 1 -- 172.21.15.84:0/3106673442 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f89d4085d70 con 0x7f89dc15ff70 2024-03-07T07:34:34.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.514+0000 7f89e0e00640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f89bc066f60 0x7f89bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.514+0000 7f89e0e00640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f89bc066f60 0x7f89bc069420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f89d00ad000 tx=0x7f89d00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.518+0000 7f89d8c00640 1 -- 172.21.15.84:0/3106673442 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f89dc144e60 con 0x7f89dc15ff70 2024-03-07T07:34:34.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.678+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89dc062d40 con 0x7f89dc15ff70 2024-03-07T07:34:34.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.678+0000 7f89d8c00640 1 -- 172.21.15.84:0/3106673442 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16822 (secure 0 0 0) 0x7f89d4014030 con 0x7f89dc15ff70 2024-03-07T07:34:34.685 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:34.685 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:32:54.985899+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-07T07:32:07.581845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-07T07:32:08.085165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.5","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:34:34.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f89bc066f60 msgr2=0x7f89bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f89bc066f60 0x7f89bc069420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f89d00ad000 tx=0x7f89d00a6000 comp rx=0 tx=0).stop 2024-03-07T07:34:34.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15ff70 msgr2=0x7f89dc155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15ff70 0x7f89dc155e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f89d400cd50 tx=0x7f89d400a650 comp rx=0 tx=0).stop 2024-03-07T07:34:34.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 shutdown_connections 2024-03-07T07:34:34.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f89bc066f60 0x7f89bc069420 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc15ff70 0x7f89dc155e80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89dc15c080 0x7f89dc155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 --2- 172.21.15.84:0/3106673442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89dc15bca0 0x7f89dc157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 >> 172.21.15.84:0/3106673442 conn(0x7f89dc0704b0 msgr2=0x7f89dc0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:34.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 shutdown_connections 2024-03-07T07:34:34.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.682+0000 7f89e3800640 1 -- 172.21.15.84:0/3106673442 wait complete. 2024-03-07T07:34:34.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-07T07:34:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.838+0000 7f661b600640 1 Processor -- start 2024-03-07T07:34:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.838+0000 7f661b600640 1 -- start start 2024-03-07T07:34:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.838+0000 7f661b600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66141586d0 0x7f661415f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.838+0000 7f661b600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66140aab90 0x7f66140704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.838+0000 7f661b600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66140731e0 con 0x7f6614072d60 2024-03-07T07:34:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.838+0000 7f661b600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6614073490 con 0x7f66140aab90 2024-03-07T07:34:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.838+0000 7f661b600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6614161db0 con 0x7f66141586d0 2024-03-07T07:34:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6613e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6614072d60 0x7f66140aa480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57388/0 (socket says 172.21.15.84:57388) 2024-03-07T07:34:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6619600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66140aab90 0x7f66140704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6613e00640 1 -- 172.21.15.84:0/411065079 learned_addr learned my addr 172.21.15.84:0/411065079 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6618c00640 1 --2- 172.21.15.84:0/411065079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66141586d0 0x7f661415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6619600640 1 -- 172.21.15.84:0/411065079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66141586d0 msgr2=0x7f661415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6619600640 1 --2- 172.21.15.84:0/411065079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66141586d0 0x7f661415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6619600640 1 -- 172.21.15.84:0/411065079 >> v1:172.21.15.84:6789/0 conn(0x7f6614072d60 legacy=0x7f66140aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6619600640 1 -- 172.21.15.84:0/411065079 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614162090 con 0x7f66140aab90 2024-03-07T07:34:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6618c00640 1 --2- 172.21.15.84:0/411065079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66141586d0 0x7f661415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6613400640 1 -- 172.21.15.84:0/411065079 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282748804 0 0) 0x7f66140731e0 con 0x7f6614072d60 2024-03-07T07:34:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6619600640 1 --2- 172.21.15.84:0/411065079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f66140704b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f660c009d90 tx=0x7f660c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80fa878b7c06e90 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6613400640 1 -- 172.21.15.84:0/411065079 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0b2070 con 0x7f66140aab90 2024-03-07T07:34:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6613400640 1 -- 172.21.15.84:0/411065079 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c0a5920 con 0x7f66140aab90 2024-03-07T07:34:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.842+0000 7f6613400640 1 -- 172.21.15.84:0/411065079 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0a5cf0 con 0x7f66140aab90 2024-03-07T07:34:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- 172.21.15.84:0/411065079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 msgr2=0x7f66140704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 --2- 172.21.15.84:0/411065079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f66140704b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f660c009d90 tx=0x7f660c01c970 comp rx=0 tx=0).stop 2024-03-07T07:34:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- 172.21.15.84:0/411065079 shutdown_connections 2024-03-07T07:34:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 --2- 172.21.15.84:0/411065079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f66140704b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 --2- 172.21.15.84:0/411065079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66141586d0 0x7f661415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- 172.21.15.84:0/411065079 >> 172.21.15.84:0/411065079 conn(0x7f6614072240 msgr2=0x7f6614072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- 172.21.15.84:0/411065079 shutdown_connections 2024-03-07T07:34:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- 172.21.15.84:0/411065079 wait complete. 2024-03-07T07:34:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 Processor -- start 2024-03-07T07:34:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- start start 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6614072d60 0x7f6614152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f661413d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66141586d0 0x7f661413d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614158c30 con 0x7f66140aab90 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614158ab0 con 0x7f66141586d0 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f661b600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6614071200 con 0x7f6614072d60 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f6613e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f661413d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f6613e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f661413d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33816/0 (socket says 172.21.15.84:33816) 2024-03-07T07:34:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f6613e00640 1 -- 172.21.15.84:0/4042524746 learned_addr learned my addr 172.21.15.84:0/4042524746 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f6619600640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66141586d0 0x7f661413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.846+0000 7f6618c00640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6614072d60 0x7f6614152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6613e00640 1 -- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6614072d60 msgr2=0x7f6614152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6613e00640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6614072d60 0x7f6614152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6613e00640 1 -- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66141586d0 msgr2=0x7f661413d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6613e00640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66141586d0 0x7f661413d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6613e00640 1 -- 172.21.15.84:0/4042524746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66141fabd0 con 0x7f66140aab90 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6618c00640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6614072d60 0x7f6614152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6613e00640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f661413d1e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f66000011f0 tx=0x7f660000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6610c00640 1 -- 172.21.15.84:0/4042524746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600018070 con 0x7f66140aab90 2024-03-07T07:34:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6610c00640 1 -- 172.21.15.84:0/4042524746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66000074e0 con 0x7f66140aab90 2024-03-07T07:34:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6610c00640 1 -- 172.21.15.84:0/4042524746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600004a10 con 0x7f66140aab90 2024-03-07T07:34:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661413ddc0 con 0x7f66140aab90 2024-03-07T07:34:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661413e380 con 0x7f66140aab90 2024-03-07T07:34:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6614062d40 con 0x7f66140aab90 2024-03-07T07:34:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6610c00640 1 -- 172.21.15.84:0/4042524746 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f6600004bb0 con 0x7f66140aab90 2024-03-07T07:34:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6610c00640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f65f4066f60 0x7f65f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6610c00640 1 -- 172.21.15.84:0/4042524746 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f66000843c0 con 0x7f66140aab90 2024-03-07T07:34:34.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.850+0000 7f6618c00640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f65f4066f60 0x7f65f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:34.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.854+0000 7f6618c00640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f65f4066f60 0x7f65f4069420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f660800b990 tx=0x7f6608008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:34.854+0000 7f6610c00640 1 -- 172.21.15.84:0/4042524746 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6600054d30 con 0x7f66140aab90 2024-03-07T07:34:35.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.050+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6614153300 con 0x7f66140aab90 2024-03-07T07:34:35.054 INFO:tasks.ceph.mon.a.smithi084.stderr:2024-03-07T07:34:35.050+0000 7f8f05a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-07T07:34:35.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.050+0000 7f6610c00640 1 -- 172.21.15.84:0/4042524746 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f660005b080 con 0x7f66140aab90 2024-03-07T07:34:35.056 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-07T07:34:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f65f4066f60 msgr2=0x7f65f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f65f4066f60 0x7f65f4069420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f660800b990 tx=0x7f6608008040 comp rx=0 tx=0).stop 2024-03-07T07:34:35.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 msgr2=0x7f661413d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:35.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f661413d1e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f66000011f0 tx=0x7f660000c9b0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 shutdown_connections 2024-03-07T07:34:35.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f65f4066f60 0x7f65f4069420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66141586d0 0x7f661413d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66140aab90 0x7f661413d1e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 --2- 172.21.15.84:0/4042524746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6614072d60 0x7f6614152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 >> 172.21.15.84:0/4042524746 conn(0x7f6614072240 msgr2=0x7f6614161130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 shutdown_connections 2024-03-07T07:34:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.054+0000 7f661b600640 1 -- 172.21.15.84:0/4042524746 wait complete. 2024-03-07T07:34:35.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-07T07:34:35.127 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2024-03-07T07:34:35.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a9000640 1 Processor -- start 2024-03-07T07:34:35.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a9000640 1 -- start start 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a9000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a406e920 0x7fb8a40b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a9000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8a40b4480 0x7fb8a40711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a9000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40b50e0 con 0x7fb8a415f380 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a9000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40b2f10 con 0x7fb8a40b4480 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a9000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a415f760 con 0x7fb8a406e920 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a2800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8a40b4480 0x7fb8a40711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a2800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8a40b4480 0x7fb8a40711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33838/0 (socket says 172.21.15.84:33838) 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a2800640 1 -- 172.21.15.84:0/1877905994 learned_addr learned my addr 172.21.15.84:0/1877905994 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a1400640 1 --2- 172.21.15.84:0/1877905994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a406e920 0x7fb8a40b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a2800640 1 -- 172.21.15.84:0/1877905994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a406e920 msgr2=0x7fb8a40b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a2800640 1 --2- 172.21.15.84:0/1877905994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a406e920 0x7fb8a40b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a2800640 1 -- 172.21.15.84:0/1877905994 >> v1:172.21.15.161:6789/0 conn(0x7fb8a415f380 legacy=0x7fb8a406e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a2800640 1 -- 172.21.15.84:0/1877905994 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40b4b20 con 0x7fb8a40b4480 2024-03-07T07:34:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.218+0000 7fb8a1400640 1 --2- 172.21.15.84:0/1877905994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a406e920 0x7fb8a40b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a2800640 1 --2- 172.21.15.84:0/1877905994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40b4480 0x7fb8a40711a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009870 tx=0x7fb89c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de28d0fd1acb967 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a0a00640 1 -- 172.21.15.84:0/1877905994 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0b0070 con 0x7fb8a40b4480 2024-03-07T07:34:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a0a00640 1 -- 172.21.15.84:0/1877905994 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c0ab600 con 0x7fb8a40b4480 2024-03-07T07:34:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a0a00640 1 -- 172.21.15.84:0/1877905994 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0ab9d0 con 0x7fb8a40b4480 2024-03-07T07:34:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 -- 172.21.15.84:0/1877905994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40b4480 msgr2=0x7fb8a40711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 --2- 172.21.15.84:0/1877905994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40b4480 0x7fb8a40711a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009870 tx=0x7fb89c01c400 comp rx=0 tx=0).stop 2024-03-07T07:34:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 -- 172.21.15.84:0/1877905994 shutdown_connections 2024-03-07T07:34:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 --2- 172.21.15.84:0/1877905994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a40b4480 0x7fb8a40711a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 --2- 172.21.15.84:0/1877905994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a406e920 0x7fb8a40b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 -- 172.21.15.84:0/1877905994 >> 172.21.15.84:0/1877905994 conn(0x7fb8a40b18c0 msgr2=0x7fb8a40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 -- 172.21.15.84:0/1877905994 shutdown_connections 2024-03-07T07:34:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 -- 172.21.15.84:0/1877905994 wait complete. 2024-03-07T07:34:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 Processor -- start 2024-03-07T07:34:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.222+0000 7fb8a9000640 1 -- start start 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8a406e920 0x7fb8a41519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a40b4480 0x7fb8a40cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a415f380 0x7fb8a4159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40cc8b0 con 0x7fb8a415f380 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40cc730 con 0x7fb8a406e920 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4168b70 con 0x7fb8a40b4480 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a415f380 0x7fb8a4159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a415f380 0x7fb8a4159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33854/0 (socket says 172.21.15.84:33854) 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 -- 172.21.15.84:0/723048279 learned_addr learned my addr 172.21.15.84:0/723048279 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a1400640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a40b4480 0x7fb8a40cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a1e00640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8a406e920 0x7fb8a41519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 -- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a40b4480 msgr2=0x7fb8a40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a40b4480 0x7fb8a40cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 -- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8a406e920 msgr2=0x7fb8a41519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8a406e920 0x7fb8a41519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 -- 172.21.15.84:0/723048279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40ce400 con 0x7fb8a415f380 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a1400640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a40b4480 0x7fb8a40cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a2800640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a415f380 0x7fb8a4159ed0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009870 tx=0x7fb89c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb89a000640 1 -- 172.21.15.84:0/723048279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0ba020 con 0x7fb8a415f380 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb89a000640 1 -- 172.21.15.84:0/723048279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c0b6620 con 0x7fb8a415f380 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40cde40 con 0x7fb8a415f380 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb89a000640 1 -- 172.21.15.84:0/723048279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0b0040 con 0x7fb8a415f380 2024-03-07T07:34:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a409ab10 con 0x7fb8a415f380 2024-03-07T07:34:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a4062d40 con 0x7fb8a415f380 2024-03-07T07:34:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.226+0000 7fb89a000640 1 -- 172.21.15.84:0/723048279 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb89c0bd020 con 0x7fb8a415f380 2024-03-07T07:34:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.230+0000 7fb89a000640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb884066f60 0x7fb884069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.230+0000 7fb89a000640 1 -- 172.21.15.84:0/723048279 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fb89c11f230 con 0x7fb8a415f380 2024-03-07T07:34:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.230+0000 7fb8a1e00640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb884066f60 0x7fb884069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.230+0000 7fb8a1e00640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb884066f60 0x7fb884069420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4158e80 tx=0x7fb894003dd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.234+0000 7fb89a000640 1 -- 172.21.15.84:0/723048279 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fb89c0c4030 con 0x7fb8a415f380 2024-03-07T07:34:35.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:35.418+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb8a406f4c0 con 0x7fb8a415f380 2024-03-07T07:34:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb89a000640 1 -- 172.21.15.84:0/723048279 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb89c016110 con 0x7fb8a415f380 2024-03-07T07:34:36.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb884066f60 msgr2=0x7fb884069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:36.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb884066f60 0x7fb884069420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4158e80 tx=0x7fb894003dd0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a415f380 msgr2=0x7fb8a4159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a415f380 0x7fb8a4159ed0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009870 tx=0x7fb89c01ac40 comp rx=0 tx=0).stop 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 shutdown_connections 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb884066f60 0x7fb884069420 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8a415f380 0x7fb8a4159ed0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8a40b4480 0x7fb8a40cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 --2- 172.21.15.84:0/723048279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8a406e920 0x7fb8a41519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 >> 172.21.15.84:0/723048279 conn(0x7fb8a40b18c0 msgr2=0x7fb8a40b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 shutdown_connections 2024-03-07T07:34:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.058+0000 7fb8a9000640 1 -- 172.21.15.84:0/723048279 wait complete. 2024-03-07T07:34:36.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-07T07:34:36.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78ede00640 1 Processor -- start 2024-03-07T07:34:36.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78ede00640 1 -- start start 2024-03-07T07:34:36.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78ede00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f78e8143e30 0x7f78e80cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78ede00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e80b3500 0x7f78e806e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78ede00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e8071f80 con 0x7f78e8071af0 2024-03-07T07:34:36.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78ede00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e80b4290 con 0x7f78e8143e30 2024-03-07T07:34:36.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78ede00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80b4550 con 0x7f78e80b3500 2024-03-07T07:34:36.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78de000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f78e8071af0 0x7f78e80b2df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57404/0 (socket says 172.21.15.84:57404) 2024-03-07T07:34:36.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78de000640 1 -- 172.21.15.84:0/3986951248 learned_addr learned my addr 172.21.15.84:0/3986951248 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:36.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295755413 0 0) 0x7f78d00014a0 con 0x7f78e8071af0 2024-03-07T07:34:36.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78e6a00640 1 --2- 172.21.15.84:0/3986951248 >> v2:172.21.15.161:3300/0 conn(0x7f78e8143e30 0x7f78e80cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78cc005740 con 0x7f78e8071af0 2024-03-07T07:34:36.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.262+0000 7f78e7400640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e80b3500 0x7f78e806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612962555 0 0) 0x7f78cc005740 con 0x7f78e8071af0 2024-03-07T07:34:36.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e80b3500 msgr2=0x7f78e806e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:36.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e80b3500 0x7f78e806e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 >> v2:172.21.15.161:3300/0 conn(0x7f78e8143e30 msgr2=0x7f78e80cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 --2- 172.21.15.84:0/3986951248 >> v2:172.21.15.161:3300/0 conn(0x7f78e8143e30 0x7f78e80cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e80b4830 con 0x7f78e8071af0 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f78d0001bd0 con 0x7f78e8071af0 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 >> v1:172.21.15.84:6789/0 conn(0x7f78e8071af0 legacy=0x7f78e80b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc005bd0 0x7f78cc005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78cc006a20 0x7f78cc006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e80b3500 0x7f78cc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80b4290 con 0x7f78cc006a20 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80b4550 con 0x7f78cc005bd0 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc00dbe0 con 0x7f78e80b3500 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78de000640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78cc006a20 0x7f78cc006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e6a00640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc005bd0 0x7f78cc005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78e7400640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e80b3500 0x7f78cc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78de000640 1 -- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e80b3500 msgr2=0x7f78cc0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78de000640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e80b3500 0x7f78cc0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78de000640 1 -- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc005bd0 msgr2=0x7f78cc005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78de000640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc005bd0 0x7f78cc005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.266+0000 7f78de000640 1 -- 172.21.15.84:0/3986951248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc005740 con 0x7f78cc006a20 2024-03-07T07:34:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78de000640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78cc006a20 0x7f78cc006ea0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f78d000a980 tx=0x7f78d001fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a02a9d161e0396 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d000a5d0 con 0x7f78cc006a20 2024-03-07T07:34:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d00b2070 con 0x7f78cc006a20 2024-03-07T07:34:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78e6000640 1 -- 172.21.15.84:0/3986951248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d00ad8a0 con 0x7f78cc006a20 2024-03-07T07:34:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- 172.21.15.84:0/3986951248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78cc006a20 msgr2=0x7f78cc006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 --2- 172.21.15.84:0/3986951248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78cc006a20 0x7f78cc006ea0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f78d000a980 tx=0x7f78d001fa20 comp rx=0 tx=0).stop 2024-03-07T07:34:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78e7400640 1 -- 172.21.15.84:0/3986951248 reap_dead start 2024-03-07T07:34:36.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- 172.21.15.84:0/3986951248 shutdown_connections 2024-03-07T07:34:36.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- 172.21.15.84:0/3986951248 >> 172.21.15.84:0/3986951248 conn(0x7f78e80cc840 msgr2=0x7f78e80ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:36.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- 172.21.15.84:0/3986951248 shutdown_connections 2024-03-07T07:34:36.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- 172.21.15.84:0/3986951248 wait complete. 2024-03-07T07:34:36.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 Processor -- start 2024-03-07T07:34:36.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- start start 2024-03-07T07:34:36.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc006a20 0x7f78e8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e81402a0 0x7f78e8155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e806e330 0x7f78e806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80b5030 con 0x7f78e81402a0 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e8072380 con 0x7f78cc006a20 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78ede00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e8135d80 con 0x7f78e806e330 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78de000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e81402a0 0x7f78e8155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78de000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e81402a0 0x7f78e8155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33886/0 (socket says 172.21.15.84:33886) 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.270+0000 7f78de000640 1 -- 172.21.15.84:0/782950426 learned_addr learned my addr 172.21.15.84:0/782950426 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78e6a00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc006a20 0x7f78e8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78e7400640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e806e330 0x7f78e806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78de000640 1 -- 172.21.15.84:0/782950426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e806e330 msgr2=0x7f78e806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78de000640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e806e330 0x7f78e806e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78de000640 1 -- 172.21.15.84:0/782950426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc006a20 msgr2=0x7f78e8159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78de000640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc006a20 0x7f78e8159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78de000640 1 -- 172.21.15.84:0/782950426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e81362b0 con 0x7f78e81402a0 2024-03-07T07:34:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78de000640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e81402a0 0x7f78e8155820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f78d001f850 tx=0x7f78cc007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78dfe00640 1 -- 172.21.15.84:0/782950426 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0001b90 con 0x7f78e81402a0 2024-03-07T07:34:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78dfe00640 1 -- 172.21.15.84:0/782950426 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d00bc030 con 0x7f78e81402a0 2024-03-07T07:34:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78dfe00640 1 -- 172.21.15.84:0/782950426 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d00ad6a0 con 0x7f78e81402a0 2024-03-07T07:34:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e8159680 con 0x7f78e81402a0 2024-03-07T07:34:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e8135fd0 con 0x7f78e81402a0 2024-03-07T07:34:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e8156e90 con 0x7f78e81402a0 2024-03-07T07:34:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78dfe00640 1 -- 172.21.15.84:0/782950426 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f78d00ad840 con 0x7f78e81402a0 2024-03-07T07:34:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78dfe00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f78c4066f90 0x7f78c4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78dfe00640 1 -- 172.21.15.84:0/782950426 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f78d0123360 con 0x7f78e81402a0 2024-03-07T07:34:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.274+0000 7f78e6a00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f78c4066f90 0x7f78c4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.278+0000 7f78e6a00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f78c4066f90 0x7f78c4069450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009b20 tx=0x7f78d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.278+0000 7f78dfe00640 1 -- 172.21.15.84:0/782950426 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f78e8071f80 con 0x7f78e81402a0 2024-03-07T07:34:36.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:36.438+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f78e8062d40 con 0x7f78e81402a0 2024-03-07T07:34:37.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.062+0000 7f78dfe00640 1 -- 172.21.15.84:0/782950426 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f78d00f4290 con 0x7f78e81402a0 2024-03-07T07:34:37.063 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2024-03-07T07:34:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f78c4066f90 msgr2=0x7f78c4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f78c4066f90 0x7f78c4069450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009b20 tx=0x7f78d8008040 comp rx=0 tx=0).stop 2024-03-07T07:34:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e81402a0 msgr2=0x7f78e8155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e81402a0 0x7f78e8155820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f78d001f850 tx=0x7f78cc007a50 comp rx=0 tx=0).stop 2024-03-07T07:34:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 shutdown_connections 2024-03-07T07:34:37.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f78c4066f90 0x7f78c4069450 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e806e330 0x7f78e806e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e81402a0 0x7f78e8155820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 --2- 172.21.15.84:0/782950426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78cc006a20 0x7f78e8159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 >> 172.21.15.84:0/782950426 conn(0x7f78e80cc840 msgr2=0x7f78e815ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:37.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 shutdown_connections 2024-03-07T07:34:37.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.066+0000 7f78ede00640 1 -- 172.21.15.84:0/782950426 wait complete. 2024-03-07T07:34:37.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-07T07:34:37.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8f600640 1 Processor -- start 2024-03-07T07:34:37.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8f600640 1 -- start start 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8f600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c8806d3f0 0x7f3c8806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8f600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c88071af0 0x7f3c88071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8f600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8806dd10 con 0x7f3c8806f660 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8f600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c880cf1d0 con 0x7f3c88071af0 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8f600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c880af2f0 con 0x7f3c8806d3f0 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8d600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c88071af0 0x7f3c88071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c87e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3c8806f660 0x7f3c88145320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57412/0 (socket says 172.21.15.84:57412) 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c87e00640 1 -- 172.21.15.84:0/1340985773 learned_addr learned my addr 172.21.15.84:0/1340985773 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.238+0000 7f3c8cc00640 1 --2- 172.21.15.84:0/1340985773 >> v2:172.21.15.161:3300/0 conn(0x7f3c8806d3f0 0x7f3c8806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8d600640 1 -- 172.21.15.84:0/1340985773 >> v2:172.21.15.161:3300/0 conn(0x7f3c8806d3f0 msgr2=0x7f3c8806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8d600640 1 --2- 172.21.15.84:0/1340985773 >> v2:172.21.15.161:3300/0 conn(0x7f3c8806d3f0 0x7f3c8806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8d600640 1 -- 172.21.15.84:0/1340985773 >> v1:172.21.15.84:6789/0 conn(0x7f3c8806f660 legacy=0x7f3c88145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8d600640 1 -- 172.21.15.84:0/1340985773 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c88145a30 con 0x7f3c88071af0 2024-03-07T07:34:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8cc00640 1 --2- 172.21.15.84:0/1340985773 >> v2:172.21.15.161:3300/0 conn(0x7f3c8806d3f0 0x7f3c8806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c87400640 1 -- 172.21.15.84:0/1340985773 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559702320 0 0) 0x7f3c8806dd10 con 0x7f3c8806f660 2024-03-07T07:34:37.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8d600640 1 --2- 172.21.15.84:0/1340985773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c88071f40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3c8806d3c0 tx=0x7f3c8001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7090c89f208516ab server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:37.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c87400640 1 -- 172.21.15.84:0/1340985773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800b2070 con 0x7f3c88071af0 2024-03-07T07:34:37.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c87400640 1 -- 172.21.15.84:0/1340985773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800a58e0 con 0x7f3c88071af0 2024-03-07T07:34:37.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c87400640 1 -- 172.21.15.84:0/1340985773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800a5cb0 con 0x7f3c88071af0 2024-03-07T07:34:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8f600640 1 -- 172.21.15.84:0/1340985773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 msgr2=0x7f3c88071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8f600640 1 --2- 172.21.15.84:0/1340985773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c88071f40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3c8806d3c0 tx=0x7f3c8001c930 comp rx=0 tx=0).stop 2024-03-07T07:34:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8f600640 1 -- 172.21.15.84:0/1340985773 shutdown_connections 2024-03-07T07:34:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8f600640 1 --2- 172.21.15.84:0/1340985773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c88071f40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8f600640 1 --2- 172.21.15.84:0/1340985773 >> v2:172.21.15.161:3300/0 conn(0x7f3c8806d3f0 0x7f3c8806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8f600640 1 -- 172.21.15.84:0/1340985773 >> 172.21.15.84:0/1340985773 conn(0x7f3c880cc840 msgr2=0x7f3c880ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8f600640 1 -- 172.21.15.84:0/1340985773 shutdown_connections 2024-03-07T07:34:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.242+0000 7f3c8f600640 1 -- 172.21.15.84:0/1340985773 wait complete. 2024-03-07T07:34:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 Processor -- start 2024-03-07T07:34:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 -- start start 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c8806d3f0 0x7f3c8813dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c8813c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c8813ff80 0x7f3c88140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88144ff0 con 0x7f3c88071af0 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88168e90 con 0x7f3c8806d3f0 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8813cd20 con 0x7f3c8813ff80 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c8813c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c8813c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33894/0 (socket says 172.21.15.84:33894) 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 -- 172.21.15.84:0/197419361 learned_addr learned my addr 172.21.15.84:0/197419361 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8cc00640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c8806d3f0 0x7f3c8813dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8d600640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c8813ff80 0x7f3c88140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 -- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c8813ff80 msgr2=0x7f3c88140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c8813ff80 0x7f3c88140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 -- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c8806d3f0 msgr2=0x7f3c8813dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c8806d3f0 0x7f3c8813dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 -- 172.21.15.84:0/197419361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8813d000 con 0x7f3c88071af0 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8cc00640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c8806d3f0 0x7f3c8813dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c87e00640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c8813c440 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400c480 tx=0x7f3c7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c84c00640 1 -- 172.21.15.84:0/197419361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74018070 con 0x7f3c88071af0 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c84c00640 1 -- 172.21.15.84:0/197419361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c74007500 con 0x7f3c88071af0 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c84c00640 1 -- 172.21.15.84:0/197419361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74004a30 con 0x7f3c88071af0 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8813d2e0 con 0x7f3c88071af0 2024-03-07T07:34:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.246+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c880adf20 con 0x7f3c88071af0 2024-03-07T07:34:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.250+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c88062d40 con 0x7f3c88071af0 2024-03-07T07:34:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.250+0000 7f3c84c00640 1 -- 172.21.15.84:0/197419361 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f3c7401b070 con 0x7f3c88071af0 2024-03-07T07:34:37.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.250+0000 7f3c84c00640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3c68066f60 0x7f3c68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:37.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.250+0000 7f3c84c00640 1 -- 172.21.15.84:0/197419361 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f3c740842f0 con 0x7f3c88071af0 2024-03-07T07:34:37.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.250+0000 7f3c8cc00640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3c68066f60 0x7f3c68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:37.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.250+0000 7f3c8cc00640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3c68066f60 0x7f3c68069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800b990 tx=0x7f3c78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.254+0000 7f3c84c00640 1 -- 172.21.15.84:0/197419361 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f3c740553d0 con 0x7f3c88071af0 2024-03-07T07:34:37.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:37.406+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c88071590 con 0x7f3c88071af0 2024-03-07T07:34:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.062+0000 7f3c84c00640 1 -- 172.21.15.84:0/197419361 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3c74054cd0 con 0x7f3c88071af0 2024-03-07T07:34:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2024-03-07T07:34:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3c68066f60 msgr2=0x7f3c68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3c68066f60 0x7f3c68069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800b990 tx=0x7f3c78008040 comp rx=0 tx=0).stop 2024-03-07T07:34:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 msgr2=0x7f3c8813c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c8813c440 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400c480 tx=0x7f3c7400c940 comp rx=0 tx=0).stop 2024-03-07T07:34:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 shutdown_connections 2024-03-07T07:34:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f3c68066f60 0x7f3c68069420 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c8813ff80 0x7f3c88140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c88071af0 0x7f3c8813c440 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 --2- 172.21.15.84:0/197419361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c8806d3f0 0x7f3c8813dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 >> 172.21.15.84:0/197419361 conn(0x7f3c880cc840 msgr2=0x7f3c8815b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 shutdown_connections 2024-03-07T07:34:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.066+0000 7f3c8f600640 1 -- 172.21.15.84:0/197419361 wait complete. 2024-03-07T07:34:38.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-07T07:34:38.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a48a00640 1 Processor -- start 2024-03-07T07:34:38.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a48a00640 1 -- start start 2024-03-07T07:34:38.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a48a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415eff0 0x7f2a44143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a48a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440b33f0 con 0x7f2a440cf610 2024-03-07T07:34:38.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a48a00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440b36d0 con 0x7f2a4415ec10 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a48a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b39b0 con 0x7f2a4415eff0 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a43200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2a440cf610 0x7f2a4406d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57420/0 (socket says 172.21.15.84:57420) 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a43200640 1 -- 172.21.15.84:0/295240644 learned_addr learned my addr 172.21.15.84:0/295240644 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a39e00640 1 --2- 172.21.15.84:0/295240644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415eff0 0x7f2a44143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a41e00640 1 -- 172.21.15.84:0/295240644 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716457378 0 0) 0x7f2a440b33f0 con 0x7f2a440cf610 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a41e00640 1 -- 172.21.15.84:0/295240644 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a28003530 con 0x7f2a440cf610 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a41e00640 1 -- 172.21.15.84:0/295240644 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604500145 0 0) 0x7f2a440b36d0 con 0x7f2a4415ec10 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a39e00640 1 -- 172.21.15.84:0/295240644 >> v1:172.21.15.161:6789/0 conn(0x7f2a4415ec10 legacy=0x7f2a441433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a39e00640 1 -- 172.21.15.84:0/295240644 >> v1:172.21.15.84:6789/0 conn(0x7f2a440cf610 legacy=0x7f2a4406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.238+0000 7f2a39e00640 1 -- 172.21.15.84:0/295240644 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440b3c90 con 0x7f2a4415eff0 2024-03-07T07:34:38.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a39e00640 1 --2- 172.21.15.84:0/295240644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415eff0 0x7f2a44143ae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097f0 tx=0x7f2a2c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2333c817ac5c84b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:38.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a41e00640 1 -- 172.21.15.84:0/295240644 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0ab5f0 con 0x7f2a4415eff0 2024-03-07T07:34:38.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a41e00640 1 -- 172.21.15.84:0/295240644 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0b0070 con 0x7f2a4415eff0 2024-03-07T07:34:38.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a41e00640 1 -- 172.21.15.84:0/295240644 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0ab9b0 con 0x7f2a4415eff0 2024-03-07T07:34:38.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a48a00640 1 -- 172.21.15.84:0/295240644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415eff0 msgr2=0x7f2a44143ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a48a00640 1 --2- 172.21.15.84:0/295240644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415eff0 0x7f2a44143ae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097f0 tx=0x7f2a2c01c4e0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a48a00640 1 -- 172.21.15.84:0/295240644 shutdown_connections 2024-03-07T07:34:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a48a00640 1 --2- 172.21.15.84:0/295240644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415eff0 0x7f2a44143ae0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a48a00640 1 -- 172.21.15.84:0/295240644 >> 172.21.15.84:0/295240644 conn(0x7f2a440b1d80 msgr2=0x7f2a440b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a48a00640 1 -- 172.21.15.84:0/295240644 shutdown_connections 2024-03-07T07:34:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.242+0000 7f2a48a00640 1 -- 172.21.15.84:0/295240644 wait complete. 2024-03-07T07:34:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 Processor -- start 2024-03-07T07:34:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 -- start start 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440cf610 0x7f2a44142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415ec10 0x7f2a44159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a4415eff0 0x7f2a4413c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44168ee0 con 0x7f2a4415eff0 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44168d60 con 0x7f2a440cf610 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44169060 con 0x7f2a4415ec10 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a4415eff0 0x7f2a4413c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a4415eff0 0x7f2a4413c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33904/0 (socket says 172.21.15.84:33904) 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 -- 172.21.15.84:0/3179917773 learned_addr learned my addr 172.21.15.84:0/3179917773 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a42800640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440cf610 0x7f2a44142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a39e00640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415ec10 0x7f2a44159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 -- 172.21.15.84:0/3179917773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415ec10 msgr2=0x7f2a44159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415ec10 0x7f2a44159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 -- 172.21.15.84:0/3179917773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440cf610 msgr2=0x7f2a44142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440cf610 0x7f2a44142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 -- 172.21.15.84:0/3179917773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4413b0f0 con 0x7f2a4415eff0 2024-03-07T07:34:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a43200640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a4415eff0 0x7f2a4413c050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00caa0 tx=0x7f2a3c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a3b400640 1 -- 172.21.15.84:0/3179917773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c017070 con 0x7f2a4415eff0 2024-03-07T07:34:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a3b400640 1 -- 172.21.15.84:0/3179917773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c00ac00 con 0x7f2a4415eff0 2024-03-07T07:34:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a3b400640 1 -- 172.21.15.84:0/3179917773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c012400 con 0x7f2a4415eff0 2024-03-07T07:34:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4413a050 con 0x7f2a4415eff0 2024-03-07T07:34:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.246+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4413a610 con 0x7f2a4415eff0 2024-03-07T07:34:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.250+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44067d30 con 0x7f2a4415eff0 2024-03-07T07:34:38.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.250+0000 7f2a3b400640 1 -- 172.21.15.84:0/3179917773 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f2a3c01a070 con 0x7f2a4415eff0 2024-03-07T07:34:38.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.250+0000 7f2a3b400640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2a20066f60 0x7f2a20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.250+0000 7f2a3b400640 1 -- 172.21.15.84:0/3179917773 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2a3c084a40 con 0x7f2a4415eff0 2024-03-07T07:34:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.250+0000 7f2a42800640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2a20066f60 0x7f2a20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.250+0000 7f2a42800640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2a20066f60 0x7f2a20069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000f70 tx=0x7f2a34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:38.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.254+0000 7f2a3b400640 1 -- 172.21.15.84:0/3179917773 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f2a3c0556f0 con 0x7f2a4415eff0 2024-03-07T07:34:38.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.414+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2a44144400 con 0x7f2a4415eff0 2024-03-07T07:34:38.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.418+0000 7f2a3b400640 1 -- 172.21.15.84:0/3179917773 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2a3c059790 con 0x7f2a4415eff0 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2a20066f60 msgr2=0x7f2a20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2a20066f60 0x7f2a20069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000f70 tx=0x7f2a34009040 comp rx=0 tx=0).stop 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a4415eff0 msgr2=0x7f2a4413c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a4415eff0 0x7f2a4413c050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00caa0 tx=0x7f2a3c00cf60 comp rx=0 tx=0).stop 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 shutdown_connections 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2a20066f60 0x7f2a20069420 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a4415eff0 0x7f2a4413c050 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a4415ec10 0x7f2a44159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 --2- 172.21.15.84:0/3179917773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a440cf610 0x7f2a44142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 >> 172.21.15.84:0/3179917773 conn(0x7f2a440b1d80 msgr2=0x7f2a4413ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 shutdown_connections 2024-03-07T07:34:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.422+0000 7f2a48a00640 1 -- 172.21.15.84:0/3179917773 wait complete. 2024-03-07T07:34:38.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-03-07T07:34:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.574+0000 7f2082c00640 1 Processor -- start 2024-03-07T07:34:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.574+0000 7f2082c00640 1 -- start start 2024-03-07T07:34:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f2082c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f207c145a30 0x7f207c0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f2082c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c0a9540 0x7f207c072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f2082c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207c06d780 con 0x7f207c06d230 2024-03-07T07:34:38.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f2082c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207c06da60 con 0x7f207c145a30 2024-03-07T07:34:38.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f2082c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c06dd40 con 0x7f207c0a9540 2024-03-07T07:34:38.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f207be00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f207c145a30 0x7f207c0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f207b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c0a9540 0x7f207c072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f2080c00640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f207c06d230 0x7f207c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:56076/0 (socket says 172.21.15.84:56076) 2024-03-07T07:34:38.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f207b400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c0a9540 0x7f207c072f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:34780/0 (socket says 172.21.15.84:34780) 2024-03-07T07:34:38.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f2080c00640 1 -- 172.21.15.84:0/845919120 learned_addr learned my addr 172.21.15.84:0/845919120 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f207aa00640 1 -- 172.21.15.84:0/845919120 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495082985 0 0) 0x7f207c06d780 con 0x7f207c06d230 2024-03-07T07:34:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f207b400640 1 -- 172.21.15.84:0/845919120 >> v2:172.21.15.161:3300/0 conn(0x7f207c145a30 msgr2=0x7f207c0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f207b400640 1 --2- 172.21.15.84:0/845919120 >> v2:172.21.15.161:3300/0 conn(0x7f207c145a30 0x7f207c0729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f207b400640 1 -- 172.21.15.84:0/845919120 >> v1:172.21.15.161:6789/0 conn(0x7f207c06d230 legacy=0x7f207c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.578+0000 7f207b400640 1 -- 172.21.15.84:0/845919120 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c06e020 con 0x7f207c0a9540 2024-03-07T07:34:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f207b400640 1 --2- 172.21.15.84:0/845919120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c0a9540 0x7f207c072f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f20680097c0 tx=0x7f206801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d550df640bb42a34 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f207aa00640 1 -- 172.21.15.84:0/845919120 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20680b0070 con 0x7f207c0a9540 2024-03-07T07:34:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f207aa00640 1 -- 172.21.15.84:0/845919120 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20680ab600 con 0x7f207c0a9540 2024-03-07T07:34:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f207aa00640 1 -- 172.21.15.84:0/845919120 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20680ab9d0 con 0x7f207c0a9540 2024-03-07T07:34:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 -- 172.21.15.84:0/845919120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c0a9540 msgr2=0x7f207c072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 --2- 172.21.15.84:0/845919120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c0a9540 0x7f207c072f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f20680097c0 tx=0x7f206801c380 comp rx=0 tx=0).stop 2024-03-07T07:34:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 -- 172.21.15.84:0/845919120 shutdown_connections 2024-03-07T07:34:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 --2- 172.21.15.84:0/845919120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c0a9540 0x7f207c072f10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 --2- 172.21.15.84:0/845919120 >> v2:172.21.15.161:3300/0 conn(0x7f207c145a30 0x7f207c0729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 -- 172.21.15.84:0/845919120 >> 172.21.15.84:0/845919120 conn(0x7f207c0704b0 msgr2=0x7f207c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 -- 172.21.15.84:0/845919120 shutdown_connections 2024-03-07T07:34:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 -- 172.21.15.84:0/845919120 wait complete. 2024-03-07T07:34:38.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 Processor -- start 2024-03-07T07:34:38.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.582+0000 7f2082c00640 1 -- start start 2024-03-07T07:34:38.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207c06d230 0x7f207c158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f207c145a30 0x7f207c13b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c165280 0x7f207c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c168d60 con 0x7f207c06d230 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c168be0 con 0x7f207c145a30 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c168ee0 con 0x7f207c165280 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207c06d230 0x7f207c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207c06d230 0x7f207c158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33914/0 (socket says 172.21.15.84:33914) 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 -- 172.21.15.84:0/4134967502 learned_addr learned my addr 172.21.15.84:0/4134967502 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207b400640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f207c145a30 0x7f207c13b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2080c00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c165280 0x7f207c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 -- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c165280 msgr2=0x7f207c0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c165280 0x7f207c0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 -- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f207c145a30 msgr2=0x7f207c13b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:38.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f207c145a30 0x7f207c13b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:38.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 -- 172.21.15.84:0/4134967502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c13bc40 con 0x7f207c06d230 2024-03-07T07:34:38.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207b400640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f207c145a30 0x7f207c13b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:38.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2080c00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c165280 0x7f207c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:38.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f207be00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207c06d230 0x7f207c158030 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f206c00e8a0 tx=0x7f206c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2073e00640 1 -- 172.21.15.84:0/4134967502 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c017070 con 0x7f207c06d230 2024-03-07T07:34:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2073e00640 1 -- 172.21.15.84:0/4134967502 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c00c940 con 0x7f207c06d230 2024-03-07T07:34:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2073e00640 1 -- 172.21.15.84:0/4134967502 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c00ccf0 con 0x7f207c06d230 2024-03-07T07:34:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c154f20 con 0x7f207c06d230 2024-03-07T07:34:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207c1551c0 con 0x7f207c06d230 2024-03-07T07:34:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c062d40 con 0x7f207c06d230 2024-03-07T07:34:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.586+0000 7f2073e00640 1 -- 172.21.15.84:0/4134967502 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f206c01a070 con 0x7f207c06d230 2024-03-07T07:34:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.590+0000 7f2073e00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f205c066f90 0x7f205c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.590+0000 7f2073e00640 1 -- 172.21.15.84:0/4134967502 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f206c084c30 con 0x7f207c06d230 2024-03-07T07:34:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.590+0000 7f207b400640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f205c066f90 0x7f205c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.590+0000 7f207b400640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f205c066f90 0x7f205c069450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20680ad000 tx=0x7f2068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.594+0000 7f2073e00640 1 -- 172.21.15.84:0/4134967502 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f206c055ea0 con 0x7f207c06d230 2024-03-07T07:34:38.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:38.802+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7f207c0cd870 con 0x7f207c06d230 2024-03-07T07:34:39.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2073e00640 1 -- 172.21.15.84:0/4134967502 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v167) v1 ==== 120+0+0 (secure 0 0 0) 0x7f206c0557a0 con 0x7f207c06d230 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f205c066f90 msgr2=0x7f205c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f205c066f90 0x7f205c069450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20680ad000 tx=0x7f2068008040 comp rx=0 tx=0).stop 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207c06d230 msgr2=0x7f207c158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207c06d230 0x7f207c158030 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f206c00e8a0 tx=0x7f206c00eca0 comp rx=0 tx=0).stop 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 shutdown_connections 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f205c066f90 0x7f205c069450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f207c165280 0x7f207c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f207c145a30 0x7f207c13b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 --2- 172.21.15.84:0/4134967502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207c06d230 0x7f207c158030 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:39.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 >> 172.21.15.84:0/4134967502 conn(0x7f207c0704b0 msgr2=0x7f207c13bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:39.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 shutdown_connections 2024-03-07T07:34:39.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:39.074+0000 7f2082c00640 1 -- 172.21.15.84:0/4134967502 wait complete. 2024-03-07T07:34:39.098 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... FAIL 2024-03-07T07:34:39.098 INFO:tasks.cephfs_test_runner: 2024-03-07T07:34:39.098 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-07T07:34:39.098 INFO:tasks.cephfs_test_runner:FAIL: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-03-07T07:34:39.098 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/cephfs/test_acls.py", line 37, in test_acls 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner: 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner:Ran 1 test in 173.716s 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner: 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner: 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-07T07:34:39.099 INFO:tasks.cephfs_test_runner:FAIL: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-03-07T07:34:39.100 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-07T07:34:39.100 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-07T07:34:39.100 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/cephfs/test_acls.py", line 37, in test_acls 2024-03-07T07:34:39.100 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2024-03-07T07:34:39.100 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2024-03-07T07:34:39.100 INFO:tasks.cephfs_test_runner: 2024-03-07T07:34:39.100 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-03-07T07:34:39.350 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=da4744cf63fc40898bb458f696d7365d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-03-07T07:34:39.352 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-07T07:34:39.362 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-07T07:34:39.375 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-07T07:34:39.375 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:34:39.375 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:39.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354604k,nr_inodes=4088651,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1097 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-07T07:34:39.389 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-07T07:34:39.390 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:39.437 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354604k,nr_inodes=4088651,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1097 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-07T07:34:39.438 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:34:39.438 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:39.448 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354612k,nr_inodes=4088653,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1434 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-07T07:34:39.448 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-03-07T07:34:39.448 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T07:34:39.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354612k,nr_inodes=4088653,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1434 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-07T07:34:39.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:39.499 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-03-07T07:34:39.508 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-07T07:34:39.508 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-07T07:34:39.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:39.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-07T07:34:39.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:39.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-07T07:34:39.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:39.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-03-07T07:34:39.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:39.844 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-03-07T07:34:39.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:39.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-03-07T07:34:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2024-03-07T07:34:39.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:34:39.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:39.925 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-03-07T07:34:39.934 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-07T07:34:39.934 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-07T07:34:39.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:39.935 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-07T07:34:40.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:40.006 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-07T07:34:40.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:40.079 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-03-07T07:34:40.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:40.253 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-03-07T07:34:40.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T07:34:40.262 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-03-07T07:34:40.332 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-03-07T07:34:40.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:34:40.334 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-07T07:34:40.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-07T07:34:40.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:34:40.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e9e200640 1 Processor -- start 2024-03-07T07:34:40.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e9e200640 1 -- start start 2024-03-07T07:34:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e9e200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6e980730e0 0x7f6e980cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e9e200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e98144360 0x7f6e9815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e9e200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980cc880 con 0x7f6e98143dd0 2024-03-07T07:34:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e9e200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e981441b0 con 0x7f6e98144360 2024-03-07T07:34:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e9e200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e980cf050 con 0x7f6e980730e0 2024-03-07T07:34:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e97400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6e98143dd0 0x7f6e980729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57430/0 (socket says 172.21.15.84:57430) 2024-03-07T07:34:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e97400640 1 -- 172.21.15.84:0/2628171901 learned_addr learned my addr 172.21.15.84:0/2628171901 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.478+0000 7f6e97e00640 1 --2- 172.21.15.84:0/2628171901 >> v2:172.21.15.84:3300/0 conn(0x7f6e98144360 0x7f6e9815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e8ea00640 1 --2- 172.21.15.84:0/2628171901 >> v2:172.21.15.161:3300/0 conn(0x7f6e980730e0 0x7f6e980cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e97e00640 1 -- 172.21.15.84:0/2628171901 >> v2:172.21.15.161:3300/0 conn(0x7f6e980730e0 msgr2=0x7f6e980cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e97e00640 1 --2- 172.21.15.84:0/2628171901 >> v2:172.21.15.161:3300/0 conn(0x7f6e980730e0 0x7f6e980cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e97e00640 1 -- 172.21.15.84:0/2628171901 >> v1:172.21.15.84:6789/0 conn(0x7f6e98143dd0 legacy=0x7f6e980729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e97e00640 1 -- 172.21.15.84:0/2628171901 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980ccb60 con 0x7f6e98144360 2024-03-07T07:34:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e97e00640 1 --2- 172.21.15.84:0/2628171901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e98144360 0x7f6e9815b410 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6e980cc090 tx=0x7f6e9001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf9dd22bc63347e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e96a00640 1 -- 172.21.15.84:0/2628171901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900ab680 con 0x7f6e98144360 2024-03-07T07:34:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e96a00640 1 -- 172.21.15.84:0/2628171901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900b0070 con 0x7f6e98144360 2024-03-07T07:34:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e96a00640 1 -- 172.21.15.84:0/2628171901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900aba40 con 0x7f6e98144360 2024-03-07T07:34:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e9e200640 1 -- 172.21.15.84:0/2628171901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e98144360 msgr2=0x7f6e9815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e9e200640 1 --2- 172.21.15.84:0/2628171901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e98144360 0x7f6e9815b410 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6e980cc090 tx=0x7f6e9001c460 comp rx=0 tx=0).stop 2024-03-07T07:34:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e9e200640 1 -- 172.21.15.84:0/2628171901 shutdown_connections 2024-03-07T07:34:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e9e200640 1 --2- 172.21.15.84:0/2628171901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e98144360 0x7f6e9815b410 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e9e200640 1 --2- 172.21.15.84:0/2628171901 >> v2:172.21.15.161:3300/0 conn(0x7f6e980730e0 0x7f6e980cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e9e200640 1 -- 172.21.15.84:0/2628171901 >> 172.21.15.84:0/2628171901 conn(0x7f6e980704b0 msgr2=0x7f6e980708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.482+0000 7f6e9e200640 1 -- 172.21.15.84:0/2628171901 shutdown_connections 2024-03-07T07:34:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 -- 172.21.15.84:0/2628171901 wait complete. 2024-03-07T07:34:40.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 Processor -- start 2024-03-07T07:34:40.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 -- start start 2024-03-07T07:34:40.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e980730e0 0x7f6e9813d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e98143dd0 0x7f6e9813df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e98144360 0x7f6e98159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98167960 con 0x7f6e980730e0 2024-03-07T07:34:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980cd6e0 con 0x7f6e98144360 2024-03-07T07:34:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98167ae0 con 0x7f6e98143dd0 2024-03-07T07:34:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e980730e0 0x7f6e9813d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e980730e0 0x7f6e9813d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33934/0 (socket says 172.21.15.84:33934) 2024-03-07T07:34:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 -- 172.21.15.84:0/1658334128 learned_addr learned my addr 172.21.15.84:0/1658334128 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e8ea00640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e98143dd0 0x7f6e9813df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97e00640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e98144360 0x7f6e98159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 -- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e98143dd0 msgr2=0x7f6e9813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e98143dd0 0x7f6e9813df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 -- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e98144360 msgr2=0x7f6e98159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e98144360 0x7f6e98159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 -- 172.21.15.84:0/1658334128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9813c5b0 con 0x7f6e980730e0 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97e00640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e98144360 0x7f6e98159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e97400640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e980730e0 0x7f6e9813d650 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c420 tx=0x7f6e8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e8fe00640 1 -- 172.21.15.84:0/1658334128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88017070 con 0x7f6e980730e0 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e8fe00640 1 -- 172.21.15.84:0/1658334128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88005cf0 con 0x7f6e980730e0 2024-03-07T07:34:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e8fe00640 1 -- 172.21.15.84:0/1658334128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880072f0 con 0x7f6e980730e0 2024-03-07T07:34:40.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9813c890 con 0x7f6e980730e0 2024-03-07T07:34:40.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.486+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9813ce50 con 0x7f6e980730e0 2024-03-07T07:34:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.490+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e98062d40 con 0x7f6e980730e0 2024-03-07T07:34:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.490+0000 7f6e8fe00640 1 -- 172.21.15.84:0/1658334128 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f6e8801a070 con 0x7f6e980730e0 2024-03-07T07:34:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.490+0000 7f6e8fe00640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e74066f60 0x7f6e74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.490+0000 7f6e8fe00640 1 -- 172.21.15.84:0/1658334128 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6e88083ff0 con 0x7f6e980730e0 2024-03-07T07:34:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.490+0000 7f6e8ea00640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e74066f60 0x7f6e74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.490+0000 7f6e8ea00640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e74066f60 0x7f6e74069420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6e980af410 tx=0x7f6e800098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:40.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.494+0000 7f6e8fe00640 1 -- 172.21.15.84:0/1658334128 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f6e88054ce0 con 0x7f6e980730e0 2024-03-07T07:34:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.646+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e98142f20 con 0x7f6e74066f60 2024-03-07T07:34:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.646+0000 7f6e8fe00640 1 -- 172.21.15.84:0/1658334128 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13417 (secure 0 0 0) 0x7f6e98142f20 con 0x7f6e74066f60 2024-03-07T07:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:34:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e74066f60 msgr2=0x7f6e74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e74066f60 0x7f6e74069420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6e980af410 tx=0x7f6e800098d0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e980730e0 msgr2=0x7f6e9813d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e980730e0 0x7f6e9813d650 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c420 tx=0x7f6e8800c8e0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 shutdown_connections 2024-03-07T07:34:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f6e74066f60 0x7f6e74069420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e98144360 0x7f6e98159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e98143dd0 0x7f6e9813df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 --2- 172.21.15.84:0/1658334128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e980730e0 0x7f6e9813d650 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 >> 172.21.15.84:0/1658334128 conn(0x7f6e980704b0 msgr2=0x7f6e980719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 shutdown_connections 2024-03-07T07:34:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.650+0000 7f6e9e200640 1 -- 172.21.15.84:0/1658334128 wait complete. 2024-03-07T07:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-03-07T07:34:38.919625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225808,"kb_used_data":5520,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748912,"statfs":{"total":773094113280,"available":772862885888,"internally_reserved":0,"allocated":5652480,"data_stored":3645904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-557650,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-123,"num_write_kb":-599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001250"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-03-07T07:32:54.997511+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:32:54.997511+0000","last_peered":"2024-03-07T07:32:54.997511+0000","last_clean":"2024-03-07T07:32:54.997511+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:32:54.997511+0000","last_undegraded":"2024-03-07T07:32:54.997511+0000","last_fullsized":"2024-03-07T07:32:54.997511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":165622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":413696,"data_stored":164880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":999424,"data_stored":750335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":159987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":159919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":999424,"data_stored":747146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":999424,"data_stored":750847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1003520,"data_stored":747168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:34:40.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:34:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2669200640 1 Processor -- start 2024-03-07T07:34:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2669200640 1 -- start start 2024-03-07T07:34:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2669200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f266415c1f0 0x7f26640b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2669200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640cf100 0x7f26640d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2669200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26640b0290 con 0x7f26640b3a00 2024-03-07T07:34:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2669200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26640b1d40 con 0x7f266415c1f0 2024-03-07T07:34:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2669200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26640b0570 con 0x7f26640cf100 2024-03-07T07:34:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2661e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f266415c1f0 0x7f26640b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2661e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f266415c1f0 0x7f26640b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33946/0 (socket says 172.21.15.84:33946) 2024-03-07T07:34:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2661e00640 1 -- 172.21.15.84:0/1165799915 learned_addr learned my addr 172.21.15.84:0/1165799915 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2659400640 1 --2- 172.21.15.84:0/1165799915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640cf100 0x7f26640d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2661e00640 1 -- 172.21.15.84:0/1165799915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640cf100 msgr2=0x7f26640d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2661e00640 1 --2- 172.21.15.84:0/1165799915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640cf100 0x7f26640d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2661e00640 1 -- 172.21.15.84:0/1165799915 >> v1:172.21.15.161:6789/0 conn(0x7f26640b3a00 legacy=0x7f266415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.806+0000 7f2661e00640 1 -- 172.21.15.84:0/1165799915 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26640b0850 con 0x7f266415c1f0 2024-03-07T07:34:40.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2661e00640 1 --2- 172.21.15.84:0/1165799915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415c1f0 0x7f26640b1330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2654009870 tx=0x7f265401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813311267a8bb70d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:40.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2661400640 1 -- 172.21.15.84:0/1165799915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540b0070 con 0x7f266415c1f0 2024-03-07T07:34:40.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2661400640 1 -- 172.21.15.84:0/1165799915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26540ab600 con 0x7f266415c1f0 2024-03-07T07:34:40.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2661400640 1 -- 172.21.15.84:0/1165799915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540ab9d0 con 0x7f266415c1f0 2024-03-07T07:34:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2669200640 1 -- 172.21.15.84:0/1165799915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415c1f0 msgr2=0x7f26640b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2669200640 1 --2- 172.21.15.84:0/1165799915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415c1f0 0x7f26640b1330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2654009870 tx=0x7f265401c4d0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2669200640 1 -- 172.21.15.84:0/1165799915 shutdown_connections 2024-03-07T07:34:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2669200640 1 --2- 172.21.15.84:0/1165799915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640cf100 0x7f26640d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2669200640 1 --2- 172.21.15.84:0/1165799915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415c1f0 0x7f26640b1330 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2669200640 1 -- 172.21.15.84:0/1165799915 >> 172.21.15.84:0/1165799915 conn(0x7f26640b1ed0 msgr2=0x7f26640b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2669200640 1 -- 172.21.15.84:0/1165799915 shutdown_connections 2024-03-07T07:34:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.810+0000 7f2669200640 1 -- 172.21.15.84:0/1165799915 wait complete. 2024-03-07T07:34:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 Processor -- start 2024-03-07T07:34:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 -- start start 2024-03-07T07:34:40.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640b3a00 0x7f266414d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26640cf100 0x7f266414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266415c1f0 0x7f26641506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664168e60 con 0x7f26640cf100 2024-03-07T07:34:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664168ce0 con 0x7f266415c1f0 2024-03-07T07:34:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2664168fe0 con 0x7f26640b3a00 2024-03-07T07:34:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26640cf100 0x7f266414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26640cf100 0x7f266414ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33954/0 (socket says 172.21.15.84:33954) 2024-03-07T07:34:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 -- 172.21.15.84:0/1787703103 learned_addr learned my addr 172.21.15.84:0/1787703103 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2661e00640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640b3a00 0x7f266414d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2662800640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266415c1f0 0x7f26641506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 -- 172.21.15.84:0/1787703103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640b3a00 msgr2=0x7f266414d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640b3a00 0x7f266414d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 -- 172.21.15.84:0/1787703103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266415c1f0 msgr2=0x7f26641506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266415c1f0 0x7f26641506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 -- 172.21.15.84:0/1787703103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2664154120 con 0x7f26640cf100 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2659400640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26640cf100 0x7f266414ca30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f264c00d800 tx=0x7f264c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f265aa00640 1 -- 172.21.15.84:0/1787703103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00b6c0 con 0x7f26640cf100 2024-03-07T07:34:40.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f265aa00640 1 -- 172.21.15.84:0/1787703103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c019070 con 0x7f26640cf100 2024-03-07T07:34:40.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f265aa00640 1 -- 172.21.15.84:0/1787703103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00bae0 con 0x7f26640cf100 2024-03-07T07:34:40.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2664154400 con 0x7f26640cf100 2024-03-07T07:34:40.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26641f7620 con 0x7f26640cf100 2024-03-07T07:34:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.814+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2664062d40 con 0x7f26640cf100 2024-03-07T07:34:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.818+0000 7f265aa00640 1 -- 172.21.15.84:0/1787703103 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f264c00bc80 con 0x7f26640cf100 2024-03-07T07:34:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.818+0000 7f265aa00640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2640066f60 0x7f2640069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.818+0000 7f265aa00640 1 -- 172.21.15.84:0/1787703103 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f264c085270 con 0x7f26640cf100 2024-03-07T07:34:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.818+0000 7f2661e00640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2640066f60 0x7f2640069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.818+0000 7f2661e00640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2640066f60 0x7f2640069420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f26540ad000 tx=0x7f26540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:40.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.822+0000 7f265aa00640 1 -- 172.21.15.84:0/1787703103 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f264c056570 con 0x7f26640cf100 2024-03-07T07:34:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.974+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f266414cf70 con 0x7f2640066f60 2024-03-07T07:34:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.974+0000 7f265aa00640 1 -- 172.21.15.84:0/1787703103 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13496 (secure 0 0 0) 0x7f26540ab500 con 0x7f2640066f60 2024-03-07T07:34:40.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:34:40.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2640066f60 msgr2=0x7f2640069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2640066f60 0x7f2640069420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f26540ad000 tx=0x7f26540a6000 comp rx=0 tx=0).stop 2024-03-07T07:34:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26640cf100 msgr2=0x7f266414ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26640cf100 0x7f266414ca30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f264c00d800 tx=0x7f264c00dcc0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 shutdown_connections 2024-03-07T07:34:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f2640066f60 0x7f2640069420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266415c1f0 0x7f26641506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26640cf100 0x7f266414ca30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 --2- 172.21.15.84:0/1787703103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26640b3a00 0x7f266414d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 >> 172.21.15.84:0/1787703103 conn(0x7f26640b1ed0 msgr2=0x7f2664071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 shutdown_connections 2024-03-07T07:34:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:40.978+0000 7f2669200640 1 -- 172.21.15.84:0/1787703103 wait complete. 2024-03-07T07:34:40.997 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-03-07T07:34:40.919890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":224928,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749792,"statfs":{"total":773094113280,"available":772863787008,"internally_reserved":0,"allocated":4694016,"data_stored":2580972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-592996,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-131,"num_write_kb":-637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001211"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-07T07:34:38.275871+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:34:38.275871+0000","last_peered":"2024-03-07T07:34:38.275871+0000","last_clean":"2024-03-07T07:34:38.275871+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:34:38.275871+0000","last_undegraded":"2024-03-07T07:34:38.275871+0000","last_fullsized":"2024-03-07T07:34:38.275871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":768214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":172213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542191,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":172213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542190,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":762581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":172213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:34:40.997 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-07T07:34:40.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:34:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22e6200640 1 Processor -- start 2024-03-07T07:34:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22e6200640 1 -- start start 2024-03-07T07:34:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22e6200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22e00729d0 0x7f22e0072db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22e6200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00cdf40 0x7f22e00ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22e6200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e00732f0 con 0x7f22e00ce8e0 2024-03-07T07:34:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22e6200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e006d550 con 0x7f22e00729d0 2024-03-07T07:34:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22e6200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00af440 con 0x7f22e00cdf40 2024-03-07T07:34:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22df400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22e00729d0 0x7f22e0072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22d6a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00cdf40 0x7f22e00ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22df400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22e00729d0 0x7f22e0072db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:56382/0 (socket says 172.21.15.84:56382) 2024-03-07T07:34:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22df400640 1 -- 172.21.15.84:0/3348086201 learned_addr learned my addr 172.21.15.84:0/3348086201 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22d6a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00cdf40 0x7f22e00ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:34818/0 (socket says 172.21.15.84:34818) 2024-03-07T07:34:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22dfe00640 1 --1- 172.21.15.84:0/3348086201 >> v1:172.21.15.161:6789/0 conn(0x7f22e00ce8e0 0x7f22e00ad850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:56088/0 (socket says 172.21.15.84:56088) 2024-03-07T07:34:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22d6a00640 1 -- 172.21.15.84:0/3348086201 >> v2:172.21.15.161:3300/0 conn(0x7f22e00729d0 msgr2=0x7f22e0072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22d6a00640 1 --2- 172.21.15.84:0/3348086201 >> v2:172.21.15.161:3300/0 conn(0x7f22e00729d0 0x7f22e0072db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22d6a00640 1 -- 172.21.15.84:0/3348086201 >> v1:172.21.15.161:6789/0 conn(0x7f22e00ce8e0 legacy=0x7f22e00ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22d6a00640 1 -- 172.21.15.84:0/3348086201 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e00af720 con 0x7f22e00cdf40 2024-03-07T07:34:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.134+0000 7f22df400640 1 --2- 172.21.15.84:0/3348086201 >> v2:172.21.15.161:3300/0 conn(0x7f22e00729d0 0x7f22e0072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T07:34:41.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22d6a00640 1 --2- 172.21.15.84:0/3348086201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00cdf40 0x7f22e00ce3a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22c80097c0 tx=0x7f22c801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ccf042d42fadcdb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:41.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22dea00640 1 -- 172.21.15.84:0/3348086201 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c80b5070 con 0x7f22e00cdf40 2024-03-07T07:34:41.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22dea00640 1 -- 172.21.15.84:0/3348086201 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c80a8990 con 0x7f22e00cdf40 2024-03-07T07:34:41.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22dea00640 1 -- 172.21.15.84:0/3348086201 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c80a8d60 con 0x7f22e00cdf40 2024-03-07T07:34:41.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22e6200640 1 -- 172.21.15.84:0/3348086201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00cdf40 msgr2=0x7f22e00ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22e6200640 1 --2- 172.21.15.84:0/3348086201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00cdf40 0x7f22e00ce3a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22c80097c0 tx=0x7f22c801ec90 comp rx=0 tx=0).stop 2024-03-07T07:34:41.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22e6200640 1 -- 172.21.15.84:0/3348086201 shutdown_connections 2024-03-07T07:34:41.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22e6200640 1 --2- 172.21.15.84:0/3348086201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00cdf40 0x7f22e00ce3a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22e6200640 1 --2- 172.21.15.84:0/3348086201 >> v2:172.21.15.161:3300/0 conn(0x7f22e00729d0 0x7f22e0072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22e6200640 1 -- 172.21.15.84:0/3348086201 >> 172.21.15.84:0/3348086201 conn(0x7f22e00704b0 msgr2=0x7f22e00708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22e6200640 1 -- 172.21.15.84:0/3348086201 shutdown_connections 2024-03-07T07:34:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.138+0000 7f22e6200640 1 -- 172.21.15.84:0/3348086201 wait complete. 2024-03-07T07:34:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 Processor -- start 2024-03-07T07:34:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 -- start start 2024-03-07T07:34:41.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00729d0 0x7f22e01f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e00cdf40 0x7f22e013f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22e00ce8e0 0x7f22e013f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00cda20 con 0x7f22e00ce8e0 2024-03-07T07:34:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00cd740 con 0x7f22e00cdf40 2024-03-07T07:34:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00aef70 con 0x7f22e00729d0 2024-03-07T07:34:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22e00ce8e0 0x7f22e013f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22e00ce8e0 0x7f22e013f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33964/0 (socket says 172.21.15.84:33964) 2024-03-07T07:34:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 -- 172.21.15.84:0/3384618730 learned_addr learned my addr 172.21.15.84:0/3384618730 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22df400640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00729d0 0x7f22e01f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22d6a00640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e00cdf40 0x7f22e013f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 -- 172.21.15.84:0/3384618730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00729d0 msgr2=0x7f22e01f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00729d0 0x7f22e01f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 -- 172.21.15.84:0/3384618730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e00cdf40 msgr2=0x7f22e013f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e00cdf40 0x7f22e013f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 -- 172.21.15.84:0/3384618730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e013fca0 con 0x7f22e00ce8e0 2024-03-07T07:34:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22dfe00640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22e00ce8e0 0x7f22e013f760 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f22d800c7d0 tx=0x7f22d800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22d7e00640 1 -- 172.21.15.84:0/3384618730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8017070 con 0x7f22e00ce8e0 2024-03-07T07:34:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22d7e00640 1 -- 172.21.15.84:0/3384618730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d800a5e0 con 0x7f22e00ce8e0 2024-03-07T07:34:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22d7e00640 1 -- 172.21.15.84:0/3384618730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d800a990 con 0x7f22e00ce8e0 2024-03-07T07:34:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e01e3550 con 0x7f22e00ce8e0 2024-03-07T07:34:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.142+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e01e3b10 con 0x7f22e00ce8e0 2024-03-07T07:34:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.146+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e0062d40 con 0x7f22e00ce8e0 2024-03-07T07:34:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.146+0000 7f22d7e00640 1 -- 172.21.15.84:0/3384618730 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f22d801a070 con 0x7f22e00ce8e0 2024-03-07T07:34:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.146+0000 7f22d7e00640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f22bc066f60 0x7f22bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.146+0000 7f22d7e00640 1 -- 172.21.15.84:0/3384618730 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f22d80842c0 con 0x7f22e00ce8e0 2024-03-07T07:34:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.146+0000 7f22df400640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f22bc066f60 0x7f22bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.146+0000 7f22df400640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f22bc066f60 0x7f22bc069420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006cb0 tx=0x7f22d0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.150+0000 7f22d7e00640 1 -- 172.21.15.84:0/3384618730 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f22d8054ee0 con 0x7f22e00ce8e0 2024-03-07T07:34:41.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.302+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22e006f070 con 0x7f22bc066f60 2024-03-07T07:34:41.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.302+0000 7f22d7e00640 1 -- 172.21.15.84:0/3384618730 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13496 (secure 0 0 0) 0x7f22e006f070 con 0x7f22bc066f60 2024-03-07T07:34:41.306 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:41.307 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:34:41.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f22bc066f60 msgr2=0x7f22bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f22bc066f60 0x7f22bc069420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006cb0 tx=0x7f22d0009240 comp rx=0 tx=0).stop 2024-03-07T07:34:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22e00ce8e0 msgr2=0x7f22e013f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22e00ce8e0 0x7f22e013f760 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f22d800c7d0 tx=0x7f22d800cc90 comp rx=0 tx=0).stop 2024-03-07T07:34:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 shutdown_connections 2024-03-07T07:34:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f22bc066f60 0x7f22bc069420 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22e00ce8e0 0x7f22e013f760 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e00cdf40 0x7f22e013f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 --2- 172.21.15.84:0/3384618730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22e00729d0 0x7f22e01f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 >> 172.21.15.84:0/3384618730 conn(0x7f22e00704b0 msgr2=0x7f22e00b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:41.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 shutdown_connections 2024-03-07T07:34:41.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.306+0000 7f22e6200640 1 -- 172.21.15.84:0/3384618730 wait complete. 2024-03-07T07:34:41.325 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-03-07T07:34:40.919890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":224928,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749792,"statfs":{"total":773094113280,"available":772863787008,"internally_reserved":0,"allocated":4694016,"data_stored":2580972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-592996,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-131,"num_write_kb":-637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001211"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-07T07:34:38.275871+0000","last_change":"2024-03-07T07:31:01.053917+0000","last_active":"2024-03-07T07:34:38.275871+0000","last_peered":"2024-03-07T07:34:38.275871+0000","last_clean":"2024-03-07T07:34:38.275871+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:34:38.275871+0000","last_undegraded":"2024-03-07T07:34:38.275871+0000","last_fullsized":"2024-03-07T07:34:38.275871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T07:30:59.458730+0000","last_clean_scrub_stamp":"2024-03-07T07:30:59.458730+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:45.149015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":768214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":172213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542191,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":172213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542190,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":762581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":172213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:34:41.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T07:34:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.458+0000 7ff764600640 1 Processor -- start 2024-03-07T07:34:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.458+0000 7ff764600640 1 -- start start 2024-03-07T07:34:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff764600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c143dd0 0x7ff75c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff764600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff75c144360 0x7ff75c0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff764600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c0cc880 con 0x7ff75c1448b0 2024-03-07T07:34:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff764600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75c1441b0 con 0x7ff75c144360 2024-03-07T07:34:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff764600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0cf050 con 0x7ff75c143dd0 2024-03-07T07:34:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff761200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff75c144360 0x7ff75c0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff762600640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff75c1448b0 0x7ff75c15b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57432/0 (socket says 172.21.15.84:57432) 2024-03-07T07:34:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff762600640 1 -- 172.21.15.84:0/176135218 learned_addr learned my addr 172.21.15.84:0/176135218 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:41.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff761200640 1 -- 172.21.15.84:0/176135218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c143dd0 msgr2=0x7ff75c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:41.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff761c00640 1 --2- 172.21.15.84:0/176135218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c143dd0 0x7ff75c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff761200640 1 --2- 172.21.15.84:0/176135218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c143dd0 0x7ff75c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff761200640 1 -- 172.21.15.84:0/176135218 >> v1:172.21.15.84:6789/0 conn(0x7ff75c1448b0 legacy=0x7ff75c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff761200640 1 -- 172.21.15.84:0/176135218 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c0ccb60 con 0x7ff75c144360 2024-03-07T07:34:41.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.462+0000 7ff761c00640 1 --2- 172.21.15.84:0/176135218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c143dd0 0x7ff75c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:41.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff761200640 1 --2- 172.21.15.84:0/176135218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c0729d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7480097f0 tx=0x7ff74801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291ad59a9d107b9f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:41.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff75be00640 1 -- 172.21.15.84:0/176135218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480aa5f0 con 0x7ff75c144360 2024-03-07T07:34:41.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff75be00640 1 -- 172.21.15.84:0/176135218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480af070 con 0x7ff75c144360 2024-03-07T07:34:41.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff75be00640 1 -- 172.21.15.84:0/176135218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480aa9b0 con 0x7ff75c144360 2024-03-07T07:34:41.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- 172.21.15.84:0/176135218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 msgr2=0x7ff75c0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 --2- 172.21.15.84:0/176135218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c0729d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7480097f0 tx=0x7ff74801c470 comp rx=0 tx=0).stop 2024-03-07T07:34:41.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- 172.21.15.84:0/176135218 shutdown_connections 2024-03-07T07:34:41.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 --2- 172.21.15.84:0/176135218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c0729d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 --2- 172.21.15.84:0/176135218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c143dd0 0x7ff75c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- 172.21.15.84:0/176135218 >> 172.21.15.84:0/176135218 conn(0x7ff75c0704b0 msgr2=0x7ff75c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:41.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- 172.21.15.84:0/176135218 shutdown_connections 2024-03-07T07:34:41.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- 172.21.15.84:0/176135218 wait complete. 2024-03-07T07:34:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 Processor -- start 2024-03-07T07:34:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- start start 2024-03-07T07:34:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff75c143dd0 0x7ff75c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c1448b0 0x7ff75c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0cd6e0 con 0x7ff75c144360 2024-03-07T07:34:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c073320 con 0x7ff75c143dd0 2024-03-07T07:34:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.466+0000 7ff764600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c15bf30 con 0x7ff75c1448b0 2024-03-07T07:34:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c13cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33976/0 (socket says 172.21.15.84:33976) 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 -- 172.21.15.84:0/791897068 learned_addr learned my addr 172.21.15.84:0/791897068 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761c00640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff75c143dd0 0x7ff75c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff762600640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c1448b0 0x7ff75c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 -- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c1448b0 msgr2=0x7ff75c1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c1448b0 0x7ff75c1379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 -- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff75c143dd0 msgr2=0x7ff75c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff75c143dd0 0x7ff75c15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 -- 172.21.15.84:0/791897068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c1599c0 con 0x7ff75c144360 2024-03-07T07:34:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761c00640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff75c143dd0 0x7ff75c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff761200640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c13cea0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff7480ac040 tx=0x7ff74801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff759600640 1 -- 172.21.15.84:0/791897068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480be610 con 0x7ff75c144360 2024-03-07T07:34:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff759600640 1 -- 172.21.15.84:0/791897068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480be7f0 con 0x7ff75c144360 2024-03-07T07:34:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff759600640 1 -- 172.21.15.84:0/791897068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480bebe0 con 0x7ff75c144360 2024-03-07T07:34:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c159ca0 con 0x7ff75c144360 2024-03-07T07:34:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c15a260 con 0x7ff75c144360 2024-03-07T07:34:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75c062d40 con 0x7ff75c144360 2024-03-07T07:34:41.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff759600640 1 -- 172.21.15.84:0/791897068 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7ff7480bc020 con 0x7ff75c144360 2024-03-07T07:34:41.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff759600640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff73c066f60 0x7ff73c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:41.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.470+0000 7ff759600640 1 -- 172.21.15.84:0/791897068 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff74811ef40 con 0x7ff75c144360 2024-03-07T07:34:41.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.474+0000 7ff761c00640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff73c066f60 0x7ff73c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:41.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.474+0000 7ff761c00640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff73c066f60 0x7ff73c069420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff75000e3d0 tx=0x7ff750007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:41.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.474+0000 7ff759600640 1 -- 172.21.15.84:0/791897068 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7ff7480c5030 con 0x7ff75c144360 2024-03-07T07:34:41.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.630+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff75c15b1f0 con 0x7ff75c144360 2024-03-07T07:34:41.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff759600640 1 -- 172.21.15.84:0/791897068 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12984 (secure 0 0 0) 0x7ff748016090 con 0x7ff75c144360 2024-03-07T07:34:41.634 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:41.634 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"9dc7a008-fd12-4491-ba8d-83bae22f3106","created":"2024-03-07T07:30:47.877510+0000","modified":"2024-03-07T07:34:38.063739+0000","last_up_change":"2024-03-07T07:30:59.458730+0000","last_in_change":"2024-03-07T07:30:50.382968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T07:30:59.018143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a241edfa-aa77-4f17-8c03-abda9be7e112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6805","nonce":3620020508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6809","nonce":3620020508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6815","nonce":3620020508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":3620020508},{"type":"v1","addr":"172.21.15.84:6813","nonce":3620020508}]},"public_addr":"172.21.15.84:6805/3620020508","cluster_addr":"172.21.15.84:6809/3620020508","heartbeat_back_addr":"172.21.15.84:6815/3620020508","heartbeat_front_addr":"172.21.15.84:6813/3620020508","state":["exists","up"]},{"osd":1,"uuid":"f4e8b5ab-439a-477e-b7a5-0f77dae4de3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6801","nonce":212168279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6804","nonce":212168279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6812","nonce":212168279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":212168279},{"type":"v1","addr":"172.21.15.84:6808","nonce":212168279}]},"public_addr":"172.21.15.84:6801/212168279","cluster_addr":"172.21.15.84:6804/212168279","heartbeat_back_addr":"172.21.15.84:6812/212168279","heartbeat_front_addr":"172.21.15.84:6808/212168279","state":["exists","up"]},{"osd":2,"uuid":"c790c1da-489e-476a-a998-7e83bc4ee96f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6825","nonce":3227098675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6827","nonce":3227098675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6831","nonce":3227098675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3227098675},{"type":"v1","addr":"172.21.15.84:6829","nonce":3227098675}]},"public_addr":"172.21.15.84:6825/3227098675","cluster_addr":"172.21.15.84:6827/3227098675","heartbeat_back_addr":"172.21.15.84:6831/3227098675","heartbeat_front_addr":"172.21.15.84:6829/3227098675","state":["exists","up"]},{"osd":3,"uuid":"46c04825-19bd-4290-87f0-16fc3aeb6ceb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6817","nonce":201863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6819","nonce":201863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6823","nonce":201863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":201863371},{"type":"v1","addr":"172.21.15.84:6821","nonce":201863371}]},"public_addr":"172.21.15.84:6817/201863371","cluster_addr":"172.21.15.84:6819/201863371","heartbeat_back_addr":"172.21.15.84:6823/201863371","heartbeat_front_addr":"172.21.15.84:6821/201863371","state":["exists","up"]},{"osd":4,"uuid":"fd96ef66-f151-4941-8c34-4aa04d767ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6801","nonce":2435467047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6803","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6805","nonce":2435467047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6814","nonce":2435467047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6807","nonce":2435467047},{"type":"v1","addr":"172.21.15.161:6809","nonce":2435467047}]},"public_addr":"172.21.15.161:6801/2435467047","cluster_addr":"172.21.15.161:6805/2435467047","heartbeat_back_addr":"172.21.15.161:6814/2435467047","heartbeat_front_addr":"172.21.15.161:6809/2435467047","state":["exists","up"]},{"osd":5,"uuid":"31a884c4-729a-4b25-9eb7-060cadb239d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6825","nonce":300876994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6827","nonce":300876994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6831","nonce":300876994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":300876994},{"type":"v1","addr":"172.21.15.161:6829","nonce":300876994}]},"public_addr":"172.21.15.161:6825/300876994","cluster_addr":"172.21.15.161:6827/300876994","heartbeat_back_addr":"172.21.15.161:6831/300876994","heartbeat_front_addr":"172.21.15.161:6829/300876994","state":["exists","up"]},{"osd":6,"uuid":"325129ea-266f-425a-8e3e-eb791cabf7e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6804","nonce":878445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6808","nonce":878445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6813","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6815","nonce":878445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":878445946},{"type":"v1","addr":"172.21.15.161:6812","nonce":878445946}]},"public_addr":"172.21.15.161:6804/878445946","cluster_addr":"172.21.15.161:6808/878445946","heartbeat_back_addr":"172.21.15.161:6815/878445946","heartbeat_front_addr":"172.21.15.161:6812/878445946","state":["exists","up"]},{"osd":7,"uuid":"87871f7e-b148-473f-b1d6-f1a7a5075e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6817","nonce":2319772910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6819","nonce":2319772910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6823","nonce":2319772910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2319772910},{"type":"v1","addr":"172.21.15.161:6821","nonce":2319772910}]},"public_addr":"172.21.15.161:6817/2319772910","cluster_addr":"172.21.15.161:6819/2319772910","heartbeat_back_addr":"172.21.15.161:6823/2319772910","heartbeat_front_addr":"172.21.15.161:6821/2319772910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.939362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.008496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.037998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.096057+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.873084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.995759+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:55.860162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T07:30:56.015287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6837/2828752085":"2024-03-08T07:34:35.054943+0000","172.21.15.84:6835/2828752085":"2024-03-08T07:34:35.054943+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T07:34:41.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff73c066f60 msgr2=0x7ff73c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff73c066f60 0x7ff73c069420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff75000e3d0 tx=0x7ff750007a10 comp rx=0 tx=0).stop 2024-03-07T07:34:41.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 msgr2=0x7ff75c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c13cea0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff7480ac040 tx=0x7ff74801acb0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 shutdown_connections 2024-03-07T07:34:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7ff73c066f60 0x7ff73c069420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff75c1448b0 0x7ff75c1379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff75c144360 0x7ff75c13cea0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 --2- 172.21.15.84:0/791897068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff75c143dd0 0x7ff75c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 >> 172.21.15.84:0/791897068 conn(0x7ff75c0704b0 msgr2=0x7ff75c0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 shutdown_connections 2024-03-07T07:34:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:41.634+0000 7ff764600640 1 -- 172.21.15.84:0/791897068 wait complete. 2024-03-07T07:34:41.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:34:41.702 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:34:42.656 INFO:tasks.ceph:Scrubbing osd.0 2024-03-07T07:34:42.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-07T07:34:42.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.798+0000 7f5785800640 1 Processor -- start 2024-03-07T07:34:42.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.798+0000 7f5785800640 1 -- start start 2024-03-07T07:34:42.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f5785800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f578006f660 0x7f5780145320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f5785800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57800ce8a0 con 0x7f578006d3f0 2024-03-07T07:34:42.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f5785800640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57800ceb80 con 0x7f5780145860 2024-03-07T07:34:42.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f5785800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57800cf1d0 con 0x7f578006f660 2024-03-07T07:34:42.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f5776000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f578006f660 0x7f5780145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f577ea00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f578006d3f0 0x7f578006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46150/0 (socket says 172.21.15.84:46150) 2024-03-07T07:34:42.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f577ea00640 1 -- 172.21.15.84:0/3091948894 learned_addr learned my addr 172.21.15.84:0/3091948894 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:42.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f5776000640 1 -- 172.21.15.84:0/3091948894 >> v1:172.21.15.161:6789/0 conn(0x7f5780145860 legacy=0x7f5780071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f5776000640 1 -- 172.21.15.84:0/3091948894 >> v1:172.21.15.84:6789/0 conn(0x7f578006d3f0 legacy=0x7f578006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.802+0000 7f5776000640 1 -- 172.21.15.84:0/3091948894 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800cee60 con 0x7f578006f660 2024-03-07T07:34:42.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5776000640 1 --2- 172.21.15.84:0/3091948894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f578006f660 0x7f5780145320 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f57680097c0 tx=0x7f576801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83afea5095c33f64 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:42.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f577e000640 1 -- 172.21.15.84:0/3091948894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680b0070 con 0x7f578006f660 2024-03-07T07:34:42.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f577e000640 1 -- 172.21.15.84:0/3091948894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57680ab600 con 0x7f578006f660 2024-03-07T07:34:42.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f577e000640 1 -- 172.21.15.84:0/3091948894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680ab9d0 con 0x7f578006f660 2024-03-07T07:34:42.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 -- 172.21.15.84:0/3091948894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f578006f660 msgr2=0x7f5780145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 --2- 172.21.15.84:0/3091948894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f578006f660 0x7f5780145320 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f57680097c0 tx=0x7f576801c4a0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 -- 172.21.15.84:0/3091948894 shutdown_connections 2024-03-07T07:34:42.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 --2- 172.21.15.84:0/3091948894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f578006f660 0x7f5780145320 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 -- 172.21.15.84:0/3091948894 >> 172.21.15.84:0/3091948894 conn(0x7f57800cc840 msgr2=0x7f57800ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:42.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 -- 172.21.15.84:0/3091948894 shutdown_connections 2024-03-07T07:34:42.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 -- 172.21.15.84:0/3091948894 wait complete. 2024-03-07T07:34:42.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 Processor -- start 2024-03-07T07:34:42.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.806+0000 7f5785800640 1 -- start start 2024-03-07T07:34:42.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578006d3f0 0x7f578015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5780145860 0x7f57800c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57800c7a40 0x7f57800b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5780169ea0 con 0x7f5780145860 2024-03-07T07:34:42.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5780072ce0 con 0x7f578006d3f0 2024-03-07T07:34:42.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578016a020 con 0x7f57800c7a40 2024-03-07T07:34:42.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5780145860 0x7f57800c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5780145860 0x7f57800c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40210/0 (socket says 172.21.15.84:40210) 2024-03-07T07:34:42.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 -- 172.21.15.84:0/417004340 learned_addr learned my addr 172.21.15.84:0/417004340 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:42.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f577ea00640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578006d3f0 0x7f578015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f577f400640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57800c7a40 0x7f57800b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 -- 172.21.15.84:0/417004340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57800c7a40 msgr2=0x7f57800b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57800c7a40 0x7f57800b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 -- 172.21.15.84:0/417004340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578006d3f0 msgr2=0x7f578015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578006d3f0 0x7f578015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 -- 172.21.15.84:0/417004340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578015d910 con 0x7f5780145860 2024-03-07T07:34:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f577ea00640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578006d3f0 0x7f578015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5776000640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5780145860 0x7f57800c7500 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f57680ae040 tx=0x7f5768019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680b0040 con 0x7f5780145860 2024-03-07T07:34:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57680b9070 con 0x7f5780145860 2024-03-07T07:34:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578015dbf0 con 0x7f5780145860 2024-03-07T07:34:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680aabb0 con 0x7f5780145860 2024-03-07T07:34:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578015e1b0 con 0x7f5780145860 2024-03-07T07:34:42.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5780062d40 con 0x7f5780145860 2024-03-07T07:34:42.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.810+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f57680ab4c0 con 0x7f5780145860 2024-03-07T07:34:42.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f5777400640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f575c066f60 0x7f575c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f576811f8d0 con 0x7f5780145860 2024-03-07T07:34:42.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f577ea00640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f575c066f60 0x7f575c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f5777400640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f575c06ce20 0x7f575c06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 --> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f576800af30 con 0x7f575c06ce20 2024-03-07T07:34:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f576811fc80 con 0x7f5780145860 2024-03-07T07:34:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f577f400640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f575c06ce20 0x7f575c06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f577ea00640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f575c066f60 0x7f575c069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5770007fd0 tx=0x7f5770009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:42.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f577f400640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f575c06ce20 0x7f575c06f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:42.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.814+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 <== osd.0 v2:172.21.15.84:6803/3620020508 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f576800af30 con 0x7f575c06ce20 2024-03-07T07:34:42.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 --> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5780071590 con 0x7f575c06ce20 2024-03-07T07:34:42.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f5777400640 1 -- 172.21.15.84:0/417004340 <== osd.0 v2:172.21.15.84:6803/3620020508 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5780071590 con 0x7f575c06ce20 2024-03-07T07:34:42.829 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:34:42.829 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T07:34:42.829 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:34:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f575c06ce20 msgr2=0x7f575c06f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f5785800640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6803/3620020508,v1:172.21.15.84:6805/3620020508] conn(0x7f575c06ce20 0x7f575c06f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f575c066f60 msgr2=0x7f575c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f5785800640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f575c066f60 0x7f575c069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5770007fd0 tx=0x7f5770009040 comp rx=0 tx=0).stop 2024-03-07T07:34:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5780145860 msgr2=0x7f57800c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f5785800640 1 --2- 172.21.15.84:0/417004340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5780145860 0x7f57800c7500 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f57680ae040 tx=0x7f5768019240 comp rx=0 tx=0).stop 2024-03-07T07:34:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.826+0000 7f577f400640 1 -- 172.21.15.84:0/417004340 reap_dead start 2024-03-07T07:34:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.830+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 shutdown_connections 2024-03-07T07:34:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.830+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 >> 172.21.15.84:0/417004340 conn(0x7f57800cc840 msgr2=0x7f57800b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.830+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 shutdown_connections 2024-03-07T07:34:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.830+0000 7f5785800640 1 -- 172.21.15.84:0/417004340 wait complete. 2024-03-07T07:34:42.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-07T07:34:42.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf39600640 1 Processor -- start 2024-03-07T07:34:42.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf39600640 1 -- start start 2024-03-07T07:34:42.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf39600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf34143dd0 0x7fbf340cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf39600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf34144360 0x7fbf340729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf39600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf340cc880 con 0x7fbf341448b0 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf39600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf341441b0 con 0x7fbf34143dd0 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf39600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340cf050 con 0x7fbf34144360 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf32a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf34143dd0 0x7fbf340cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf33400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbf341448b0 0x7fbf3415b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46154/0 (socket says 172.21.15.84:46154) 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.982+0000 7fbf33400640 1 -- 172.21.15.84:0/425781077 learned_addr learned my addr 172.21.15.84:0/425781077 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf2a000640 1 --2- 172.21.15.84:0/425781077 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf34144360 0x7fbf340729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf32a00640 1 -- 172.21.15.84:0/425781077 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf34144360 msgr2=0x7fbf340729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:42.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf32a00640 1 --2- 172.21.15.84:0/425781077 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf34144360 0x7fbf340729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf32a00640 1 -- 172.21.15.84:0/425781077 >> v1:172.21.15.84:6789/0 conn(0x7fbf341448b0 legacy=0x7fbf3415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf32a00640 1 -- 172.21.15.84:0/425781077 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340ccb60 con 0x7fbf34143dd0 2024-03-07T07:34:42.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf32a00640 1 --2- 172.21.15.84:0/425781077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34143dd0 0x7fbf340cdc00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbf240097f0 tx=0x7fbf2401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42388d4614a4f2c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:42.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf32000640 1 -- 172.21.15.84:0/425781077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf240aa5f0 con 0x7fbf34143dd0 2024-03-07T07:34:42.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf32000640 1 -- 172.21.15.84:0/425781077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf240af070 con 0x7fbf34143dd0 2024-03-07T07:34:42.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf32000640 1 -- 172.21.15.84:0/425781077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf240aa9b0 con 0x7fbf34143dd0 2024-03-07T07:34:42.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf39600640 1 -- 172.21.15.84:0/425781077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34143dd0 msgr2=0x7fbf340cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.986+0000 7fbf39600640 1 --2- 172.21.15.84:0/425781077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34143dd0 0x7fbf340cdc00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbf240097f0 tx=0x7fbf2401c470 comp rx=0 tx=0).stop 2024-03-07T07:34:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 -- 172.21.15.84:0/425781077 shutdown_connections 2024-03-07T07:34:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 --2- 172.21.15.84:0/425781077 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf34144360 0x7fbf340729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 --2- 172.21.15.84:0/425781077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34143dd0 0x7fbf340cdc00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 -- 172.21.15.84:0/425781077 >> 172.21.15.84:0/425781077 conn(0x7fbf340704b0 msgr2=0x7fbf340708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 -- 172.21.15.84:0/425781077 shutdown_connections 2024-03-07T07:34:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 -- 172.21.15.84:0/425781077 wait complete. 2024-03-07T07:34:42.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 Processor -- start 2024-03-07T07:34:42.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 -- start start 2024-03-07T07:34:42.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf34143dd0 0x7fbf34157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34144360 0x7fbf3413acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf341448b0 0x7fbf3413b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340cd6e0 con 0x7fbf34144360 2024-03-07T07:34:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34073320 con 0x7fbf34143dd0 2024-03-07T07:34:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf39600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3415bf30 con 0x7fbf341448b0 2024-03-07T07:34:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34144360 0x7fbf3413acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34144360 0x7fbf3413acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40228/0 (socket says 172.21.15.84:40228) 2024-03-07T07:34:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 -- 172.21.15.84:0/248094353 learned_addr learned my addr 172.21.15.84:0/248094353 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf32a00640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf34143dd0 0x7fbf34157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf33400640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf341448b0 0x7fbf3413b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 -- 172.21.15.84:0/248094353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf341448b0 msgr2=0x7fbf3413b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf341448b0 0x7fbf3413b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 -- 172.21.15.84:0/248094353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf34143dd0 msgr2=0x7fbf34157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf34143dd0 0x7fbf34157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 -- 172.21.15.84:0/248094353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34158150 con 0x7fbf34144360 2024-03-07T07:34:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.990+0000 7fbf2a000640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34144360 0x7fbf3413acb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c007ef0 tx=0x7fbf1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf2b400640 1 -- 172.21.15.84:0/248094353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c014620 con 0x7fbf34144360 2024-03-07T07:34:42.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf2b400640 1 -- 172.21.15.84:0/248094353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c019070 con 0x7fbf34144360 2024-03-07T07:34:42.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf2b400640 1 -- 172.21.15.84:0/248094353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c014a00 con 0x7fbf34144360 2024-03-07T07:34:42.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf341561b0 con 0x7fbf34144360 2024-03-07T07:34:42.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf34156770 con 0x7fbf34144360 2024-03-07T07:34:42.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf34062d40 con 0x7fbf34144360 2024-03-07T07:34:42.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf2b400640 1 -- 172.21.15.84:0/248094353 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fbf1c014ba0 con 0x7fbf34144360 2024-03-07T07:34:42.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf2b400640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbf10066f60 0x7fbf10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:42.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf2b400640 1 -- 172.21.15.84:0/248094353 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf1c085590 con 0x7fbf34144360 2024-03-07T07:34:42.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf32a00640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbf10066f60 0x7fbf10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:42.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.994+0000 7fbf32a00640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbf10066f60 0x7fbf10069420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbf240ae000 tx=0x7fbf240a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:42.998+0000 7fbf2b400640 1 -- 172.21.15.84:0/248094353 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fbf34158150 con 0x7fbf34144360 2024-03-07T07:34:43.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.154+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf340ce130 con 0x7fbf10066f60 2024-03-07T07:34:43.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.154+0000 7fbf2b400640 1 -- 172.21.15.84:0/248094353 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf340ce130 con 0x7fbf10066f60 2024-03-07T07:34:43.156 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 0 to deep-scrub 2024-03-07T07:34:43.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbf10066f60 msgr2=0x7fbf10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbf10066f60 0x7fbf10069420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbf240ae000 tx=0x7fbf240a7000 comp rx=0 tx=0).stop 2024-03-07T07:34:43.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34144360 msgr2=0x7fbf3413acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34144360 0x7fbf3413acb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c007ef0 tx=0x7fbf1c00e4b0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 shutdown_connections 2024-03-07T07:34:43.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fbf10066f60 0x7fbf10069420 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf341448b0 0x7fbf3413b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf34144360 0x7fbf3413acb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 --2- 172.21.15.84:0/248094353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf34143dd0 0x7fbf34157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 >> 172.21.15.84:0/248094353 conn(0x7fbf340704b0 msgr2=0x7fbf3406e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:43.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 shutdown_connections 2024-03-07T07:34:43.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.158+0000 7fbf39600640 1 -- 172.21.15.84:0/248094353 wait complete. 2024-03-07T07:34:43.177 INFO:tasks.ceph:Scrubbing osd.1 2024-03-07T07:34:43.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-07T07:34:43.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.314+0000 7fc34ea00640 1 Processor -- start 2024-03-07T07:34:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.314+0000 7fc34ea00640 1 -- start start 2024-03-07T07:34:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3480b3500 0x7fc3480cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ea00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc348071af0 0x7fc34806e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ea00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480b4290 con 0x7fc348143e30 2024-03-07T07:34:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ea00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc348071f40 con 0x7fc348071af0 2024-03-07T07:34:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480b4550 con 0x7fc3480b3500 2024-03-07T07:34:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ca00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc348071af0 0x7fc34806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ca00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc348071af0 0x7fc34806e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40230/0 (socket says 172.21.15.84:40230) 2024-03-07T07:34:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ca00640 1 -- 172.21.15.84:0/124896889 learned_addr learned my addr 172.21.15.84:0/124896889 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc33f400640 1 --2- 172.21.15.84:0/124896889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3480b3500 0x7fc3480cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ca00640 1 -- 172.21.15.84:0/124896889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3480b3500 msgr2=0x7fc3480cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ca00640 1 --2- 172.21.15.84:0/124896889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3480b3500 0x7fc3480cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ca00640 1 -- 172.21.15.84:0/124896889 >> v1:172.21.15.161:6789/0 conn(0x7fc348143e30 legacy=0x7fc3480b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc34ca00640 1 -- 172.21.15.84:0/124896889 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480b4830 con 0x7fc348071af0 2024-03-07T07:34:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.318+0000 7fc33f400640 1 --2- 172.21.15.84:0/124896889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3480b3500 0x7fc3480cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ca00640 1 --2- 172.21.15.84:0/124896889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348071af0 0x7fc34806e370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc340009e50 tx=0x7fc34001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baff08718f0d524f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc347400640 1 -- 172.21.15.84:0/124896889 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3400a5790 con 0x7fc348071af0 2024-03-07T07:34:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc347400640 1 -- 172.21.15.84:0/124896889 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3400a5930 con 0x7fc348071af0 2024-03-07T07:34:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc347400640 1 -- 172.21.15.84:0/124896889 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3400a5d00 con 0x7fc348071af0 2024-03-07T07:34:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- 172.21.15.84:0/124896889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348071af0 msgr2=0x7fc34806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 --2- 172.21.15.84:0/124896889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348071af0 0x7fc34806e370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc340009e50 tx=0x7fc34001c9f0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- 172.21.15.84:0/124896889 shutdown_connections 2024-03-07T07:34:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 --2- 172.21.15.84:0/124896889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348071af0 0x7fc34806e370 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 --2- 172.21.15.84:0/124896889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3480b3500 0x7fc3480cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- 172.21.15.84:0/124896889 >> 172.21.15.84:0/124896889 conn(0x7fc3480cc840 msgr2=0x7fc3480ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- 172.21.15.84:0/124896889 shutdown_connections 2024-03-07T07:34:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- 172.21.15.84:0/124896889 wait complete. 2024-03-07T07:34:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 Processor -- start 2024-03-07T07:34:43.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- start start 2024-03-07T07:34:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348071af0 0x7fc34813d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b3500 0x7fc34813cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc348143e30 0x7fc3481f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34806f490 con 0x7fc3480b3500 2024-03-07T07:34:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34806f310 con 0x7fc348071af0 2024-03-07T07:34:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc34ea00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc348167cc0 con 0x7fc348143e30 2024-03-07T07:34:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.322+0000 7fc33f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b3500 0x7fc34813cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc33f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b3500 0x7fc34813cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40232/0 (socket says 172.21.15.84:40232) 2024-03-07T07:34:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc33f400640 1 -- 172.21.15.84:0/3216821160 learned_addr learned my addr 172.21.15.84:0/3216821160 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc34ca00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc348143e30 0x7fc3481f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc347e00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348071af0 0x7fc34813d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc33f400640 1 -- 172.21.15.84:0/3216821160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc348143e30 msgr2=0x7fc3481f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc33f400640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc348143e30 0x7fc3481f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc33f400640 1 -- 172.21.15.84:0/3216821160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348071af0 msgr2=0x7fc34813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc33f400640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348071af0 0x7fc34813d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc33f400640 1 -- 172.21.15.84:0/3216821160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348141ef0 con 0x7fc3480b3500 2024-03-07T07:34:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc33f400640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b3500 0x7fc34813cb30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc33000c7c0 tx=0x7fc33000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330007a30 con 0x7fc3480b3500 2024-03-07T07:34:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc330007bd0 con 0x7fc3480b3500 2024-03-07T07:34:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34813d070 con 0x7fc3480b3500 2024-03-07T07:34:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3300113f0 con 0x7fc3480b3500 2024-03-07T07:34:43.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3480b0510 con 0x7fc3480b3500 2024-03-07T07:34:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc348141a50 con 0x7fc3480b3500 2024-03-07T07:34:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fc330011590 con 0x7fc3480b3500 2024-03-07T07:34:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc344c00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc324066f60 0x7fc324069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc3300854c0 con 0x7fc3480b3500 2024-03-07T07:34:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc347e00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc324066f60 0x7fc324069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.326+0000 7fc344c00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7fc32406ce20 0x7fc32406f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.330+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 --> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc330018ec0 con 0x7fc32406ce20 2024-03-07T07:34:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.330+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc330085870 con 0x7fc3480b3500 2024-03-07T07:34:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.330+0000 7fc34ca00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7fc32406ce20 0x7fc32406f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.330+0000 7fc347e00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc324066f60 0x7fc324069420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc348165c80 tx=0x7fc338007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.330+0000 7fc34ca00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7fc32406ce20 0x7fc32406f240 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.330+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 <== osd.1 v2:172.21.15.84:6800/212168279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc330018ec0 con 0x7fc32406ce20 2024-03-07T07:34:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 --> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc348062d40 con 0x7fc32406ce20 2024-03-07T07:34:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc344c00640 1 -- 172.21.15.84:0/3216821160 <== osd.1 v2:172.21.15.84:6800/212168279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc348062d40 con 0x7fc32406ce20 2024-03-07T07:34:43.344 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:34:43.345 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T07:34:43.345 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:34:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7fc32406ce20 msgr2=0x7fc32406f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6800/212168279,v1:172.21.15.84:6801/212168279] conn(0x7fc32406ce20 0x7fc32406f240 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc324066f60 msgr2=0x7fc324069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fc324066f60 0x7fc324069420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc348165c80 tx=0x7fc338007e40 comp rx=0 tx=0).stop 2024-03-07T07:34:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b3500 msgr2=0x7fc34813cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 --2- 172.21.15.84:0/3216821160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b3500 0x7fc34813cb30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc33000c7c0 tx=0x7fc33000cc80 comp rx=0 tx=0).stop 2024-03-07T07:34:43.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ca00640 1 -- 172.21.15.84:0/3216821160 reap_dead start 2024-03-07T07:34:43.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 shutdown_connections 2024-03-07T07:34:43.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 >> 172.21.15.84:0/3216821160 conn(0x7fc3480cc840 msgr2=0x7fc3480ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:43.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 shutdown_connections 2024-03-07T07:34:43.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.342+0000 7fc34ea00640 1 -- 172.21.15.84:0/3216821160 wait complete. 2024-03-07T07:34:43.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-07T07:34:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b8ce00640 1 Processor -- start 2024-03-07T07:34:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b8ce00640 1 -- start start 2024-03-07T07:34:43.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b8ce00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b88145a30 0x7f4b880729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b8ce00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b8806d230 0x7f4b88072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b8ce00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8806d780 con 0x7f4b880a9540 2024-03-07T07:34:43.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b8ce00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8806da60 con 0x7f4b88145a30 2024-03-07T07:34:43.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b8ce00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8806dd40 con 0x7f4b8806d230 2024-03-07T07:34:43.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b85e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b88145a30 0x7f4b880729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b85400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4b880a9540 0x7f4b880ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46164/0 (socket says 172.21.15.84:46164) 2024-03-07T07:34:43.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b85400640 1 -- 172.21.15.84:0/1680046337 learned_addr learned my addr 172.21.15.84:0/1680046337 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:43.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b85e00640 1 -- 172.21.15.84:0/1680046337 >> v2:172.21.15.161:3300/0 conn(0x7f4b8806d230 msgr2=0x7f4b88072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:43.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b86800640 1 --2- 172.21.15.84:0/1680046337 >> v2:172.21.15.161:3300/0 conn(0x7f4b8806d230 0x7f4b88072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b84a00640 1 -- 172.21.15.84:0/1680046337 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177689257 0 0) 0x7f4b8806d780 con 0x7f4b880a9540 2024-03-07T07:34:43.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b85e00640 1 --2- 172.21.15.84:0/1680046337 >> v2:172.21.15.161:3300/0 conn(0x7f4b8806d230 0x7f4b88072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b85e00640 1 -- 172.21.15.84:0/1680046337 >> v1:172.21.15.84:6789/0 conn(0x7f4b880a9540 legacy=0x7f4b880ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b85e00640 1 -- 172.21.15.84:0/1680046337 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8806e020 con 0x7f4b88145a30 2024-03-07T07:34:43.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.498+0000 7f4b86800640 1 --2- 172.21.15.84:0/1680046337 >> v2:172.21.15.161:3300/0 conn(0x7f4b8806d230 0x7f4b88072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:43.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b85e00640 1 --2- 172.21.15.84:0/1680046337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b88145a30 0x7f4b880729d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4b88069010 tx=0x7f4b7801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3c68f9672ec7c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b84a00640 1 -- 172.21.15.84:0/1680046337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b0070 con 0x7f4b88145a30 2024-03-07T07:34:43.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b84a00640 1 -- 172.21.15.84:0/1680046337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780ab600 con 0x7f4b88145a30 2024-03-07T07:34:43.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b84a00640 1 -- 172.21.15.84:0/1680046337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780ab9d0 con 0x7f4b88145a30 2024-03-07T07:34:43.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 -- 172.21.15.84:0/1680046337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b88145a30 msgr2=0x7f4b880729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/1680046337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b88145a30 0x7f4b880729d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4b88069010 tx=0x7f4b7801c360 comp rx=0 tx=0).stop 2024-03-07T07:34:43.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 -- 172.21.15.84:0/1680046337 shutdown_connections 2024-03-07T07:34:43.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/1680046337 >> v2:172.21.15.161:3300/0 conn(0x7f4b8806d230 0x7f4b88072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/1680046337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b88145a30 0x7f4b880729d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 -- 172.21.15.84:0/1680046337 >> 172.21.15.84:0/1680046337 conn(0x7f4b880704b0 msgr2=0x7f4b880708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:43.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 -- 172.21.15.84:0/1680046337 shutdown_connections 2024-03-07T07:34:43.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 -- 172.21.15.84:0/1680046337 wait complete. 2024-03-07T07:34:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 Processor -- start 2024-03-07T07:34:43.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.502+0000 7f4b8ce00640 1 -- start start 2024-03-07T07:34:43.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8806d230 0x7f4b881661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b88145a30 0x7f4b880ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b880adab0 0x7f4b881430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88168d60 con 0x7f4b8806d230 2024-03-07T07:34:43.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88168be0 con 0x7f4b880adab0 2024-03-07T07:34:43.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88168ee0 con 0x7f4b88145a30 2024-03-07T07:34:43.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8806d230 0x7f4b881661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8806d230 0x7f4b881661d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40252/0 (socket says 172.21.15.84:40252) 2024-03-07T07:34:43.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 -- 172.21.15.84:0/3231220736 learned_addr learned my addr 172.21.15.84:0/3231220736 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:43.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85400640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b88145a30 0x7f4b880ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b86800640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b880adab0 0x7f4b881430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 -- 172.21.15.84:0/3231220736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b88145a30 msgr2=0x7f4b880ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b88145a30 0x7f4b880ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 -- 172.21.15.84:0/3231220736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b880adab0 msgr2=0x7f4b881430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b880adab0 0x7f4b881430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 -- 172.21.15.84:0/3231220736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880adf60 con 0x7f4b8806d230 2024-03-07T07:34:43.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b85e00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8806d230 0x7f4b881661d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4b780ae040 tx=0x7f4b78019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b7e000640 1 -- 172.21.15.84:0/3231220736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b8020 con 0x7f4b8806d230 2024-03-07T07:34:43.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b7e000640 1 -- 172.21.15.84:0/3231220736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780b4610 con 0x7f4b8806d230 2024-03-07T07:34:43.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8812a290 con 0x7f4b8806d230 2024-03-07T07:34:43.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b7e000640 1 -- 172.21.15.84:0/3231220736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b0040 con 0x7f4b8806d230 2024-03-07T07:34:43.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8812a530 con 0x7f4b8806d230 2024-03-07T07:34:43.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.506+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b88062d40 con 0x7f4b8806d230 2024-03-07T07:34:43.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.510+0000 7f4b7e000640 1 -- 172.21.15.84:0/3231220736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f4b780bb020 con 0x7f4b8806d230 2024-03-07T07:34:43.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.510+0000 7f4b7e000640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b68066f60 0x7f4b68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.510+0000 7f4b7e000640 1 -- 172.21.15.84:0/3231220736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4b7811eaa0 con 0x7f4b8806d230 2024-03-07T07:34:43.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.510+0000 7f4b85400640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b68066f60 0x7f4b68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.510+0000 7f4b85400640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b68066f60 0x7f4b68069420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4b74007fd0 tx=0x7f4b74007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.514+0000 7f4b7e000640 1 -- 172.21.15.84:0/3231220736 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f4b780c2030 con 0x7f4b8806d230 2024-03-07T07:34:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b88141120 con 0x7f4b68066f60 2024-03-07T07:34:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b7e000640 1 -- 172.21.15.84:0/3231220736 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4b88141120 con 0x7f4b68066f60 2024-03-07T07:34:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 1 to deep-scrub 2024-03-07T07:34:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b68066f60 msgr2=0x7f4b68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b68066f60 0x7f4b68069420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4b74007fd0 tx=0x7f4b74007d60 comp rx=0 tx=0).stop 2024-03-07T07:34:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8806d230 msgr2=0x7f4b881661d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8806d230 0x7f4b881661d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4b780ae040 tx=0x7f4b78019100 comp rx=0 tx=0).stop 2024-03-07T07:34:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 shutdown_connections 2024-03-07T07:34:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f4b68066f60 0x7f4b68069420 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b880adab0 0x7f4b881430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b88145a30 0x7f4b880ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 --2- 172.21.15.84:0/3231220736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8806d230 0x7f4b881661d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 >> 172.21.15.84:0/3231220736 conn(0x7f4b880704b0 msgr2=0x7f4b880cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 shutdown_connections 2024-03-07T07:34:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.670+0000 7f4b8ce00640 1 -- 172.21.15.84:0/3231220736 wait complete. 2024-03-07T07:34:43.691 INFO:tasks.ceph:Scrubbing osd.2 2024-03-07T07:34:43.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-07T07:34:43.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.826+0000 7f978a000640 1 Processor -- start 2024-03-07T07:34:43.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f978a000640 1 -- start start 2024-03-07T07:34:43.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f978a000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9784071e80 0x7f9784072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f978a000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f97840cb8d0 0x7f978406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f978a000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 0x7f978406cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f978a000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9784147000 con 0x7f9784071e80 2024-03-07T07:34:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f978a000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978406c520 con 0x7f97840cb8d0 2024-03-07T07:34:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f978a000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97840727a0 con 0x7f97841477e0 2024-03-07T07:34:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9788c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9784071e80 0x7f9784072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9788c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9784071e80 0x7f9784072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40254/0 (socket says 172.21.15.84:40254) 2024-03-07T07:34:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9788c00640 1 -- 172.21.15.84:0/3718994024 learned_addr learned my addr 172.21.15.84:0/3718994024 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9789600640 1 --2- 172.21.15.84:0/3718994024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 0x7f978406cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9783e00640 1 --2- 172.21.15.84:0/3718994024 >> v2:172.21.15.161:3300/0 conn(0x7f97840cb8d0 0x7f978406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9788c00640 1 -- 172.21.15.84:0/3718994024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 msgr2=0x7f978406cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9788c00640 1 --2- 172.21.15.84:0/3718994024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 0x7f978406cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9788c00640 1 -- 172.21.15.84:0/3718994024 >> v2:172.21.15.161:3300/0 conn(0x7f97840cb8d0 msgr2=0x7f978406ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9788c00640 1 --2- 172.21.15.84:0/3718994024 >> v2:172.21.15.161:3300/0 conn(0x7f97840cb8d0 0x7f978406ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9788c00640 1 -- 172.21.15.84:0/3718994024 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978406b760 con 0x7f9784071e80 2024-03-07T07:34:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9789600640 1 --2- 172.21.15.84:0/3718994024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 0x7f978406cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.830+0000 7f9783e00640 1 --2- 172.21.15.84:0/3718994024 >> v2:172.21.15.161:3300/0 conn(0x7f97840cb8d0 0x7f978406ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:43.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f9788c00640 1 --2- 172.21.15.84:0/3718994024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 0x7f9784072260 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f978406c7e0 tx=0x7f977801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d154337218ad9c29 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f9783400640 1 -- 172.21.15.84:0/3718994024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97780b2070 con 0x7f9784071e80 2024-03-07T07:34:43.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f9783400640 1 -- 172.21.15.84:0/3718994024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97780a9070 con 0x7f9784071e80 2024-03-07T07:34:43.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f9783400640 1 -- 172.21.15.84:0/3718994024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97780ad880 con 0x7f9784071e80 2024-03-07T07:34:43.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 -- 172.21.15.84:0/3718994024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 msgr2=0x7f9784072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 --2- 172.21.15.84:0/3718994024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 0x7f9784072260 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f978406c7e0 tx=0x7f977801c490 comp rx=0 tx=0).stop 2024-03-07T07:34:43.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 -- 172.21.15.84:0/3718994024 shutdown_connections 2024-03-07T07:34:43.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 --2- 172.21.15.84:0/3718994024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 0x7f978406cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 --2- 172.21.15.84:0/3718994024 >> v2:172.21.15.161:3300/0 conn(0x7f97840cb8d0 0x7f978406ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 --2- 172.21.15.84:0/3718994024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 0x7f9784072260 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 -- 172.21.15.84:0/3718994024 >> 172.21.15.84:0/3718994024 conn(0x7f97840ce5f0 msgr2=0x7f97840cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:43.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 -- 172.21.15.84:0/3718994024 shutdown_connections 2024-03-07T07:34:43.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 -- 172.21.15.84:0/3718994024 wait complete. 2024-03-07T07:34:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 Processor -- start 2024-03-07T07:34:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.834+0000 7f978a000640 1 -- start start 2024-03-07T07:34:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 0x7f97841392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 0x7f978415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f978413f580 0x7f978413fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840d0510 con 0x7f9784071e80 2024-03-07T07:34:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978406d8d0 con 0x7f978413f580 2024-03-07T07:34:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97840d0690 con 0x7f97841477e0 2024-03-07T07:34:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 0x7f97841392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 0x7f97841392f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40266/0 (socket says 172.21.15.84:40266) 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 -- 172.21.15.84:0/1505559045 learned_addr learned my addr 172.21.15.84:0/1505559045 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9783e00640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 0x7f978415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9789600640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f978413f580 0x7f978413fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 -- 172.21.15.84:0/1505559045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 msgr2=0x7f978415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97841477e0 0x7f978415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 -- 172.21.15.84:0/1505559045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f978413f580 msgr2=0x7f978413fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f978413f580 0x7f978413fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 -- 172.21.15.84:0/1505559045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978413b190 con 0x7f9784071e80 2024-03-07T07:34:43.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9788c00640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 0x7f97841392f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f977801ab40 tx=0x7f9778019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97780b2040 con 0x7f9784071e80 2024-03-07T07:34:43.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97780bb070 con 0x7f9784071e80 2024-03-07T07:34:43.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97780b6440 con 0x7f9784071e80 2024-03-07T07:34:43.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978413b470 con 0x7f9784071e80 2024-03-07T07:34:43.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978413ae60 con 0x7f9784071e80 2024-03-07T07:34:43.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9784062d40 con 0x7f9784071e80 2024-03-07T07:34:43.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.838+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f97780ab070 con 0x7f9784071e80 2024-03-07T07:34:43.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9780c00640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9764066f60 0x7f9764069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f977811e6a0 con 0x7f9784071e80 2024-03-07T07:34:43.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9783e00640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9764066f60 0x7f9764069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9780c00640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f976406ce20 0x7f976406f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:43.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 --> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9778001d40 con 0x7f976406ce20 2024-03-07T07:34:43.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9778125050 con 0x7f9784071e80 2024-03-07T07:34:43.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9789600640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f976406ce20 0x7f976406f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:43.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9783e00640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9764066f60 0x7f9764069420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f978413ac50 tx=0x7f9770008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9789600640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f976406ce20 0x7f976406f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:43.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.842+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 <== osd.2 v2:172.21.15.84:6824/3227098675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9778001d40 con 0x7f976406ce20 2024-03-07T07:34:43.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.854+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 --> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f978413b640 con 0x7f976406ce20 2024-03-07T07:34:43.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.854+0000 7f9780c00640 1 -- 172.21.15.84:0/1505559045 <== osd.2 v2:172.21.15.84:6824/3227098675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f978413b640 con 0x7f976406ce20 2024-03-07T07:34:43.857 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:34:43.857 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T07:34:43.857 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:34:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.854+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f976406ce20 msgr2=0x7f976406f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.854+0000 7f978a000640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6824/3227098675,v1:172.21.15.84:6825/3227098675] conn(0x7f976406ce20 0x7f976406f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.854+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9764066f60 msgr2=0x7f9764069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.854+0000 7f978a000640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9764066f60 0x7f9764069420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f978413ac50 tx=0x7f9770008040 comp rx=0 tx=0).stop 2024-03-07T07:34:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.854+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 msgr2=0x7f97841392f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.854+0000 7f978a000640 1 --2- 172.21.15.84:0/1505559045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9784071e80 0x7f97841392f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f977801ab40 tx=0x7f9778019230 comp rx=0 tx=0).stop 2024-03-07T07:34:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.858+0000 7f9789600640 1 -- 172.21.15.84:0/1505559045 reap_dead start 2024-03-07T07:34:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.858+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 shutdown_connections 2024-03-07T07:34:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.858+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 >> 172.21.15.84:0/1505559045 conn(0x7f97840ce5f0 msgr2=0x7f97840b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:43.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.858+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 shutdown_connections 2024-03-07T07:34:43.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:43.858+0000 7f978a000640 1 -- 172.21.15.84:0/1505559045 wait complete. 2024-03-07T07:34:43.875 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-07T07:34:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f5460000640 1 Processor -- start 2024-03-07T07:34:44.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f5460000640 1 -- start start 2024-03-07T07:34:44.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f5460000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54580730e0 0x7f54580cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f5460000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5458144360 0x7f545815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f5460000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580cc880 con 0x7f5458143dd0 2024-03-07T07:34:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f5460000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54581441b0 con 0x7f5458144360 2024-03-07T07:34:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f5460000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54580cf050 con 0x7f54580730e0 2024-03-07T07:34:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f545e000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5458144360 0x7f545815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f545d600640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5458143dd0 0x7f54580729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46178/0 (socket says 172.21.15.84:46178) 2024-03-07T07:34:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.010+0000 7f545d600640 1 -- 172.21.15.84:0/336326792 learned_addr learned my addr 172.21.15.84:0/336326792 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f545cc00640 1 --2- 172.21.15.84:0/336326792 >> v2:172.21.15.161:3300/0 conn(0x7f54580730e0 0x7f54580cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f545e000640 1 -- 172.21.15.84:0/336326792 >> v2:172.21.15.161:3300/0 conn(0x7f54580730e0 msgr2=0x7f54580cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f545e000640 1 --2- 172.21.15.84:0/336326792 >> v2:172.21.15.161:3300/0 conn(0x7f54580730e0 0x7f54580cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f545e000640 1 -- 172.21.15.84:0/336326792 >> v1:172.21.15.84:6789/0 conn(0x7f5458143dd0 legacy=0x7f54580729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f5457e00640 1 -- 172.21.15.84:0/336326792 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281041756 0 0) 0x7f54580cc880 con 0x7f5458143dd0 2024-03-07T07:34:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f545e000640 1 -- 172.21.15.84:0/336326792 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580ccb60 con 0x7f5458144360 2024-03-07T07:34:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f545cc00640 1 --2- 172.21.15.84:0/336326792 >> v2:172.21.15.161:3300/0 conn(0x7f54580730e0 0x7f54580cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f545e000640 1 --2- 172.21.15.84:0/336326792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5458144360 0x7f545815b410 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f54580cc090 tx=0x7f545001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c42ca3d98f98fe server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f5457e00640 1 -- 172.21.15.84:0/336326792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500b2070 con 0x7f5458144360 2024-03-07T07:34:44.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f5457e00640 1 -- 172.21.15.84:0/336326792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54500a5a10 con 0x7f5458144360 2024-03-07T07:34:44.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f5457e00640 1 -- 172.21.15.84:0/336326792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500a5de0 con 0x7f5458144360 2024-03-07T07:34:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f5460000640 1 -- 172.21.15.84:0/336326792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5458144360 msgr2=0x7f545815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.014+0000 7f5460000640 1 --2- 172.21.15.84:0/336326792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5458144360 0x7f545815b410 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f54580cc090 tx=0x7f545001c930 comp rx=0 tx=0).stop 2024-03-07T07:34:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 -- 172.21.15.84:0/336326792 shutdown_connections 2024-03-07T07:34:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 --2- 172.21.15.84:0/336326792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5458144360 0x7f545815b410 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 --2- 172.21.15.84:0/336326792 >> v2:172.21.15.161:3300/0 conn(0x7f54580730e0 0x7f54580cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 -- 172.21.15.84:0/336326792 >> 172.21.15.84:0/336326792 conn(0x7f54580704b0 msgr2=0x7f54580708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 -- 172.21.15.84:0/336326792 shutdown_connections 2024-03-07T07:34:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 -- 172.21.15.84:0/336326792 wait complete. 2024-03-07T07:34:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 Processor -- start 2024-03-07T07:34:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 -- start start 2024-03-07T07:34:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54580730e0 0x7f5458159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5458143dd0 0x7f54580ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458144360 0x7f54580ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458167960 con 0x7f54580730e0 2024-03-07T07:34:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580cd6e0 con 0x7f5458144360 2024-03-07T07:34:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f5460000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5458167ae0 con 0x7f5458143dd0 2024-03-07T07:34:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54580730e0 0x7f5458159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54580730e0 0x7f5458159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40278/0 (socket says 172.21.15.84:40278) 2024-03-07T07:34:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 -- 172.21.15.84:0/3217682118 learned_addr learned my addr 172.21.15.84:0/3217682118 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545cc00640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5458143dd0 0x7f54580ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545e000640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458144360 0x7f54580ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 -- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5458143dd0 msgr2=0x7f54580ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5458143dd0 0x7f54580ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 -- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458144360 msgr2=0x7f54580ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458144360 0x7f54580ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 -- 172.21.15.84:0/3217682118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458140190 con 0x7f54580730e0 2024-03-07T07:34:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545cc00640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5458143dd0 0x7f54580ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.018+0000 7f545d600640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54580730e0 0x7f5458159c00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c550 tx=0x7f544c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5455600640 1 -- 172.21.15.84:0/3217682118 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c017070 con 0x7f54580730e0 2024-03-07T07:34:44.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5455600640 1 -- 172.21.15.84:0/3217682118 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c005d10 con 0x7f54580730e0 2024-03-07T07:34:44.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5458140470 con 0x7f54580730e0 2024-03-07T07:34:44.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5455600640 1 -- 172.21.15.84:0/3217682118 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c007330 con 0x7f54580730e0 2024-03-07T07:34:44.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545815a140 con 0x7f54580730e0 2024-03-07T07:34:44.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5458062d40 con 0x7f54580730e0 2024-03-07T07:34:44.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5455600640 1 -- 172.21.15.84:0/3217682118 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f544c01a070 con 0x7f54580730e0 2024-03-07T07:34:44.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5455600640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5438066f60 0x7f5438069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f5455600640 1 -- 172.21.15.84:0/3217682118 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f544c084130 con 0x7f54580730e0 2024-03-07T07:34:44.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f545cc00640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5438066f60 0x7f5438069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.022+0000 7f545cc00640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5438066f60 0x7f5438069420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54581f81d0 tx=0x7f5444008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.026+0000 7f5455600640 1 -- 172.21.15.84:0/3217682118 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f544c054de0 con 0x7f54580730e0 2024-03-07T07:34:44.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.182+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f545815b1f0 con 0x7f5438066f60 2024-03-07T07:34:44.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.182+0000 7f5455600640 1 -- 172.21.15.84:0/3217682118 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f545815b1f0 con 0x7f5438066f60 2024-03-07T07:34:44.184 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 2 to deep-scrub 2024-03-07T07:34:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.182+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5438066f60 msgr2=0x7f5438069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.182+0000 7f5460000640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5438066f60 0x7f5438069420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54581f81d0 tx=0x7f5444008040 comp rx=0 tx=0).stop 2024-03-07T07:34:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54580730e0 msgr2=0x7f5458159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54580730e0 0x7f5458159c00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c550 tx=0x7f544c00ca10 comp rx=0 tx=0).stop 2024-03-07T07:34:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 shutdown_connections 2024-03-07T07:34:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5438066f60 0x7f5438069420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458144360 0x7f54580ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5458143dd0 0x7f54580ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 --2- 172.21.15.84:0/3217682118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54580730e0 0x7f5458159c00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 >> 172.21.15.84:0/3217682118 conn(0x7f54580704b0 msgr2=0x7f5458142c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 shutdown_connections 2024-03-07T07:34:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.186+0000 7f5460000640 1 -- 172.21.15.84:0/3217682118 wait complete. 2024-03-07T07:34:44.205 INFO:tasks.ceph:Scrubbing osd.3 2024-03-07T07:34:44.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-07T07:34:44.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd5a600640 1 Processor -- start 2024-03-07T07:34:44.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd5a600640 1 -- start start 2024-03-07T07:34:44.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd5a600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54163430 0x7fdd540b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd5a600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd54163810 0x7fdd540b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd5a600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540727b0 con 0x7fdd54071af0 2024-03-07T07:34:44.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd5a600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd54072a90 con 0x7fdd54163810 2024-03-07T07:34:44.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd5a600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54072d70 con 0x7fdd54163430 2024-03-07T07:34:44.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd53e00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdd54071af0 0x7fdd54071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46186/0 (socket says 172.21.15.84:46186) 2024-03-07T07:34:44.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd53e00640 1 -- 172.21.15.84:0/203973938 learned_addr learned my addr 172.21.15.84:0/203973938 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:44.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd4be00640 1 --2- 172.21.15.84:0/203973938 >> v2:172.21.15.84:3300/0 conn(0x7fdd54163810 0x7fdd540b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd53400640 1 --2- 172.21.15.84:0/203973938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54163430 0x7fdd540b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd4be00640 1 -- 172.21.15.84:0/203973938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54163430 msgr2=0x7fdd540b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:44.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd4be00640 1 --2- 172.21.15.84:0/203973938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54163430 0x7fdd540b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd4be00640 1 -- 172.21.15.84:0/203973938 >> v1:172.21.15.84:6789/0 conn(0x7fdd54071af0 legacy=0x7fdd54071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd4be00640 1 -- 172.21.15.84:0/203973938 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54073050 con 0x7fdd54163810 2024-03-07T07:34:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd52a00640 1 -- 172.21.15.84:0/203973938 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228027703 0 0) 0x7fdd540727b0 con 0x7fdd54071af0 2024-03-07T07:34:44.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.346+0000 7fdd53400640 1 --2- 172.21.15.84:0/203973938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54163430 0x7fdd540b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:44.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd4be00640 1 --2- 172.21.15.84:0/203973938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163810 0x7fdd540b3ab0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0097c0 tx=0x7fdd3c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e006fd13d589da11 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd52a00640 1 -- 172.21.15.84:0/203973938 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0ab600 con 0x7fdd54163810 2024-03-07T07:34:44.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd52a00640 1 -- 172.21.15.84:0/203973938 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0b0070 con 0x7fdd54163810 2024-03-07T07:34:44.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd52a00640 1 -- 172.21.15.84:0/203973938 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0ab9c0 con 0x7fdd54163810 2024-03-07T07:34:44.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 -- 172.21.15.84:0/203973938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163810 msgr2=0x7fdd540b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 --2- 172.21.15.84:0/203973938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163810 0x7fdd540b3ab0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0097c0 tx=0x7fdd3c01c3e0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 -- 172.21.15.84:0/203973938 shutdown_connections 2024-03-07T07:34:44.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 --2- 172.21.15.84:0/203973938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163810 0x7fdd540b3ab0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 --2- 172.21.15.84:0/203973938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54163430 0x7fdd540b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 -- 172.21.15.84:0/203973938 >> 172.21.15.84:0/203973938 conn(0x7fdd540cc840 msgr2=0x7fdd540ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:44.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 -- 172.21.15.84:0/203973938 shutdown_connections 2024-03-07T07:34:44.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 -- 172.21.15.84:0/203973938 wait complete. 2024-03-07T07:34:44.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 Processor -- start 2024-03-07T07:34:44.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.350+0000 7fdd5a600640 1 -- start start 2024-03-07T07:34:44.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54071af0 0x7fdd54151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163430 0x7fdd540b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd54163810 0x7fdd5415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540ce920 con 0x7fdd54163430 2024-03-07T07:34:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540ce7a0 con 0x7fdd54163810 2024-03-07T07:34:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540ceaa0 con 0x7fdd54071af0 2024-03-07T07:34:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163430 0x7fdd540b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163430 0x7fdd540b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40296/0 (socket says 172.21.15.84:40296) 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 -- 172.21.15.84:0/1974769807 learned_addr learned my addr 172.21.15.84:0/1974769807 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd53400640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54071af0 0x7fdd54151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd53e00640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd54163810 0x7fdd5415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 -- 172.21.15.84:0/1974769807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54071af0 msgr2=0x7fdd54151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd54071af0 0x7fdd54151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 -- 172.21.15.84:0/1974769807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd54163810 msgr2=0x7fdd5415ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd54163810 0x7fdd5415ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 -- 172.21.15.84:0/1974769807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54154f60 con 0x7fdd54163430 2024-03-07T07:34:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd53e00640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd54163810 0x7fdd5415ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4be00640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163430 0x7fdd540b32b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ad040 tx=0x7fdd3c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0b5810 con 0x7fdd54163430 2024-03-07T07:34:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0b59d0 con 0x7fdd54163430 2024-03-07T07:34:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd54155240 con 0x7fdd54163430 2024-03-07T07:34:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0b5dc0 con 0x7fdd54163430 2024-03-07T07:34:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd54155800 con 0x7fdd54163430 2024-03-07T07:34:44.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.354+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd54062d40 con 0x7fdd54163430 2024-03-07T07:34:44.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fdd3c0bd020 con 0x7fdd54163430 2024-03-07T07:34:44.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd4b400640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd30066f60 0x7fdd30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdd3c11f4a0 con 0x7fdd54163430 2024-03-07T07:34:44.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd4b400640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7fdd3006ce20 0x7fdd3006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd53400640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd30066f60 0x7fdd30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 --> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd3c00af30 con 0x7fdd3006ce20 2024-03-07T07:34:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd3c126050 con 0x7fdd54163430 2024-03-07T07:34:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd53e00640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7fdd3006ce20 0x7fdd3006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd53400640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd30066f60 0x7fdd30069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400ab60 tx=0x7fdd44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd53e00640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7fdd3006ce20 0x7fdd3006f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.358+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 <== osd.3 v2:172.21.15.84:6816/201863371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdd3c00af30 con 0x7fdd3006ce20 2024-03-07T07:34:44.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.370+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 --> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdd5406f540 con 0x7fdd3006ce20 2024-03-07T07:34:44.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd4b400640 1 -- 172.21.15.84:0/1974769807 <== osd.3 v2:172.21.15.84:6816/201863371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdd5406f540 con 0x7fdd3006ce20 2024-03-07T07:34:44.374 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:34:44.374 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T07:34:44.374 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:34:44.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7fdd3006ce20 msgr2=0x7fdd3006f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6816/201863371,v1:172.21.15.84:6817/201863371] conn(0x7fdd3006ce20 0x7fdd3006f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd30066f60 msgr2=0x7fdd30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdd30066f60 0x7fdd30069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400ab60 tx=0x7fdd44008040 comp rx=0 tx=0).stop 2024-03-07T07:34:44.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163430 msgr2=0x7fdd540b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 --2- 172.21.15.84:0/1974769807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd54163430 0x7fdd540b32b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ad040 tx=0x7fdd3c01ac20 comp rx=0 tx=0).stop 2024-03-07T07:34:44.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd53e00640 1 -- 172.21.15.84:0/1974769807 reap_dead start 2024-03-07T07:34:44.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 shutdown_connections 2024-03-07T07:34:44.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 >> 172.21.15.84:0/1974769807 conn(0x7fdd540cc840 msgr2=0x7fdd54161f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 shutdown_connections 2024-03-07T07:34:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.374+0000 7fdd5a600640 1 -- 172.21.15.84:0/1974769807 wait complete. 2024-03-07T07:34:44.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-07T07:34:44.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c07400640 1 Processor -- start 2024-03-07T07:34:44.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c07400640 1 -- start start 2024-03-07T07:34:44.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c07400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9c00143dd0 0x7f9c000cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c07400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c0015b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c07400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c000cc880 con 0x7f9c00144360 2024-03-07T07:34:44.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c07400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c001441b0 con 0x7f9c00143dd0 2024-03-07T07:34:44.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c07400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000cf050 con 0x7f9c000730e0 2024-03-07T07:34:44.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9bffe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9c00144360 0x7f9c000729d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46194/0 (socket says 172.21.15.84:46194) 2024-03-07T07:34:44.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9bffe00640 1 -- 172.21.15.84:0/821180491 learned_addr learned my addr 172.21.15.84:0/821180491 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:44.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c05400640 1 --2- 172.21.15.84:0/821180491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c0015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c04a00640 1 --2- 172.21.15.84:0/821180491 >> v2:172.21.15.161:3300/0 conn(0x7f9c00143dd0 0x7f9c000cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9bff400640 1 -- 172.21.15.84:0/821180491 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985149317 0 0) 0x7f9c000cc880 con 0x7f9c00144360 2024-03-07T07:34:44.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9bff400640 1 -- 172.21.15.84:0/821180491 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9be4003530 con 0x7f9c00144360 2024-03-07T07:34:44.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c05400640 1 -- 172.21.15.84:0/821180491 >> v2:172.21.15.161:3300/0 conn(0x7f9c00143dd0 msgr2=0x7f9c000cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:44.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c05400640 1 --2- 172.21.15.84:0/821180491 >> v2:172.21.15.161:3300/0 conn(0x7f9c00143dd0 0x7f9c000cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c05400640 1 -- 172.21.15.84:0/821180491 >> v1:172.21.15.84:6789/0 conn(0x7f9c00144360 legacy=0x7f9c000729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.526+0000 7f9c05400640 1 -- 172.21.15.84:0/821180491 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000ccb60 con 0x7f9c000730e0 2024-03-07T07:34:44.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.530+0000 7f9c05400640 1 --2- 172.21.15.84:0/821180491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c0015b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80097c0 tx=0x7f9bf801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b9dfe10b4af366e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.530+0000 7f9bff400640 1 -- 172.21.15.84:0/821180491 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80aa5f0 con 0x7f9c000730e0 2024-03-07T07:34:44.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.530+0000 7f9bff400640 1 -- 172.21.15.84:0/821180491 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf80af070 con 0x7f9c000730e0 2024-03-07T07:34:44.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.530+0000 7f9bff400640 1 -- 172.21.15.84:0/821180491 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80aa9b0 con 0x7f9c000730e0 2024-03-07T07:34:44.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.530+0000 7f9c07400640 1 -- 172.21.15.84:0/821180491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 msgr2=0x7f9c0015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.530+0000 7f9c07400640 1 --2- 172.21.15.84:0/821180491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c0015b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80097c0 tx=0x7f9bf801c470 comp rx=0 tx=0).stop 2024-03-07T07:34:44.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 -- 172.21.15.84:0/821180491 shutdown_connections 2024-03-07T07:34:44.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 --2- 172.21.15.84:0/821180491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c0015b410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 --2- 172.21.15.84:0/821180491 >> v2:172.21.15.161:3300/0 conn(0x7f9c00143dd0 0x7f9c000cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 -- 172.21.15.84:0/821180491 >> 172.21.15.84:0/821180491 conn(0x7f9c000704b0 msgr2=0x7f9c000708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:44.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 -- 172.21.15.84:0/821180491 shutdown_connections 2024-03-07T07:34:44.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 -- 172.21.15.84:0/821180491 wait complete. 2024-03-07T07:34:44.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 Processor -- start 2024-03-07T07:34:44.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 -- start start 2024-03-07T07:34:44.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c00163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c00143dd0 0x7f9c001f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c00144360 0x7f9c000b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c00167960 con 0x7f9c00144360 2024-03-07T07:34:44.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000cd6e0 con 0x7f9c00143dd0 2024-03-07T07:34:44.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c07400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c00167ae0 con 0x7f9c000730e0 2024-03-07T07:34:44.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c00144360 0x7f9c000b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c00144360 0x7f9c000b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40310/0 (socket says 172.21.15.84:40310) 2024-03-07T07:34:44.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 -- 172.21.15.84:0/4136649136 learned_addr learned my addr 172.21.15.84:0/4136649136 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:44.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c04a00640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c00163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9bffe00640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c00143dd0 0x7f9c001f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 -- 172.21.15.84:0/4136649136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 msgr2=0x7f9c00163fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c00163fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 -- 172.21.15.84:0/4136649136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c00143dd0 msgr2=0x7f9c001f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c00143dd0 0x7f9c001f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 -- 172.21.15.84:0/4136649136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0013bfa0 con 0x7f9c00144360 2024-03-07T07:34:44.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.534+0000 7f9c05400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c00144360 0x7f9c000b0270 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80ac040 tx=0x7f9bf801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9bfcc00640 1 -- 172.21.15.84:0/4136649136 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80be410 con 0x7f9c00144360 2024-03-07T07:34:44.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9bfcc00640 1 -- 172.21.15.84:0/4136649136 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf80be5b0 con 0x7f9c00144360 2024-03-07T07:34:44.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0013c240 con 0x7f9c00144360 2024-03-07T07:34:44.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9bfcc00640 1 -- 172.21.15.84:0/4136649136 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80be9a0 con 0x7f9c00144360 2024-03-07T07:34:44.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0013c800 con 0x7f9c00144360 2024-03-07T07:34:44.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c00062d40 con 0x7f9c00144360 2024-03-07T07:34:44.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9bfcc00640 1 -- 172.21.15.84:0/4136649136 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f9bf80bc020 con 0x7f9c00144360 2024-03-07T07:34:44.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9bfcc00640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9be0066f60 0x7f9be0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9bfcc00640 1 -- 172.21.15.84:0/4136649136 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9bf811f1e0 con 0x7f9c00144360 2024-03-07T07:34:44.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9c04a00640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9be0066f60 0x7f9be0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.538+0000 7f9c04a00640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9be0066f60 0x7f9be0069420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9c000aec70 tx=0x7f9bf000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.542+0000 7f9bfcc00640 1 -- 172.21.15.84:0/4136649136 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f9bf8016090 con 0x7f9c00144360 2024-03-07T07:34:44.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c00164520 con 0x7f9be0066f60 2024-03-07T07:34:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9bfcc00640 1 -- 172.21.15.84:0/4136649136 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9c00164520 con 0x7f9be0066f60 2024-03-07T07:34:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 3 to deep-scrub 2024-03-07T07:34:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9be0066f60 msgr2=0x7f9be0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9be0066f60 0x7f9be0069420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9c000aec70 tx=0x7f9bf000b040 comp rx=0 tx=0).stop 2024-03-07T07:34:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c00144360 msgr2=0x7f9c000b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c00144360 0x7f9c000b0270 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80ac040 tx=0x7f9bf801acb0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 shutdown_connections 2024-03-07T07:34:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f9be0066f60 0x7f9be0069420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c00144360 0x7f9c000b0270 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c00143dd0 0x7f9c001f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 --2- 172.21.15.84:0/4136649136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c000730e0 0x7f9c00163fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 >> 172.21.15.84:0/4136649136 conn(0x7f9c000704b0 msgr2=0x7f9c001423e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 shutdown_connections 2024-03-07T07:34:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.698+0000 7f9c07400640 1 -- 172.21.15.84:0/4136649136 wait complete. 2024-03-07T07:34:44.720 INFO:tasks.ceph:Scrubbing osd.4 2024-03-07T07:34:44.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-07T07:34:44.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27dc400640 1 Processor -- start 2024-03-07T07:34:44.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27dc400640 1 -- start start 2024-03-07T07:34:44.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27dc400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f27d4151620 0x7f27d406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27dc400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f27d406e030 0x7f27d415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27dc400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d415af80 0x7f27d40704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27dc400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d415e030 con 0x7f27d4151620 2024-03-07T07:34:44.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27dc400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d415b7e0 con 0x7f27d406e030 2024-03-07T07:34:44.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27dc400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d415e280 con 0x7f27d415af80 2024-03-07T07:34:44.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f27d4151620 0x7f27d406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f27d4151620 0x7f27d406daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40318/0 (socket says 172.21.15.84:40318) 2024-03-07T07:34:44.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9a00640 1 -- 172.21.15.84:0/2260808840 learned_addr learned my addr 172.21.15.84:0/2260808840 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:44.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27da400640 1 --2- 172.21.15.84:0/2260808840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d415af80 0x7f27d40704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9000640 1 --2- 172.21.15.84:0/2260808840 >> v2:172.21.15.161:3300/0 conn(0x7f27d406e030 0x7f27d415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9a00640 1 -- 172.21.15.84:0/2260808840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d415af80 msgr2=0x7f27d40704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9a00640 1 --2- 172.21.15.84:0/2260808840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d415af80 0x7f27d40704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9a00640 1 -- 172.21.15.84:0/2260808840 >> v2:172.21.15.161:3300/0 conn(0x7f27d406e030 msgr2=0x7f27d415aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9a00640 1 --2- 172.21.15.84:0/2260808840 >> v2:172.21.15.161:3300/0 conn(0x7f27d406e030 0x7f27d415aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9a00640 1 -- 172.21.15.84:0/2260808840 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d415e560 con 0x7f27d4151620 2024-03-07T07:34:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.858+0000 7f27d9000640 1 --2- 172.21.15.84:0/2260808840 >> v2:172.21.15.161:3300/0 conn(0x7f27d406e030 0x7f27d415aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27d9a00640 1 --2- 172.21.15.84:0/2260808840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d4151620 0x7f27d406daf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f27d40b2cc0 tx=0x7f27c801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94402e35b264d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27d3e00640 1 -- 172.21.15.84:0/2260808840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80a55f0 con 0x7f27d4151620 2024-03-07T07:34:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27d3e00640 1 -- 172.21.15.84:0/2260808840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80a5790 con 0x7f27d4151620 2024-03-07T07:34:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27d3e00640 1 -- 172.21.15.84:0/2260808840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80a5b60 con 0x7f27d4151620 2024-03-07T07:34:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 -- 172.21.15.84:0/2260808840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d4151620 msgr2=0x7f27d406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 --2- 172.21.15.84:0/2260808840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d4151620 0x7f27d406daf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f27d40b2cc0 tx=0x7f27c801c9f0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 -- 172.21.15.84:0/2260808840 shutdown_connections 2024-03-07T07:34:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 --2- 172.21.15.84:0/2260808840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d415af80 0x7f27d40704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 --2- 172.21.15.84:0/2260808840 >> v2:172.21.15.161:3300/0 conn(0x7f27d406e030 0x7f27d415aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 --2- 172.21.15.84:0/2260808840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d4151620 0x7f27d406daf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 -- 172.21.15.84:0/2260808840 >> 172.21.15.84:0/2260808840 conn(0x7f27d406c2d0 msgr2=0x7f27d40b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 -- 172.21.15.84:0/2260808840 shutdown_connections 2024-03-07T07:34:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.862+0000 7f27dc400640 1 -- 172.21.15.84:0/2260808840 wait complete. 2024-03-07T07:34:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 Processor -- start 2024-03-07T07:34:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 -- start start 2024-03-07T07:34:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d406e030 0x7f27d413cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d4151620 0x7f27d4146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27d415af80 0x7f27d4147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40709f0 con 0x7f27d406e030 2024-03-07T07:34:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d415b5a0 con 0x7f27d415af80 2024-03-07T07:34:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4070b70 con 0x7f27d4151620 2024-03-07T07:34:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d406e030 0x7f27d413cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d406e030 0x7f27d413cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40328/0 (socket says 172.21.15.84:40328) 2024-03-07T07:34:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 -- 172.21.15.84:0/1461023469 learned_addr learned my addr 172.21.15.84:0/1461023469 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27da400640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27d415af80 0x7f27d4147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9000640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d4151620 0x7f27d4146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 -- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d4151620 msgr2=0x7f27d4146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d4151620 0x7f27d4146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 -- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27d415af80 msgr2=0x7f27d4147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27d415af80 0x7f27d4147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 -- 172.21.15.84:0/1461023469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40b4aa0 con 0x7f27d406e030 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27da400640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27d415af80 0x7f27d4147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9000640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27d4151620 0x7f27d4146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d9a00640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d406e030 0x7f27d413cd70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f27c801b0a0 tx=0x7f27c8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8009510 con 0x7f27d406e030 2024-03-07T07:34:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80be070 con 0x7f27d406e030 2024-03-07T07:34:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80b88d0 con 0x7f27d406e030 2024-03-07T07:34:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d40b4d80 con 0x7f27d406e030 2024-03-07T07:34:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.866+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d4142680 con 0x7f27d406e030 2024-03-07T07:34:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27d4164c30 con 0x7f27d406e030 2024-03-07T07:34:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f27c80b8a70 con 0x7f27d406e030 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27d1600640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f27b4066f60 0x7f27b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f27c81207b0 con 0x7f27d406e030 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27d9000640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f27b4066f60 0x7f27b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27d1600640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7f27b406ce20 0x7f27b406f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 --> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27c80c5e70 con 0x7f27b406ce20 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c8120c40 con 0x7f27d406e030 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27da400640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7f27b406ce20 0x7f27b406f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27d9000640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f27b4066f60 0x7f27b4069420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27d41f7da0 tx=0x7f27c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.870+0000 7f27da400640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7f27b406ce20 0x7f27b406f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.874+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 <== osd.4 v2:172.21.15.161:6800/2435467047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f27c80c5e70 con 0x7f27b406ce20 2024-03-07T07:34:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 --> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f27d4062d40 con 0x7f27b406ce20 2024-03-07T07:34:44.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27d1600640 1 -- 172.21.15.84:0/1461023469 <== osd.4 v2:172.21.15.161:6800/2435467047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f27d4062d40 con 0x7f27b406ce20 2024-03-07T07:34:44.887 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:34:44.888 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T07:34:44.888 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:34:44.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7f27b406ce20 msgr2=0x7f27b406f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.161:6800/2435467047,v1:172.21.15.161:6801/2435467047] conn(0x7f27b406ce20 0x7f27b406f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:44.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f27b4066f60 msgr2=0x7f27b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f27b4066f60 0x7f27b4069420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27d41f7da0 tx=0x7f27c0008040 comp rx=0 tx=0).stop 2024-03-07T07:34:44.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d406e030 msgr2=0x7f27d413cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:44.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 --2- 172.21.15.84:0/1461023469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d406e030 0x7f27d413cd70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f27c801b0a0 tx=0x7f27c8019790 comp rx=0 tx=0).stop 2024-03-07T07:34:44.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27da400640 1 -- 172.21.15.84:0/1461023469 reap_dead start 2024-03-07T07:34:44.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 shutdown_connections 2024-03-07T07:34:44.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 >> 172.21.15.84:0/1461023469 conn(0x7f27d406c2d0 msgr2=0x7f27d4151fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:44.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 shutdown_connections 2024-03-07T07:34:44.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:44.886+0000 7f27dc400640 1 -- 172.21.15.84:0/1461023469 wait complete. 2024-03-07T07:34:44.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-07T07:34:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.042+0000 7f077dc00640 1 Processor -- start 2024-03-07T07:34:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.042+0000 7f077dc00640 1 -- start start 2024-03-07T07:34:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.042+0000 7f077dc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778143dd0 0x7f07780cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.042+0000 7f077dc00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780cc880 con 0x7f07780730e0 2024-03-07T07:34:45.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.042+0000 7f077dc00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780ccb60 con 0x7f0778144360 2024-03-07T07:34:45.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.042+0000 7f077dc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07781441b0 con 0x7f0778143dd0 2024-03-07T07:34:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.042+0000 7f0777400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f07780730e0 0x7f077815b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46202/0 (socket says 172.21.15.84:46202) 2024-03-07T07:34:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.042+0000 7f0777400640 1 -- 172.21.15.84:0/3326806696 learned_addr learned my addr 172.21.15.84:0/3326806696 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0776a00640 1 --2- 172.21.15.84:0/3326806696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778143dd0 0x7f07780cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0775600640 1 -- 172.21.15.84:0/3326806696 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031209758 0 0) 0x7f07780cc880 con 0x7f07780730e0 2024-03-07T07:34:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0775600640 1 -- 172.21.15.84:0/3326806696 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f075c003530 con 0x7f07780730e0 2024-03-07T07:34:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0776a00640 1 -- 172.21.15.84:0/3326806696 >> v1:172.21.15.161:6789/0 conn(0x7f0778144360 legacy=0x7f07780729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0775600640 1 -- 172.21.15.84:0/3326806696 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866945328 0 0) 0x7f07780ccb60 con 0x7f0778144360 2024-03-07T07:34:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0776a00640 1 -- 172.21.15.84:0/3326806696 >> v1:172.21.15.84:6789/0 conn(0x7f07780730e0 legacy=0x7f077815b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0776a00640 1 -- 172.21.15.84:0/3326806696 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780cce40 con 0x7f0778143dd0 2024-03-07T07:34:45.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0776a00640 1 --2- 172.21.15.84:0/3326806696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778143dd0 0x7f07780cdc00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07680097f0 tx=0x7f076801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f18118ecdf2a87a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0775600640 1 -- 172.21.15.84:0/3326806696 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680ab5f0 con 0x7f0778143dd0 2024-03-07T07:34:45.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0775600640 1 -- 172.21.15.84:0/3326806696 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07680b0070 con 0x7f0778143dd0 2024-03-07T07:34:45.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.046+0000 7f0775600640 1 -- 172.21.15.84:0/3326806696 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680ab9b0 con 0x7f0778143dd0 2024-03-07T07:34:45.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- 172.21.15.84:0/3326806696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778143dd0 msgr2=0x7f07780cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 --2- 172.21.15.84:0/3326806696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778143dd0 0x7f07780cdc00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07680097f0 tx=0x7f076801c4e0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- 172.21.15.84:0/3326806696 shutdown_connections 2024-03-07T07:34:45.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 --2- 172.21.15.84:0/3326806696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778143dd0 0x7f07780cdc00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- 172.21.15.84:0/3326806696 >> 172.21.15.84:0/3326806696 conn(0x7f07780704b0 msgr2=0x7f07780708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:45.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- 172.21.15.84:0/3326806696 shutdown_connections 2024-03-07T07:34:45.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- 172.21.15.84:0/3326806696 wait complete. 2024-03-07T07:34:45.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 Processor -- start 2024-03-07T07:34:45.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- start start 2024-03-07T07:34:45.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07780730e0 0x7f077815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0778143dd0 0x7f0778138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778144360 0x7f07780b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077815c0b0 con 0x7f07780730e0 2024-03-07T07:34:45.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077815bf30 con 0x7f0778143dd0 2024-03-07T07:34:45.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f077dc00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0778169180 con 0x7f0778144360 2024-03-07T07:34:45.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07780730e0 0x7f077815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07780730e0 0x7f077815aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40330/0 (socket says 172.21.15.84:40330) 2024-03-07T07:34:45.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 -- 172.21.15.84:0/1885580896 learned_addr learned my addr 172.21.15.84:0/1885580896 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:45.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 -- 172.21.15.84:0/1885580896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778144360 msgr2=0x7f07780b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778144360 0x7f07780b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 -- 172.21.15.84:0/1885580896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0778143dd0 msgr2=0x7f0778138f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0778143dd0 0x7f0778138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 -- 172.21.15.84:0/1885580896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780b07d0 con 0x7f07780730e0 2024-03-07T07:34:45.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.050+0000 7f0776a00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07780730e0 0x7f077815aa30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f07680ad040 tx=0x7f076801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f076ea00640 1 -- 172.21.15.84:0/1885580896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680bf410 con 0x7f07780730e0 2024-03-07T07:34:45.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f076ea00640 1 -- 172.21.15.84:0/1885580896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07680bf5b0 con 0x7f07780730e0 2024-03-07T07:34:45.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0778131140 con 0x7f07780730e0 2024-03-07T07:34:45.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f076ea00640 1 -- 172.21.15.84:0/1885580896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680bf980 con 0x7f07780730e0 2024-03-07T07:34:45.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07781313e0 con 0x7f07780730e0 2024-03-07T07:34:45.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0778062d40 con 0x7f07780730e0 2024-03-07T07:34:45.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f076ea00640 1 -- 172.21.15.84:0/1885580896 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f07680bd020 con 0x7f07780730e0 2024-03-07T07:34:45.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f076ea00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0758066f90 0x7f0758069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f076ea00640 1 -- 172.21.15.84:0/1885580896 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f076811f070 con 0x7f07780730e0 2024-03-07T07:34:45.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f0776000640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0758066f90 0x7f0758069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.054+0000 7f0776000640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0758066f90 0x7f0758069450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0764007fd0 tx=0x7f0764007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.058+0000 7f076ea00640 1 -- 172.21.15.84:0/1885580896 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f07680160d0 con 0x7f07780730e0 2024-03-07T07:34:45.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.218+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f077815b1f0 con 0x7f0758066f90 2024-03-07T07:34:45.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f076ea00640 1 -- 172.21.15.84:0/1885580896 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f077815b1f0 con 0x7f0758066f90 2024-03-07T07:34:45.222 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 4 to deep-scrub 2024-03-07T07:34:45.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0758066f90 msgr2=0x7f0758069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0758066f90 0x7f0758069450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0764007fd0 tx=0x7f0764007940 comp rx=0 tx=0).stop 2024-03-07T07:34:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07780730e0 msgr2=0x7f077815aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07780730e0 0x7f077815aa30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f07680ad040 tx=0x7f076801ad20 comp rx=0 tx=0).stop 2024-03-07T07:34:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 shutdown_connections 2024-03-07T07:34:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f0758066f90 0x7f0758069450 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0778144360 0x7f07780b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0778143dd0 0x7f0778138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 --2- 172.21.15.84:0/1885580896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07780730e0 0x7f077815aa30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 >> 172.21.15.84:0/1885580896 conn(0x7f07780704b0 msgr2=0x7f07780719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 shutdown_connections 2024-03-07T07:34:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.222+0000 7f077dc00640 1 -- 172.21.15.84:0/1885580896 wait complete. 2024-03-07T07:34:45.242 INFO:tasks.ceph:Scrubbing osd.5 2024-03-07T07:34:45.242 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-07T07:34:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.378+0000 7f7952600640 1 Processor -- start 2024-03-07T07:34:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.378+0000 7f7952600640 1 -- start start 2024-03-07T07:34:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f7952600640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f794c164d90 0x7f794c167180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f7952600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0d1de0 con 0x7f794c15f6c0 2024-03-07T07:34:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f7952600640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0c8960 con 0x7f794c0d1800 2024-03-07T07:34:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f7952600640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0d1060 con 0x7f794c164d90 2024-03-07T07:34:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794b400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f794c15f6c0 0x7f794c0d0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46210/0 (socket says 172.21.15.84:46210) 2024-03-07T07:34:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794b400640 1 -- 172.21.15.84:0/4259959742 learned_addr learned my addr 172.21.15.84:0/4259959742 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794be00640 1 --2- 172.21.15.84:0/4259959742 >> v2:172.21.15.161:3300/0 conn(0x7f794c164d90 0x7f794c167180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942819639 0 0) 0x7f794c0d1de0 con 0x7f794c15f6c0 2024-03-07T07:34:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7930003530 con 0x7f794c15f6c0 2024-03-07T07:34:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 176128517 0 0) 0x7f7930003530 con 0x7f794c15f6c0 2024-03-07T07:34:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 >> v2:172.21.15.161:3300/0 conn(0x7f794c164d90 msgr2=0x7f794c167180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 --2- 172.21.15.84:0/4259959742 >> v2:172.21.15.161:3300/0 conn(0x7f794c164d90 0x7f794c167180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 >> v1:172.21.15.161:6789/0 conn(0x7f794c0d1800 legacy=0x7f794c06bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0c8c40 con 0x7f794c15f6c0 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121013454 0 0) 0x7f793c001680 con 0x7f794c15f6c0 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 >> v1:172.21.15.84:6789/0 conn(0x7f794c15f6c0 legacy=0x7f794c0d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7930003a10 0x7f7930003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930004810 0x7f7930004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7930005220 0x7f793000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793000c140 con 0x7f7930005220 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793000c2f0 con 0x7f7930004810 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793000c4f0 con 0x7f7930003a10 2024-03-07T07:34:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794be00640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7930005220 0x7f793000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794b400640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7930003a10 0x7f7930003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794aa00640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930004810 0x7f7930004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794be00640 1 -- 172.21.15.84:0/4259959742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7930003a10 msgr2=0x7f7930003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794be00640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7930003a10 0x7f7930003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794be00640 1 -- 172.21.15.84:0/4259959742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930004810 msgr2=0x7f7930004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794be00640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930004810 0x7f7930004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.382+0000 7f794be00640 1 -- 172.21.15.84:0/4259959742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7930003530 con 0x7f7930005220 2024-03-07T07:34:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f794be00640 1 -- 172.21.15.84:0/4259959742 reap_dead start 2024-03-07T07:34:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f794be00640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7930005220 0x7f793000b9d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f794c06e670 tx=0x7f794401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cb9a8166ec9f9f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944009c10 con 0x7f7930005220 2024-03-07T07:34:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7944003ba0 con 0x7f7930005220 2024-03-07T07:34:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f794a000640 1 -- 172.21.15.84:0/4259959742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440a5960 con 0x7f7930005220 2024-03-07T07:34:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f7952600640 1 -- 172.21.15.84:0/4259959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7930005220 msgr2=0x7f793000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f7952600640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7930005220 0x7f793000b9d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f794c06e670 tx=0x7f794401cc60 comp rx=0 tx=0).stop 2024-03-07T07:34:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f7952600640 1 -- 172.21.15.84:0/4259959742 shutdown_connections 2024-03-07T07:34:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f7952600640 1 --2- 172.21.15.84:0/4259959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7930005220 0x7f793000b9d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f7952600640 1 -- 172.21.15.84:0/4259959742 >> 172.21.15.84:0/4259959742 conn(0x7f794c0b3c10 msgr2=0x7f794c0b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f7952600640 1 -- 172.21.15.84:0/4259959742 shutdown_connections 2024-03-07T07:34:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.386+0000 7f7952600640 1 -- 172.21.15.84:0/4259959742 wait complete. 2024-03-07T07:34:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 Processor -- start 2024-03-07T07:34:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 -- start start 2024-03-07T07:34:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930005220 0x7f794c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794c159e10 0x7f794c1f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f794c1f4120 0x7f794c1f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c15faa0 con 0x7f794c159e10 2024-03-07T07:34:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0d1c60 con 0x7f7930005220 2024-03-07T07:34:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0b4a90 con 0x7f794c1f4120 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794c159e10 0x7f794c1f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794c159e10 0x7f794c1f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40346/0 (socket says 172.21.15.84:40346) 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 -- 172.21.15.84:0/2946256372 learned_addr learned my addr 172.21.15.84:0/2946256372 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794b400640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930005220 0x7f794c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 -- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f794c1f4120 msgr2=0x7f794c1f45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f794c1f4120 0x7f794c1f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 -- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930005220 msgr2=0x7f794c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930005220 0x7f794c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 -- 172.21.15.84:0/2946256372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c15a640 con 0x7f794c159e10 2024-03-07T07:34:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794b400640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7930005220 0x7f794c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f794aa00640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794c159e10 0x7f794c1f3be0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f793800f620 tx=0x7f793800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380052e0 con 0x7f794c159e10 2024-03-07T07:34:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7938018070 con 0x7f794c159e10 2024-03-07T07:34:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938003820 con 0x7f794c159e10 2024-03-07T07:34:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c15a920 con 0x7f794c159e10 2024-03-07T07:34:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c15aee0 con 0x7f794c159e10 2024-03-07T07:34:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.390+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f794c1f4af0 con 0x7f794c159e10 2024-03-07T07:34:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f79380039c0 con 0x7f794c159e10 2024-03-07T07:34:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f7943400640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f792c066f60 0x7f792c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7938085520 con 0x7f794c159e10 2024-03-07T07:34:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f794b400640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f792c066f60 0x7f792c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f7943400640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f792c06ce20 0x7f792c06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 --> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f793801ee50 con 0x7f792c06ce20 2024-03-07T07:34:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79380858d0 con 0x7f794c159e10 2024-03-07T07:34:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f794be00640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f792c06ce20 0x7f792c06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f794b400640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f792c066f60 0x7f792c069420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f793c000c10 tx=0x7f793c001bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f794be00640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f792c06ce20 0x7f792c06f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.394+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 <== osd.5 v2:172.21.15.161:6824/300876994 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f793801ee50 con 0x7f792c06ce20 2024-03-07T07:34:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 --> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f794c062d40 con 0x7f792c06ce20 2024-03-07T07:34:45.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7943400640 1 -- 172.21.15.84:0/2946256372 <== osd.5 v2:172.21.15.161:6824/300876994 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f794c062d40 con 0x7f792c06ce20 2024-03-07T07:34:45.411 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:34:45.411 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T07:34:45.411 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:34:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f792c06ce20 msgr2=0x7f792c06f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.161:6824/300876994,v1:172.21.15.161:6825/300876994] conn(0x7f792c06ce20 0x7f792c06f240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f792c066f60 msgr2=0x7f792c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f792c066f60 0x7f792c069420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f793c000c10 tx=0x7f793c001bb0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794c159e10 msgr2=0x7f794c1f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 --2- 172.21.15.84:0/2946256372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794c159e10 0x7f794c1f3be0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f793800f620 tx=0x7f793800fae0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f794be00640 1 -- 172.21.15.84:0/2946256372 reap_dead start 2024-03-07T07:34:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 shutdown_connections 2024-03-07T07:34:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 >> 172.21.15.84:0/2946256372 conn(0x7f794c0b3c10 msgr2=0x7f794c155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 shutdown_connections 2024-03-07T07:34:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.410+0000 7f7952600640 1 -- 172.21.15.84:0/2946256372 wait complete. 2024-03-07T07:34:45.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-07T07:34:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.562+0000 7fba17200640 1 Processor -- start 2024-03-07T07:34:45.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.562+0000 7fba17200640 1 -- start start 2024-03-07T07:34:45.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba17200640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba10143dd0 0x7fba100cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba17200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100cc880 con 0x7fba100730e0 2024-03-07T07:34:45.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba17200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100ccb60 con 0x7fba10144360 2024-03-07T07:34:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba17200640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba101441b0 con 0x7fba10143dd0 2024-03-07T07:34:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba15200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fba100730e0 0x7fba1015b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46218/0 (socket says 172.21.15.84:46218) 2024-03-07T07:34:45.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba15200640 1 -- 172.21.15.84:0/2220952607 learned_addr learned my addr 172.21.15.84:0/2220952607 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:45.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba0fe00640 1 --2- 172.21.15.84:0/2220952607 >> v2:172.21.15.161:3300/0 conn(0x7fba10143dd0 0x7fba100cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba0f400640 1 -- 172.21.15.84:0/2220952607 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912505278 0 0) 0x7fba100cc880 con 0x7fba100730e0 2024-03-07T07:34:45.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba0f400640 1 -- 172.21.15.84:0/2220952607 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f4003530 con 0x7fba100730e0 2024-03-07T07:34:45.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba0fe00640 1 -- 172.21.15.84:0/2220952607 >> v1:172.21.15.161:6789/0 conn(0x7fba10144360 legacy=0x7fba100729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba0fe00640 1 -- 172.21.15.84:0/2220952607 >> v1:172.21.15.84:6789/0 conn(0x7fba100730e0 legacy=0x7fba1015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.566+0000 7fba0fe00640 1 -- 172.21.15.84:0/2220952607 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100cce40 con 0x7fba10143dd0 2024-03-07T07:34:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba0fe00640 1 --2- 172.21.15.84:0/2220952607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10143dd0 0x7fba100cdc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba000097c0 tx=0x7fba0001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9376108a0ad16e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba0f400640 1 -- 172.21.15.84:0/2220952607 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000b1070 con 0x7fba10143dd0 2024-03-07T07:34:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba0f400640 1 -- 172.21.15.84:0/2220952607 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba000ac410 con 0x7fba10143dd0 2024-03-07T07:34:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba0f400640 1 -- 172.21.15.84:0/2220952607 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000ac7e0 con 0x7fba10143dd0 2024-03-07T07:34:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- 172.21.15.84:0/2220952607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10143dd0 msgr2=0x7fba100cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 --2- 172.21.15.84:0/2220952607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10143dd0 0x7fba100cdc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba000097c0 tx=0x7fba0001c4a0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- 172.21.15.84:0/2220952607 shutdown_connections 2024-03-07T07:34:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 --2- 172.21.15.84:0/2220952607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10143dd0 0x7fba100cdc00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- 172.21.15.84:0/2220952607 >> 172.21.15.84:0/2220952607 conn(0x7fba100704b0 msgr2=0x7fba100708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- 172.21.15.84:0/2220952607 shutdown_connections 2024-03-07T07:34:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- 172.21.15.84:0/2220952607 wait complete. 2024-03-07T07:34:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 Processor -- start 2024-03-07T07:34:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- start start 2024-03-07T07:34:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba100730e0 0x7fba10157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba10143dd0 0x7fba10139900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10144360 0x7fba10142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1015c0b0 con 0x7fba100730e0 2024-03-07T07:34:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1015bf30 con 0x7fba10144360 2024-03-07T07:34:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba17200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba10169180 con 0x7fba10143dd0 2024-03-07T07:34:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba100730e0 0x7fba10157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba100730e0 0x7fba10157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40362/0 (socket says 172.21.15.84:40362) 2024-03-07T07:34:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.570+0000 7fba0fe00640 1 -- 172.21.15.84:0/4086439673 learned_addr learned my addr 172.21.15.84:0/4086439673 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba15200640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10144360 0x7fba10142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba07e00640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba10143dd0 0x7fba10139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0fe00640 1 -- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba10143dd0 msgr2=0x7fba10139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0fe00640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba10143dd0 0x7fba10139900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0fe00640 1 -- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10144360 msgr2=0x7fba10142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0fe00640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10144360 0x7fba10142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0fe00640 1 -- 172.21.15.84:0/4086439673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100af8c0 con 0x7fba100730e0 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba15200640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10144360 0x7fba10142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba07e00640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba10143dd0 0x7fba10139900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0fe00640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba100730e0 0x7fba10157760 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fba0001a0d0 tx=0x7fba00019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0cc00640 1 -- 172.21.15.84:0/4086439673 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000b1040 con 0x7fba100730e0 2024-03-07T07:34:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0cc00640 1 -- 172.21.15.84:0/4086439673 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba000bb070 con 0x7fba100730e0 2024-03-07T07:34:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0cc00640 1 -- 172.21.15.84:0/4086439673 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000b5430 con 0x7fba100730e0 2024-03-07T07:34:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba100b2d00 con 0x7fba100730e0 2024-03-07T07:34:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba10156c80 con 0x7fba100730e0 2024-03-07T07:34:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba10062d40 con 0x7fba100730e0 2024-03-07T07:34:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0cc00640 1 -- 172.21.15.84:0/4086439673 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fba000b55d0 con 0x7fba100730e0 2024-03-07T07:34:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0cc00640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb9ec066f60 0x7fb9ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba0cc00640 1 -- 172.21.15.84:0/4086439673 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba0011e790 con 0x7fba100730e0 2024-03-07T07:34:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.574+0000 7fba07e00640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb9ec066f60 0x7fb9ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.578+0000 7fba07e00640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb9ec066f60 0x7fb9ec069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba10155930 tx=0x7fb9f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.578+0000 7fba0cc00640 1 -- 172.21.15.84:0/4086439673 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fba00016090 con 0x7fba100730e0 2024-03-07T07:34:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fba10139e40 con 0x7fb9ec066f60 2024-03-07T07:34:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba0cc00640 1 -- 172.21.15.84:0/4086439673 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fba10139e40 con 0x7fb9ec066f60 2024-03-07T07:34:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 5 to deep-scrub 2024-03-07T07:34:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb9ec066f60 msgr2=0x7fb9ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb9ec066f60 0x7fb9ec069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba10155930 tx=0x7fb9f8009040 comp rx=0 tx=0).stop 2024-03-07T07:34:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba100730e0 msgr2=0x7fba10157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba100730e0 0x7fba10157760 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fba0001a0d0 tx=0x7fba00019240 comp rx=0 tx=0).stop 2024-03-07T07:34:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 shutdown_connections 2024-03-07T07:34:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb9ec066f60 0x7fb9ec069420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba10144360 0x7fba10142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba10143dd0 0x7fba10139900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 --2- 172.21.15.84:0/4086439673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba100730e0 0x7fba10157760 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 >> 172.21.15.84:0/4086439673 conn(0x7fba100704b0 msgr2=0x7fba100b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:45.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 shutdown_connections 2024-03-07T07:34:45.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.734+0000 7fba17200640 1 -- 172.21.15.84:0/4086439673 wait complete. 2024-03-07T07:34:45.755 INFO:tasks.ceph:Scrubbing osd.6 2024-03-07T07:34:45.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-07T07:34:45.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.890+0000 7fb279c00640 1 Processor -- start 2024-03-07T07:34:45.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb279c00640 1 -- start start 2024-03-07T07:34:45.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb279c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb27415bd40 0x7fb2740cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb279c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2740b56a0 0x7fb27415c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb279c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2740cdb70 con 0x7fb274160520 2024-03-07T07:34:45.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb279c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2740cde50 con 0x7fb27415bd40 2024-03-07T07:34:45.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb279c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27415fa40 con 0x7fb2740b56a0 2024-03-07T07:34:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb273e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb27415bd40 0x7fb2740cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb273400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb274160520 0x7fb2740b4f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46232/0 (socket says 172.21.15.84:46232) 2024-03-07T07:34:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb273400640 1 -- 172.21.15.84:0/43751946 learned_addr learned my addr 172.21.15.84:0/43751946 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb279200640 1 --2- 172.21.15.84:0/43751946 >> v2:172.21.15.161:3300/0 conn(0x7fb2740b56a0 0x7fb27415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb273e00640 1 -- 172.21.15.84:0/43751946 >> v2:172.21.15.161:3300/0 conn(0x7fb2740b56a0 msgr2=0x7fb27415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb273e00640 1 --2- 172.21.15.84:0/43751946 >> v2:172.21.15.161:3300/0 conn(0x7fb2740b56a0 0x7fb27415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb273e00640 1 -- 172.21.15.84:0/43751946 >> v1:172.21.15.84:6789/0 conn(0x7fb274160520 legacy=0x7fb2740b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb272a00640 1 -- 172.21.15.84:0/43751946 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368249892 0 0) 0x7fb2740cdb70 con 0x7fb274160520 2024-03-07T07:34:45.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb273e00640 1 -- 172.21.15.84:0/43751946 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27415fd20 con 0x7fb27415bd40 2024-03-07T07:34:45.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.894+0000 7fb279200640 1 --2- 172.21.15.84:0/43751946 >> v2:172.21.15.161:3300/0 conn(0x7fb2740b56a0 0x7fb27415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T07:34:45.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb273e00640 1 --2- 172.21.15.84:0/43751946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb27415bd40 0x7fb2740cd200 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb2740cfba0 tx=0x7fb26401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71d5383d03a2db6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb272a00640 1 -- 172.21.15.84:0/43751946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640b2070 con 0x7fb27415bd40 2024-03-07T07:34:45.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb272a00640 1 -- 172.21.15.84:0/43751946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2640a59e0 con 0x7fb27415bd40 2024-03-07T07:34:45.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb272a00640 1 -- 172.21.15.84:0/43751946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640a5db0 con 0x7fb27415bd40 2024-03-07T07:34:45.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 -- 172.21.15.84:0/43751946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb27415bd40 msgr2=0x7fb2740cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 --2- 172.21.15.84:0/43751946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb27415bd40 0x7fb2740cd200 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb2740cfba0 tx=0x7fb26401c900 comp rx=0 tx=0).stop 2024-03-07T07:34:45.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 -- 172.21.15.84:0/43751946 shutdown_connections 2024-03-07T07:34:45.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 --2- 172.21.15.84:0/43751946 >> v2:172.21.15.161:3300/0 conn(0x7fb2740b56a0 0x7fb27415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 --2- 172.21.15.84:0/43751946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb27415bd40 0x7fb2740cd200 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 -- 172.21.15.84:0/43751946 >> 172.21.15.84:0/43751946 conn(0x7fb274071900 msgr2=0x7fb274071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:45.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 -- 172.21.15.84:0/43751946 shutdown_connections 2024-03-07T07:34:45.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 -- 172.21.15.84:0/43751946 wait complete. 2024-03-07T07:34:45.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 Processor -- start 2024-03-07T07:34:45.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.898+0000 7fb279c00640 1 -- start start 2024-03-07T07:34:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2740b56a0 0x7fb27414a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb27415bd40 0x7fb27414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb274160520 0x7fb274134d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb274168a30 con 0x7fb274160520 2024-03-07T07:34:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27415d0c0 con 0x7fb2740b56a0 2024-03-07T07:34:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb274168bb0 con 0x7fb27415bd40 2024-03-07T07:34:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb274160520 0x7fb274134d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb274160520 0x7fb274134d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40374/0 (socket says 172.21.15.84:40374) 2024-03-07T07:34:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 -- 172.21.15.84:0/925824252 learned_addr learned my addr 172.21.15.84:0/925824252 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb273400640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb27415bd40 0x7fb27414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb273e00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2740b56a0 0x7fb27414a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 -- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb27415bd40 msgr2=0x7fb27414dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb27415bd40 0x7fb27414dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 -- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2740b56a0 msgr2=0x7fb27414a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2740b56a0 0x7fb27414a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 -- 172.21.15.84:0/925824252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274149790 con 0x7fb274160520 2024-03-07T07:34:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb273e00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2740b56a0 0x7fb27414a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279200640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb274160520 0x7fb274134d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00c7f0 tx=0x7fb26c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c015070 con 0x7fb274160520 2024-03-07T07:34:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c007860 con 0x7fb274160520 2024-03-07T07:34:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c007c50 con 0x7fb274160520 2024-03-07T07:34:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb274149a70 con 0x7fb274160520 2024-03-07T07:34:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27414a030 con 0x7fb274160520 2024-03-07T07:34:45.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb27414e730 con 0x7fb274160520 2024-03-07T07:34:45.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.902+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fb26c018070 con 0x7fb274160520 2024-03-07T07:34:45.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb26be00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb254066f60 0x7fb254069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb26c084f40 con 0x7fb274160520 2024-03-07T07:34:45.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb273e00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb254066f60 0x7fb254069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb26be00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7fb25406ce20 0x7fb25406f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:45.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 --> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb26c01ee50 con 0x7fb25406ce20 2024-03-07T07:34:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb26c087560 con 0x7fb274160520 2024-03-07T07:34:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb273400640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7fb25406ce20 0x7fb25406f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb273e00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb254066f60 0x7fb254069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2640af000 tx=0x7fb2640a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb273400640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7fb25406ce20 0x7fb25406f240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.906+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 <== osd.6 v2:172.21.15.161:6802/878445946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb26c01ee50 con 0x7fb25406ce20 2024-03-07T07:34:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.918+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 --> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb274071f30 con 0x7fb25406ce20 2024-03-07T07:34:45.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb26be00640 1 -- 172.21.15.84:0/925824252 <== osd.6 v2:172.21.15.161:6802/878445946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb274071f30 con 0x7fb25406ce20 2024-03-07T07:34:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:34:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T07:34:45.922 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:34:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7fb25406ce20 msgr2=0x7fb25406f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.161:6802/878445946,v1:172.21.15.161:6804/878445946] conn(0x7fb25406ce20 0x7fb25406f240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb254066f60 msgr2=0x7fb254069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fb254066f60 0x7fb254069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2640af000 tx=0x7fb2640a7070 comp rx=0 tx=0).stop 2024-03-07T07:34:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb274160520 msgr2=0x7fb274134d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 --2- 172.21.15.84:0/925824252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb274160520 0x7fb274134d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00c7f0 tx=0x7fb26c00ccb0 comp rx=0 tx=0).stop 2024-03-07T07:34:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279200640 1 -- 172.21.15.84:0/925824252 reap_dead start 2024-03-07T07:34:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 shutdown_connections 2024-03-07T07:34:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 >> 172.21.15.84:0/925824252 conn(0x7fb274071900 msgr2=0x7fb27415eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 shutdown_connections 2024-03-07T07:34:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:45.922+0000 7fb279c00640 1 -- 172.21.15.84:0/925824252 wait complete. 2024-03-07T07:34:45.939 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-07T07:34:46.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c3ac00640 1 Processor -- start 2024-03-07T07:34:46.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c3ac00640 1 -- start start 2024-03-07T07:34:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c3ac00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5c34147a10 0x7f5c340b6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c3ac00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c3406eae0 0x7f5c34072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c3ac00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c34147df0 con 0x7f5c341623e0 2024-03-07T07:34:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c3ac00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c34071bf0 con 0x7f5c34147a10 2024-03-07T07:34:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c3ac00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c340712c0 con 0x7f5c3406eae0 2024-03-07T07:34:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c33e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5c34147a10 0x7f5c340b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c2b400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5c341623e0 0x7f5c3406e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46238/0 (socket says 172.21.15.84:46238) 2024-03-07T07:34:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c2b400640 1 -- 172.21.15.84:0/2380217216 learned_addr learned my addr 172.21.15.84:0/2380217216 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:46.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c38c00640 1 --2- 172.21.15.84:0/2380217216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c3406eae0 0x7f5c34072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c33e00640 1 -- 172.21.15.84:0/2380217216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c3406eae0 msgr2=0x7f5c34072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:46.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c33e00640 1 --2- 172.21.15.84:0/2380217216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c3406eae0 0x7f5c34072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c33e00640 1 -- 172.21.15.84:0/2380217216 >> v1:172.21.15.84:6789/0 conn(0x7f5c341623e0 legacy=0x7f5c3406e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.074+0000 7f5c33e00640 1 -- 172.21.15.84:0/2380217216 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340715a0 con 0x7f5c34147a10 2024-03-07T07:34:46.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c33e00640 1 --2- 172.21.15.84:0/2380217216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c34147a10 0x7f5c340b6320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5c240097c0 tx=0x7f5c2401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47934e19918cefe3 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c33400640 1 -- 172.21.15.84:0/2380217216 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c240ab600 con 0x7f5c34147a10 2024-03-07T07:34:46.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c33400640 1 -- 172.21.15.84:0/2380217216 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c240b0070 con 0x7f5c34147a10 2024-03-07T07:34:46.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c33400640 1 -- 172.21.15.84:0/2380217216 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c240ab9c0 con 0x7f5c34147a10 2024-03-07T07:34:46.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2380217216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c34147a10 msgr2=0x7f5c340b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2380217216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c34147a10 0x7f5c340b6320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5c240097c0 tx=0x7f5c2401c3e0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2380217216 shutdown_connections 2024-03-07T07:34:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2380217216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c3406eae0 0x7f5c34072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2380217216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c34147a10 0x7f5c340b6320 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2380217216 >> 172.21.15.84:0/2380217216 conn(0x7f5c3406b0f0 msgr2=0x7f5c3406b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2380217216 shutdown_connections 2024-03-07T07:34:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.078+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2380217216 wait complete. 2024-03-07T07:34:46.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 Processor -- start 2024-03-07T07:34:46.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 -- start start 2024-03-07T07:34:46.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c3406eae0 0x7f5c341400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c34147a10 0x7f5c3413e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c341623e0 0x7f5c3413ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34072dd0 con 0x7f5c341623e0 2024-03-07T07:34:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34162a00 con 0x7f5c3406eae0 2024-03-07T07:34:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34072f50 con 0x7f5c34147a10 2024-03-07T07:34:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c341623e0 0x7f5c3413ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c341623e0 0x7f5c3413ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40398/0 (socket says 172.21.15.84:40398) 2024-03-07T07:34:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 -- 172.21.15.84:0/2363537129 learned_addr learned my addr 172.21.15.84:0/2363537129 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c2b400640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c34147a10 0x7f5c3413e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c33e00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c3406eae0 0x7f5c341400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 -- 172.21.15.84:0/2363537129 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c34147a10 msgr2=0x7f5c3413e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c34147a10 0x7f5c3413e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 -- 172.21.15.84:0/2363537129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c3406eae0 msgr2=0x7f5c341400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c3406eae0 0x7f5c341400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 -- 172.21.15.84:0/2363537129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3415c690 con 0x7f5c341623e0 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c38c00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c341623e0 0x7f5c3413ee70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c007e70 tx=0x7f5c2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c30c00640 1 -- 172.21.15.84:0/2363537129 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c014620 con 0x7f5c341623e0 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c30c00640 1 -- 172.21.15.84:0/2363537129 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c019070 con 0x7f5c341623e0 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c30c00640 1 -- 172.21.15.84:0/2363537129 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c014a20 con 0x7f5c341623e0 2024-03-07T07:34:46.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3415d3d0 con 0x7f5c341623e0 2024-03-07T07:34:46.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.082+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3415d990 con 0x7f5c341623e0 2024-03-07T07:34:46.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.086+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3415dcc0 con 0x7f5c341623e0 2024-03-07T07:34:46.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.086+0000 7f5c30c00640 1 -- 172.21.15.84:0/2363537129 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f5c2c014bc0 con 0x7f5c341623e0 2024-03-07T07:34:46.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.086+0000 7f5c30c00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5c10066f60 0x7f5c10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.086+0000 7f5c30c00640 1 -- 172.21.15.84:0/2363537129 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c2c0854d0 con 0x7f5c341623e0 2024-03-07T07:34:46.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.086+0000 7f5c33e00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5c10066f60 0x7f5c10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.086+0000 7f5c33e00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5c10066f60 0x7f5c10069420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5c240af000 tx=0x7f5c240a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.090+0000 7f5c30c00640 1 -- 172.21.15.84:0/2363537129 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f5c3415c690 con 0x7f5c341623e0 2024-03-07T07:34:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c34062d40 con 0x7f5c10066f60 2024-03-07T07:34:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c30c00640 1 -- 172.21.15.84:0/2363537129 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5c34062d40 con 0x7f5c10066f60 2024-03-07T07:34:46.247 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 6 to deep-scrub 2024-03-07T07:34:46.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5c10066f60 msgr2=0x7f5c10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5c10066f60 0x7f5c10069420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5c240af000 tx=0x7f5c240a7000 comp rx=0 tx=0).stop 2024-03-07T07:34:46.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c341623e0 msgr2=0x7f5c3413ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c341623e0 0x7f5c3413ee70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c007e70 tx=0x7f5c2c00e4b0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 shutdown_connections 2024-03-07T07:34:46.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f5c10066f60 0x7f5c10069420 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c341623e0 0x7f5c3413ee70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c34147a10 0x7f5c3413e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 --2- 172.21.15.84:0/2363537129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c3406eae0 0x7f5c341400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 >> 172.21.15.84:0/2363537129 conn(0x7f5c3406b0f0 msgr2=0x7f5c3413cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:46.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 shutdown_connections 2024-03-07T07:34:46.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.246+0000 7f5c3ac00640 1 -- 172.21.15.84:0/2363537129 wait complete. 2024-03-07T07:34:46.267 INFO:tasks.ceph:Scrubbing osd.7 2024-03-07T07:34:46.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-07T07:34:46.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79e7c00640 1 Processor -- start 2024-03-07T07:34:46.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79e7c00640 1 -- start start 2024-03-07T07:34:46.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79e7c00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f79e00d1800 0x7f79e006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79e7c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00d1de0 con 0x7f79e015f6c0 2024-03-07T07:34:46.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79e7c00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00c8960 con 0x7f79e006c2e0 2024-03-07T07:34:46.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79e7c00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00d1060 con 0x7f79e00d1800 2024-03-07T07:34:46.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79e5200640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f79e015f6c0 0x7f79e00d0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46252/0 (socket says 172.21.15.84:46252) 2024-03-07T07:34:46.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79e5200640 1 -- 172.21.15.84:0/1537218966 learned_addr learned my addr 172.21.15.84:0/1537218966 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:46.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79d7e00640 1 --2- 172.21.15.84:0/1537218966 >> v2:172.21.15.161:3300/0 conn(0x7f79e00d1800 0x7f79e006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79dfe00640 1 -- 172.21.15.84:0/1537218966 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588329918 0 0) 0x7f79e00d1de0 con 0x7f79e015f6c0 2024-03-07T07:34:46.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.406+0000 7f79dfe00640 1 -- 172.21.15.84:0/1537218966 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c4003530 con 0x7f79e015f6c0 2024-03-07T07:34:46.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79d7e00640 1 -- 172.21.15.84:0/1537218966 >> v1:172.21.15.161:6789/0 conn(0x7f79e006c2e0 legacy=0x7f79e00c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79dfe00640 1 -- 172.21.15.84:0/1537218966 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911280417 0 0) 0x7f79e00c8960 con 0x7f79e006c2e0 2024-03-07T07:34:46.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79d7e00640 1 -- 172.21.15.84:0/1537218966 >> v1:172.21.15.84:6789/0 conn(0x7f79e015f6c0 legacy=0x7f79e00d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79d7e00640 1 -- 172.21.15.84:0/1537218966 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00c8c40 con 0x7f79e00d1800 2024-03-07T07:34:46.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79d7e00640 1 --2- 172.21.15.84:0/1537218966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e00d1800 0x7f79e006bda0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79c80097c0 tx=0x7f79c801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f8831440e96165d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79dfe00640 1 -- 172.21.15.84:0/1537218966 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80b0070 con 0x7f79e00d1800 2024-03-07T07:34:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79dfe00640 1 -- 172.21.15.84:0/1537218966 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c80ab600 con 0x7f79e00d1800 2024-03-07T07:34:46.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79dfe00640 1 -- 172.21.15.84:0/1537218966 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80ab9d0 con 0x7f79e00d1800 2024-03-07T07:34:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79e7c00640 1 -- 172.21.15.84:0/1537218966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e00d1800 msgr2=0x7f79e006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.410+0000 7f79e7c00640 1 --2- 172.21.15.84:0/1537218966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e00d1800 0x7f79e006bda0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79c80097c0 tx=0x7f79c801c380 comp rx=0 tx=0).stop 2024-03-07T07:34:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 -- 172.21.15.84:0/1537218966 shutdown_connections 2024-03-07T07:34:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 --2- 172.21.15.84:0/1537218966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e00d1800 0x7f79e006bda0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 -- 172.21.15.84:0/1537218966 >> 172.21.15.84:0/1537218966 conn(0x7f79e00b3c10 msgr2=0x7f79e00b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 -- 172.21.15.84:0/1537218966 shutdown_connections 2024-03-07T07:34:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 -- 172.21.15.84:0/1537218966 wait complete. 2024-03-07T07:34:46.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 Processor -- start 2024-03-07T07:34:46.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 -- start start 2024-03-07T07:34:46.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79e006c2e0 0x7f79e0140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e00d1800 0x7f79e00aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e015f6c0 0x7f79e00af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0169dc0 con 0x7f79e00d1800 2024-03-07T07:34:46.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c8550 con 0x7f79e015f6c0 2024-03-07T07:34:46.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e7c00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0169f40 con 0x7f79e006c2e0 2024-03-07T07:34:46.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e00d1800 0x7f79e00aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e00d1800 0x7f79e00aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40410/0 (socket says 172.21.15.84:40410) 2024-03-07T07:34:46.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 -- 172.21.15.84:0/3291432323 learned_addr learned my addr 172.21.15.84:0/3291432323 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:46.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e5200640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79e006c2e0 0x7f79e0140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79e5c00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e015f6c0 0x7f79e00af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 -- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79e006c2e0 msgr2=0x7f79e0140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79e006c2e0 0x7f79e0140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 -- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e015f6c0 msgr2=0x7f79e00af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e015f6c0 0x7f79e00af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 -- 172.21.15.84:0/3291432323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00b13a0 con 0x7f79e00d1800 2024-03-07T07:34:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.414+0000 7f79d7e00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e00d1800 0x7f79e00aeef0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f79c80097c0 tx=0x7f79c8019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80b8070 con 0x7f79e00d1800 2024-03-07T07:34:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c8004020 con 0x7f79e00d1800 2024-03-07T07:34:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e00cd8d0 con 0x7f79e00d1800 2024-03-07T07:34:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80b0040 con 0x7f79e00d1800 2024-03-07T07:34:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e00cde90 con 0x7f79e00d1800 2024-03-07T07:34:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79e0062d40 con 0x7f79e00d1800 2024-03-07T07:34:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f79c8003620 con 0x7f79e00d1800 2024-03-07T07:34:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f79bc066f60 0x7f79bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f79c811ef10 con 0x7f79e00d1800 2024-03-07T07:34:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79e5200640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f79bc066f60 0x7f79bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7f79bc06ce20 0x7f79bc06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 --> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79c80b6e80 con 0x7f79bc06ce20 2024-03-07T07:34:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c811f2c0 con 0x7f79e00d1800 2024-03-07T07:34:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.418+0000 7f79e5c00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7f79bc06ce20 0x7f79bc06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.422+0000 7f79e5200640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f79bc066f60 0x7f79bc069420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f79d0005890 tx=0x7f79d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.422+0000 7f79e5c00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7f79bc06ce20 0x7f79bc06f240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.422+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 <== osd.7 v2:172.21.15.161:6816/2319772910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f79c80b6e80 con 0x7f79bc06ce20 2024-03-07T07:34:46.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 --> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79e015da70 con 0x7f79bc06ce20 2024-03-07T07:34:46.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79dd600640 1 -- 172.21.15.84:0/3291432323 <== osd.7 v2:172.21.15.161:6816/2319772910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f79e015da70 con 0x7f79bc06ce20 2024-03-07T07:34:46.437 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-07T07:34:46.437 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T07:34:46.437 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-07T07:34:46.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7f79bc06ce20 msgr2=0x7f79bc06f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.161:6816/2319772910,v1:172.21.15.161:6817/2319772910] conn(0x7f79bc06ce20 0x7f79bc06f240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f79bc066f60 msgr2=0x7f79bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f79bc066f60 0x7f79bc069420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f79d0005890 tx=0x7f79d0009040 comp rx=0 tx=0).stop 2024-03-07T07:34:46.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e00d1800 msgr2=0x7f79e00aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 --2- 172.21.15.84:0/3291432323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e00d1800 0x7f79e00aeef0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f79c80097c0 tx=0x7f79c8019120 comp rx=0 tx=0).stop 2024-03-07T07:34:46.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e5c00640 1 -- 172.21.15.84:0/3291432323 reap_dead start 2024-03-07T07:34:46.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 shutdown_connections 2024-03-07T07:34:46.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 >> 172.21.15.84:0/3291432323 conn(0x7f79e00b3c10 msgr2=0x7f79e00b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:46.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 shutdown_connections 2024-03-07T07:34:46.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.434+0000 7f79e7c00640 1 -- 172.21.15.84:0/3291432323 wait complete. 2024-03-07T07:34:46.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-07T07:34:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41a00640 1 Processor -- start 2024-03-07T07:34:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41a00640 1 -- start start 2024-03-07T07:34:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0d17c0 0x7faf3c141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf3c0b4b10 0x7faf3c15f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c142300 con 0x7faf3c0b7ae0 2024-03-07T07:34:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c13f0f0 con 0x7faf3c0b4b10 2024-03-07T07:34:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15c280 con 0x7faf3c0d17c0 2024-03-07T07:34:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf3c0b4b10 0x7faf3c15f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf3b400640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faf3c0b7ae0 0x7faf3c0b4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46264/0 (socket says 172.21.15.84:46264) 2024-03-07T07:34:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf3b400640 1 -- 172.21.15.84:0/2881543018 learned_addr learned my addr 172.21.15.84:0/2881543018 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf3be00640 1 --2- 172.21.15.84:0/2881543018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0d17c0 0x7faf3c141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41000640 1 -- 172.21.15.84:0/2881543018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0d17c0 msgr2=0x7faf3c141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41000640 1 --2- 172.21.15.84:0/2881543018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0d17c0 0x7faf3c141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41000640 1 -- 172.21.15.84:0/2881543018 >> v1:172.21.15.84:6789/0 conn(0x7faf3c0b7ae0 legacy=0x7faf3c0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf3aa00640 1 -- 172.21.15.84:0/2881543018 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888333856 0 0) 0x7faf3c142300 con 0x7faf3c0b7ae0 2024-03-07T07:34:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.590+0000 7faf41000640 1 -- 172.21.15.84:0/2881543018 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c15c4d0 con 0x7faf3c0b4b10 2024-03-07T07:34:46.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41000640 1 --2- 172.21.15.84:0/2881543018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c15f9d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faf34009d90 tx=0x7faf3401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4b6538c09af36c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf3aa00640 1 -- 172.21.15.84:0/2881543018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf340b2070 con 0x7faf3c0b4b10 2024-03-07T07:34:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf3aa00640 1 -- 172.21.15.84:0/2881543018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf340a5920 con 0x7faf3c0b4b10 2024-03-07T07:34:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf3aa00640 1 -- 172.21.15.84:0/2881543018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf340a5cf0 con 0x7faf3c0b4b10 2024-03-07T07:34:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 -- 172.21.15.84:0/2881543018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 msgr2=0x7faf3c15f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 --2- 172.21.15.84:0/2881543018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c15f9d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faf34009d90 tx=0x7faf3401c970 comp rx=0 tx=0).stop 2024-03-07T07:34:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 -- 172.21.15.84:0/2881543018 shutdown_connections 2024-03-07T07:34:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 --2- 172.21.15.84:0/2881543018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c15f9d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 --2- 172.21.15.84:0/2881543018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0d17c0 0x7faf3c141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 -- 172.21.15.84:0/2881543018 >> 172.21.15.84:0/2881543018 conn(0x7faf3c06b5c0 msgr2=0x7faf3c06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:46.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 -- 172.21.15.84:0/2881543018 shutdown_connections 2024-03-07T07:34:46.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 -- 172.21.15.84:0/2881543018 wait complete. 2024-03-07T07:34:46.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.594+0000 7faf41a00640 1 Processor -- start 2024-03-07T07:34:46.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 -- start start 2024-03-07T07:34:46.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c13b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0b7ae0 0x7faf3c150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf3c0d17c0 0x7faf3c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c168c70 con 0x7faf3c0b4b10 2024-03-07T07:34:46.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15d050 con 0x7faf3c0d17c0 2024-03-07T07:34:46.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c168df0 con 0x7faf3c0b7ae0 2024-03-07T07:34:46.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c13b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c13b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40418/0 (socket says 172.21.15.84:40418) 2024-03-07T07:34:46.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 -- 172.21.15.84:0/430911065 learned_addr learned my addr 172.21.15.84:0/430911065 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:46.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3b400640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0b7ae0 0x7faf3c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41000640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf3c0d17c0 0x7faf3c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 -- 172.21.15.84:0/430911065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0b7ae0 msgr2=0x7faf3c150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0b7ae0 0x7faf3c150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 -- 172.21.15.84:0/430911065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf3c0d17c0 msgr2=0x7faf3c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf3c0d17c0 0x7faf3c15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 -- 172.21.15.84:0/430911065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c150690 con 0x7faf3c0b4b10 2024-03-07T07:34:46.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf3be00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c13b180 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00e870 tx=0x7faf2c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf33e00640 1 -- 172.21.15.84:0/430911065 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c017070 con 0x7faf3c0b4b10 2024-03-07T07:34:46.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf33e00640 1 -- 172.21.15.84:0/430911065 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00c940 con 0x7faf3c0b4b10 2024-03-07T07:34:46.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf33e00640 1 -- 172.21.15.84:0/430911065 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00ccf0 con 0x7faf3c0b4b10 2024-03-07T07:34:46.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c13ddc0 con 0x7faf3c0b4b10 2024-03-07T07:34:46.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c13e380 con 0x7faf3c0b4b10 2024-03-07T07:34:46.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.598+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c062d40 con 0x7faf3c0b4b10 2024-03-07T07:34:46.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.602+0000 7faf33e00640 1 -- 172.21.15.84:0/430911065 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7faf2c01a070 con 0x7faf3c0b4b10 2024-03-07T07:34:46.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.602+0000 7faf33e00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faf1c066f60 0x7faf1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.602+0000 7faf33e00640 1 -- 172.21.15.84:0/430911065 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faf2c084c80 con 0x7faf3c0b4b10 2024-03-07T07:34:46.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.602+0000 7faf3b400640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faf1c066f60 0x7faf1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.602+0000 7faf3b400640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faf1c066f60 0x7faf1c069420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf3c072a50 tx=0x7faf28007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.606+0000 7faf33e00640 1 -- 172.21.15.84:0/430911065 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7faf3c150690 con 0x7faf3c0b4b10 2024-03-07T07:34:46.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.758+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7faf3c0d0980 con 0x7faf1c066f60 2024-03-07T07:34:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.758+0000 7faf33e00640 1 -- 172.21.15.84:0/430911065 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faf3c0d0980 con 0x7faf1c066f60 2024-03-07T07:34:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 7 to deep-scrub 2024-03-07T07:34:46.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faf1c066f60 msgr2=0x7faf1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faf1c066f60 0x7faf1c069420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf3c072a50 tx=0x7faf28007b60 comp rx=0 tx=0).stop 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 msgr2=0x7faf3c13b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c13b180 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00e870 tx=0x7faf2c00ec70 comp rx=0 tx=0).stop 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 shutdown_connections 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7faf1c066f60 0x7faf1c069420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf3c0d17c0 0x7faf3c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf3c0b7ae0 0x7faf3c150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 --2- 172.21.15.84:0/430911065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b4b10 0x7faf3c13b180 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 >> 172.21.15.84:0/430911065 conn(0x7faf3c06b5c0 msgr2=0x7faf3c0b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:46.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 shutdown_connections 2024-03-07T07:34:46.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.762+0000 7faf41a00640 1 -- 172.21.15.84:0/430911065 wait complete. 2024-03-07T07:34:46.782 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T07:34:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5aaa00640 1 Processor -- start 2024-03-07T07:34:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5aaa00640 1 -- start start 2024-03-07T07:34:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5aaa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a4071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5aaa00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe5a40d0c00 0x7fe5a40d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5aaa00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a4071be0 con 0x7fe5a4072c80 2024-03-07T07:34:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5aaa00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a40d15b0 con 0x7fe5a40d0c00 2024-03-07T07:34:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5aaa00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40730e0 con 0x7fe5a41478c0 2024-03-07T07:34:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5a8c00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe5a4072c80 0x7fe5a40cfd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46274/0 (socket says 172.21.15.84:46274) 2024-03-07T07:34:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5a8c00640 1 -- 172.21.15.84:0/111666532 learned_addr learned my addr 172.21.15.84:0/111666532 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-03-07T07:34:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5a9600640 1 --2- 172.21.15.84:0/111666532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a4071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.914+0000 7fe5aa000640 1 --2- 172.21.15.84:0/111666532 >> v2:172.21.15.161:3300/0 conn(0x7fe5a40d0c00 0x7fe5a40d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a3e00640 1 -- 172.21.15.84:0/111666532 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288758999 0 0) 0x7fe5a4071be0 con 0x7fe5a4072c80 2024-03-07T07:34:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a3e00640 1 -- 172.21.15.84:0/111666532 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe58c003530 con 0x7fe5a4072c80 2024-03-07T07:34:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a9600640 1 -- 172.21.15.84:0/111666532 >> v2:172.21.15.161:3300/0 conn(0x7fe5a40d0c00 msgr2=0x7fe5a40d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a9600640 1 --2- 172.21.15.84:0/111666532 >> v2:172.21.15.161:3300/0 conn(0x7fe5a40d0c00 0x7fe5a40d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a9600640 1 -- 172.21.15.84:0/111666532 >> v1:172.21.15.84:6789/0 conn(0x7fe5a4072c80 legacy=0x7fe5a40cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a9600640 1 -- 172.21.15.84:0/111666532 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a4071ec0 con 0x7fe5a41478c0 2024-03-07T07:34:46.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a9600640 1 --2- 172.21.15.84:0/111666532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a4071600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5980097c0 tx=0x7fe59801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a4e60bd7651af9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a3e00640 1 -- 172.21.15.84:0/111666532 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5980a7070 con 0x7fe5a41478c0 2024-03-07T07:34:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.918+0000 7fe5a3e00640 1 -- 172.21.15.84:0/111666532 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5980b0070 con 0x7fe5a41478c0 2024-03-07T07:34:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5a3e00640 1 -- 172.21.15.84:0/111666532 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5980ab890 con 0x7fe5a41478c0 2024-03-07T07:34:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- 172.21.15.84:0/111666532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 msgr2=0x7fe5a4071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/111666532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a4071600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5980097c0 tx=0x7fe59801c470 comp rx=0 tx=0).stop 2024-03-07T07:34:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- 172.21.15.84:0/111666532 shutdown_connections 2024-03-07T07:34:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/111666532 >> v2:172.21.15.161:3300/0 conn(0x7fe5a40d0c00 0x7fe5a40d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/111666532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a4071600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- 172.21.15.84:0/111666532 >> 172.21.15.84:0/111666532 conn(0x7fe5a406b5c0 msgr2=0x7fe5a406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- 172.21.15.84:0/111666532 shutdown_connections 2024-03-07T07:34:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- 172.21.15.84:0/111666532 wait complete. 2024-03-07T07:34:46.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 Processor -- start 2024-03-07T07:34:46.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- start start 2024-03-07T07:34:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4072c80 0x7fe5a413f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a40d0c00 0x7fe5a415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40cc990 con 0x7fe5a4072c80 2024-03-07T07:34:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4147ca0 con 0x7fe5a40d0c00 2024-03-07T07:34:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aaa00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40ccb10 con 0x7fe5a41478c0 2024-03-07T07:34:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5a9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4072c80 0x7fe5a413f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5a9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4072c80 0x7fe5a413f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40420/0 (socket says 172.21.15.84:40420) 2024-03-07T07:34:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5a9600640 1 -- 172.21.15.84:0/192874288 learned_addr learned my addr 172.21.15.84:0/192874288 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5a8c00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a40d0c00 0x7fe5a415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.922+0000 7fe5aa000640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a9600640 1 -- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 msgr2=0x7fe5a415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a9600640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a9600640 1 -- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a40d0c00 msgr2=0x7fe5a415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a9600640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a40d0c00 0x7fe5a415c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a9600640 1 -- 172.21.15.84:0/192874288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40b64a0 con 0x7fe5a4072c80 2024-03-07T07:34:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a8c00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a40d0c00 0x7fe5a415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a9600640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4072c80 0x7fe5a413f7d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe59801a0a0 tx=0x7fe598019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a1600640 1 -- 172.21.15.84:0/192874288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5980abb60 con 0x7fe5a4072c80 2024-03-07T07:34:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a1600640 1 -- 172.21.15.84:0/192874288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5980abd00 con 0x7fe5a4072c80 2024-03-07T07:34:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a415ea70 con 0x7fe5a4072c80 2024-03-07T07:34:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a1600640 1 -- 172.21.15.84:0/192874288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5980bf650 con 0x7fe5a4072c80 2024-03-07T07:34:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a415f030 con 0x7fe5a4072c80 2024-03-07T07:34:46.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4062d40 con 0x7fe5a4072c80 2024-03-07T07:34:46.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a1600640 1 -- 172.21.15.84:0/192874288 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fe5980c83f0 con 0x7fe5a4072c80 2024-03-07T07:34:46.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a1600640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe584066f60 0x7fe584069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:46.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a1600640 1 -- 172.21.15.84:0/192874288 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe59811f720 con 0x7fe5a4072c80 2024-03-07T07:34:46.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.926+0000 7fe5a8c00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe584066f60 0x7fe584069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:46.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.930+0000 7fe5a8c00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe584066f60 0x7fe584069420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5a41472e0 tx=0x7fe590009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:46.930+0000 7fe5a1600640 1 -- 172.21.15.84:0/192874288 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fe598016090 con 0x7fe5a4072c80 2024-03-07T07:34:47.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 --> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5a40d1830 con 0x7fe584066f60 2024-03-07T07:34:47.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5a1600640 1 -- 172.21.15.84:0/192874288 <== mgr.4101 v2:172.21.15.84:6832/2204566843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13420 (secure 0 0 0) 0x7fe5a40d1830 con 0x7fe584066f60 2024-03-07T07:34:47.087 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:47.087 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-07T07:34:47.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe584066f60 msgr2=0x7fe584069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe584066f60 0x7fe584069420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5a41472e0 tx=0x7fe590009040 comp rx=0 tx=0).stop 2024-03-07T07:34:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4072c80 msgr2=0x7fe5a413f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4072c80 0x7fe5a413f7d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe59801a0a0 tx=0x7fe598019210 comp rx=0 tx=0).stop 2024-03-07T07:34:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 shutdown_connections 2024-03-07T07:34:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fe584066f60 0x7fe584069420 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a41478c0 0x7fe5a415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a40d0c00 0x7fe5a415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 --2- 172.21.15.84:0/192874288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a4072c80 0x7fe5a413f7d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 >> 172.21.15.84:0/192874288 conn(0x7fe5a406b5c0 msgr2=0x7fe5a40b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:47.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 shutdown_connections 2024-03-07T07:34:47.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.086+0000 7fe5aaa00640 1 -- 172.21.15.84:0/192874288 wait complete. 2024-03-07T07:34:47.108 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-03-07T07:34:46.920793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224980,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749740,"statfs":{"total":773094113280,"available":772863733760,"internally_reserved":0,"allocated":4759552,"data_stored":2603504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-4,"num_write_kb":-2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.856469"},"pg_stats":[{"pgid":"1.0","version":"39'119","reported_seq":216,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-07T07:34:44.225124+0000","last_change":"2024-03-07T07:34:44.225151+0000","last_active":"2024-03-07T07:34:44.225124+0000","last_peered":"2024-03-07T07:34:44.225124+0000","last_clean":"2024-03-07T07:34:44.225124+0000","last_became_active":"2024-03-07T07:31:01.053096+0000","last_became_peered":"2024-03-07T07:31:01.053096+0000","last_unstale":"2024-03-07T07:34:44.225124+0000","last_undegraded":"2024-03-07T07:34:44.225124+0000","last_fullsized":"2024-03-07T07:34:44.225124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-03-07T07:34:44.225055+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-03-07T07:34:44.225055+0000","last_clean_scrub_stamp":"2024-03-07T07:34:44.225055+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:23:02.493933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":768214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1040384,"data_stored":768214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":177846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T07:34:47.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-07T07:34:47.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.242+0000 7f38dc000640 1 Processor -- start 2024-03-07T07:34:47.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.242+0000 7f38dc000640 1 -- start start 2024-03-07T07:34:47.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38dc000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38d4145090 0x7f38d40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38dc000640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f38d40cdb20 0x7f38d40724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38dc000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40b4a60 con 0x7f38d415c3d0 2024-03-07T07:34:47.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38dc000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40b4d40 con 0x7f38d4145090 2024-03-07T07:34:47.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38dc000640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40719c0 con 0x7f38d40cdb20 2024-03-07T07:34:47.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38d9600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38d4145090 0x7f38d40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38d9600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38d4145090 0x7f38d40cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40432/0 (socket says 172.21.15.84:40432) 2024-03-07T07:34:47.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38d9600640 1 -- 172.21.15.84:0/1690179947 learned_addr learned my addr 172.21.15.84:0/1690179947 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:47.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38d9600640 1 -- 172.21.15.84:0/1690179947 >> v2:172.21.15.161:3300/0 conn(0x7f38d40cdb20 msgr2=0x7f38d40724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:47.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38d9600640 1 --2- 172.21.15.84:0/1690179947 >> v2:172.21.15.161:3300/0 conn(0x7f38d40cdb20 0x7f38d40724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38d9600640 1 -- 172.21.15.84:0/1690179947 >> v1:172.21.15.161:6789/0 conn(0x7f38d415c3d0 legacy=0x7f38d40cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:47.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.246+0000 7f38d9600640 1 -- 172.21.15.84:0/1690179947 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4071ca0 con 0x7f38d4145090 2024-03-07T07:34:47.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38d9600640 1 --2- 172.21.15.84:0/1690179947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d40cf540 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f38d40b3a10 tx=0x7f38c801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57e9fcc42625c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:47.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38d3e00640 1 -- 172.21.15.84:0/1690179947 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c80ab600 con 0x7f38d4145090 2024-03-07T07:34:47.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38d3e00640 1 -- 172.21.15.84:0/1690179947 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c80b0070 con 0x7f38d4145090 2024-03-07T07:34:47.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38d3e00640 1 -- 172.21.15.84:0/1690179947 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c80ab9c0 con 0x7f38d4145090 2024-03-07T07:34:47.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 -- 172.21.15.84:0/1690179947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 msgr2=0x7f38d40cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 --2- 172.21.15.84:0/1690179947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d40cf540 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f38d40b3a10 tx=0x7f38c801c420 comp rx=0 tx=0).stop 2024-03-07T07:34:47.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 -- 172.21.15.84:0/1690179947 shutdown_connections 2024-03-07T07:34:47.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 --2- 172.21.15.84:0/1690179947 >> v2:172.21.15.161:3300/0 conn(0x7f38d40cdb20 0x7f38d40724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 --2- 172.21.15.84:0/1690179947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d40cf540 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 -- 172.21.15.84:0/1690179947 >> 172.21.15.84:0/1690179947 conn(0x7f38d40b1c50 msgr2=0x7f38d40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:47.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 -- 172.21.15.84:0/1690179947 shutdown_connections 2024-03-07T07:34:47.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 -- 172.21.15.84:0/1690179947 wait complete. 2024-03-07T07:34:47.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 Processor -- start 2024-03-07T07:34:47.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.250+0000 7f38dc000640 1 -- start start 2024-03-07T07:34:47.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d40cdb20 0x7f38d415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d415c3d0 0x7f38d413d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4145830 con 0x7f38d4145090 2024-03-07T07:34:47.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40b4710 con 0x7f38d40cdb20 2024-03-07T07:34:47.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41459b0 con 0x7f38d415c3d0 2024-03-07T07:34:47.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d406d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40440/0 (socket says 172.21.15.84:40440) 2024-03-07T07:34:47.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 -- 172.21.15.84:0/1904575869 learned_addr learned my addr 172.21.15.84:0/1904575869 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:47.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38da000640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d415c3d0 0x7f38d413d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d9600640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d40cdb20 0x7f38d415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 -- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d415c3d0 msgr2=0x7f38d413d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d415c3d0 0x7f38d413d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 -- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d40cdb20 msgr2=0x7f38d415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d40cdb20 0x7f38d415e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 -- 172.21.15.84:0/1904575869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d406e2c0 con 0x7f38d4145090 2024-03-07T07:34:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d9600640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d40cdb20 0x7f38d415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T07:34:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d8c00640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d406d820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c410 tx=0x7f38c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:47.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d1600640 1 -- 172.21.15.84:0/1904575869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0017070 con 0x7f38d4145090 2024-03-07T07:34:47.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d1600640 1 -- 172.21.15.84:0/1904575869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0003600 con 0x7f38d4145090 2024-03-07T07:34:47.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d1600640 1 -- 172.21.15.84:0/1904575869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c00039f0 con 0x7f38d4145090 2024-03-07T07:34:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d406e5a0 con 0x7f38d4145090 2024-03-07T07:34:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d406eb60 con 0x7f38d4145090 2024-03-07T07:34:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d4062d40 con 0x7f38d4145090 2024-03-07T07:34:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.254+0000 7f38d1600640 1 -- 172.21.15.84:0/1904575869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7f38c0003b90 con 0x7f38d4145090 2024-03-07T07:34:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.258+0000 7f38d1600640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f38b4066f60 0x7f38b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.258+0000 7f38d1600640 1 -- 172.21.15.84:0/1904575869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f38c00841b0 con 0x7f38d4145090 2024-03-07T07:34:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.258+0000 7f38d9600640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f38b4066f60 0x7f38b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.258+0000 7f38d9600640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f38b4066f60 0x7f38b4069420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38c80af000 tx=0x7f38c80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.262+0000 7f38d1600640 1 -- 172.21.15.84:0/1904575869 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7f38c00554b0 con 0x7f38d4145090 2024-03-07T07:34:47.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.418+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f38d40ccf70 con 0x7f38d4145090 2024-03-07T07:34:47.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.422+0000 7f38d1600640 1 -- 172.21.15.84:0/1904575869 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f38c0059e20 con 0x7f38d4145090 2024-03-07T07:34:47.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.422+0000 7f38d1600640 1 -- 172.21.15.84:0/1904575869 <== mon.0 v2:172.21.15.84:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f38c0054db0 con 0x7f38d4145090 2024-03-07T07:34:47.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.422+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f38b4066f60 msgr2=0x7f38b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.422+0000 7f38dc000640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f38b4066f60 0x7f38b4069420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38c80af000 tx=0x7f38c80a7000 comp rx=0 tx=0).stop 2024-03-07T07:34:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.422+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 msgr2=0x7f38d406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d406d820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c410 tx=0x7f38c000c8d0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 shutdown_connections 2024-03-07T07:34:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7f38b4066f60 0x7f38b4069420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d415c3d0 0x7f38d413d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38d4145090 0x7f38d406d820 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 --2- 172.21.15.84:0/1904575869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d40cdb20 0x7f38d415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 >> 172.21.15.84:0/1904575869 conn(0x7f38d40b1c50 msgr2=0x7f38d4144270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 shutdown_connections 2024-03-07T07:34:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.426+0000 7f38dc000640 1 -- 172.21.15.84:0/1904575869 wait complete. 2024-03-07T07:34:47.445 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-07T07:34:47.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T07:34:47.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.578+0000 7fdd0b200640 1 Processor -- start 2024-03-07T07:34:47.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.578+0000 7fdd0b200640 1 -- start start 2024-03-07T07:34:47.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd0b200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd0415c1f0 0x7fdd040b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd0b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 0x7fdd040d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd0b200640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd040b0290 con 0x7fdd040b3a00 2024-03-07T07:34:47.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd0b200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd040b1d40 con 0x7fdd0415c1f0 2024-03-07T07:34:47.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd0b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040b0570 con 0x7fdd040cf100 2024-03-07T07:34:47.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd03e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd0415c1f0 0x7fdd040b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd03e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd0415c1f0 0x7fdd040b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40444/0 (socket says 172.21.15.84:40444) 2024-03-07T07:34:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd03e00640 1 -- 172.21.15.84:0/1123020927 learned_addr learned my addr 172.21.15.84:0/1123020927 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd03400640 1 --2- 172.21.15.84:0/1123020927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 0x7fdd040d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd03e00640 1 -- 172.21.15.84:0/1123020927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 msgr2=0x7fdd040d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T07:34:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd03e00640 1 --2- 172.21.15.84:0/1123020927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 0x7fdd040d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd03e00640 1 -- 172.21.15.84:0/1123020927 >> v1:172.21.15.161:6789/0 conn(0x7fdd040b3a00 legacy=0x7fdd0415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.582+0000 7fdd03e00640 1 -- 172.21.15.84:0/1123020927 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd040b0850 con 0x7fdd0415c1f0 2024-03-07T07:34:47.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd03e00640 1 --2- 172.21.15.84:0/1123020927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd040b1330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009870 tx=0x7fdcf401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dccbdae42413b4a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd02a00640 1 -- 172.21.15.84:0/1123020927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40b0070 con 0x7fdd0415c1f0 2024-03-07T07:34:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd02a00640 1 -- 172.21.15.84:0/1123020927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdcf40ab600 con 0x7fdd0415c1f0 2024-03-07T07:34:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd02a00640 1 -- 172.21.15.84:0/1123020927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40ab9f0 con 0x7fdd0415c1f0 2024-03-07T07:34:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- 172.21.15.84:0/1123020927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 msgr2=0x7fdd040b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 --2- 172.21.15.84:0/1123020927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd040b1330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009870 tx=0x7fdcf401c4d0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- 172.21.15.84:0/1123020927 shutdown_connections 2024-03-07T07:34:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 --2- 172.21.15.84:0/1123020927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 0x7fdd040d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 --2- 172.21.15.84:0/1123020927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd040b1330 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- 172.21.15.84:0/1123020927 >> 172.21.15.84:0/1123020927 conn(0x7fdd040b1ed0 msgr2=0x7fdd040b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- 172.21.15.84:0/1123020927 shutdown_connections 2024-03-07T07:34:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- 172.21.15.84:0/1123020927 wait complete. 2024-03-07T07:34:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 Processor -- start 2024-03-07T07:34:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- start start 2024-03-07T07:34:47.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd040b3a00 0x7fdd0414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 0x7fdd0414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd04157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04168e60 con 0x7fdd0415c1f0 2024-03-07T07:34:47.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04168ce0 con 0x7fdd040b3a00 2024-03-07T07:34:47.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd0b200640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04168fe0 con 0x7fdd040cf100 2024-03-07T07:34:47.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.586+0000 7fdd09200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd04157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd03400640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 0x7fdd0414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd03e00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd040b3a00 0x7fdd0414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd09200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd04157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40448/0 (socket says 172.21.15.84:40448) 2024-03-07T07:34:47.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd09200640 1 -- 172.21.15.84:0/2289091614 learned_addr learned my addr 172.21.15.84:0/2289091614 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-03-07T07:34:47.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd09200640 1 -- 172.21.15.84:0/2289091614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 msgr2=0x7fdd0414bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd09200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 0x7fdd0414bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd09200640 1 -- 172.21.15.84:0/2289091614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd040b3a00 msgr2=0x7fdd0414acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd09200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd040b3a00 0x7fdd0414acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd09200640 1 -- 172.21.15.84:0/2289091614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0414c5a0 con 0x7fdd0415c1f0 2024-03-07T07:34:47.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd09200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd04157de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00c7a0 tx=0x7fdcfc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:47.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdcfbe00640 1 -- 172.21.15.84:0/2289091614 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc003b80 con 0x7fdd0415c1f0 2024-03-07T07:34:47.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdcfbe00640 1 -- 172.21.15.84:0/2289091614 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdcfc003d20 con 0x7fdd0415c1f0 2024-03-07T07:34:47.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0414c880 con 0x7fdd0415c1f0 2024-03-07T07:34:47.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdcfbe00640 1 -- 172.21.15.84:0/2289091614 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00aa50 con 0x7fdd0415c1f0 2024-03-07T07:34:47.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0414ce40 con 0x7fdd0415c1f0 2024-03-07T07:34:47.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd04062d40 con 0x7fdd0415c1f0 2024-03-07T07:34:47.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdcfbe00640 1 -- 172.21.15.84:0/2289091614 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 86725+0+0 (secure 0 0 0) 0x7fdcfc00abf0 con 0x7fdd0415c1f0 2024-03-07T07:34:47.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdcfbe00640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdce4066f90 0x7fdce4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T07:34:47.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdcfbe00640 1 -- 172.21.15.84:0/2289091614 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdcfc084b30 con 0x7fdd0415c1f0 2024-03-07T07:34:47.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.590+0000 7fdd03e00640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdce4066f90 0x7fdce4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T07:34:47.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.594+0000 7fdd03e00640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdce4066f90 0x7fdce4069450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40ad000 tx=0x7fdcf40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T07:34:47.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.594+0000 7fdcfbe00640 1 -- 172.21.15.84:0/2289091614 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176632 (secure 0 0 0) 0x7fdcfc055750 con 0x7fdd0415c1f0 2024-03-07T07:34:47.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.782+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd0406bd50 con 0x7fdd0415c1f0 2024-03-07T07:34:47.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdcfbe00640 1 -- 172.21.15.84:0/2289091614 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fdcfc0597f0 con 0x7fdd0415c1f0 2024-03-07T07:34:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-07T07:34:47.786 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/2371752160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2371752160},{"type":"v1","addr":"172.21.15.161:6834","nonce":2371752160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/850187244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":850187244},{"type":"v1","addr":"172.21.15.161:6835","nonce":850187244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3878293455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3878293455},{"type":"v1","addr":"172.21.15.84:6836","nonce":3878293455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5352,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3808718367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3808718367},{"type":"v1","addr":"172.21.15.84:6837","nonce":3808718367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2024-03-07T07:34:47.786 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2024-03-07T07:34:47.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdce4066f90 msgr2=0x7fdce4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdce4066f90 0x7fdce4069450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40ad000 tx=0x7fdcf40a6000 comp rx=0 tx=0).stop 2024-03-07T07:34:47.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 msgr2=0x7fdd04157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T07:34:47.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd04157de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00c7a0 tx=0x7fdcfc00cc60 comp rx=0 tx=0).stop 2024-03-07T07:34:47.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 shutdown_connections 2024-03-07T07:34:47.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:6832/2204566843,v1:172.21.15.84:6833/2204566843] conn(0x7fdce4066f90 0x7fdce4069450 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0415c1f0 0x7fdd04157de0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd040cf100 0x7fdd0414bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 --2- 172.21.15.84:0/2289091614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd040b3a00 0x7fdd0414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T07:34:47.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 >> 172.21.15.84:0/2289091614 conn(0x7fdd040b1ed0 msgr2=0x7fdd0414b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T07:34:47.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 shutdown_connections 2024-03-07T07:34:47.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-07T07:34:47.786+0000 7fdd0b200640 1 -- 172.21.15.84:0/2289091614 wait complete. 2024-03-07T07:34:47.806 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-07T07:34:47.806 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-07T07:34:47.807 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-07T07:34:47.807 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:47.819 INFO:tasks.ceph.mds.a:Stopped 2024-03-07T07:34:47.819 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-07T07:34:47.819 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:47.876 INFO:tasks.ceph.mds.c:Stopped 2024-03-07T07:34:47.876 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-07T07:34:47.876 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:47.890 INFO:tasks.ceph.mds.b:Stopped 2024-03-07T07:34:47.890 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-07T07:34:47.891 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:47.948 INFO:tasks.ceph.mds.d:Stopped 2024-03-07T07:34:47.948 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-07T07:34:47.948 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-07T07:34:47.948 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:48.013 INFO:tasks.ceph.osd.0:Stopped 2024-03-07T07:34:48.013 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-07T07:34:48.013 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:48.076 INFO:tasks.ceph.osd.1:Stopped 2024-03-07T07:34:48.076 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-07T07:34:48.077 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:48.142 INFO:tasks.ceph.osd.2:Stopped 2024-03-07T07:34:48.142 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-07T07:34:48.143 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:48.227 INFO:tasks.ceph.osd.3:Stopped 2024-03-07T07:34:48.227 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-07T07:34:48.227 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:48.288 INFO:tasks.ceph.osd.4:Stopped 2024-03-07T07:34:48.289 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-07T07:34:48.289 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:52.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-07T07:34:54.003 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-03-07T07:34:54.002+0000 7f3274200640 -1 calc_pg_upmaps abort due to max <= 0 2024-03-07T07:34:54.391 INFO:tasks.ceph.osd.5:Stopped 2024-03-07T07:34:54.392 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-07T07:34:54.392 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:54.446 INFO:tasks.ceph.osd.6:Stopped 2024-03-07T07:34:54.446 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-07T07:34:54.446 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:54.545 INFO:tasks.ceph.osd.7:Stopped 2024-03-07T07:34:54.545 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-07T07:34:54.546 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-07T07:34:54.546 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:54.604 INFO:tasks.ceph.mgr.y:Stopped 2024-03-07T07:34:54.605 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-07T07:34:54.605 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:54.659 INFO:tasks.ceph.mgr.x:Stopped 2024-03-07T07:34:54.659 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-07T07:34:54.659 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-07T07:34:54.659 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:54.677 INFO:tasks.ceph.mon.a:Stopped 2024-03-07T07:34:54.678 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-07T07:34:54.678 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:54.694 INFO:tasks.ceph.mon.b:Stopped 2024-03-07T07:34:54.694 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-07T07:34:54.695 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T07:34:54.754 INFO:tasks.ceph.mon.c:Stopped 2024-03-07T07:34:54.755 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-07T07:34:54.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-03-07T07:34:54.787 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:34:54.788 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-07T07:34:55.624 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:34:55.625 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-07T07:34:55.875 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:34:55.875 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-07T07:34:56.041 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:34:56.041 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-07T07:34:56.232 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:34:56.232 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-07T07:34:56.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:34:56.590 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-07T07:34:56.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:34:56.770 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-07T07:34:56.929 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:34:56.929 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-07T07:34:57.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-07T07:34:57.095 INFO:tasks.ceph:Archiving mon data... 2024-03-07T07:34:57.096 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/data/mon.a.tgz 2024-03-07T07:34:57.096 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-03-07T07:34:57.105 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.rOVKIjQEEY 2024-03-07T07:34:57.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rOVKIjQEEY 2024-03-07T07:34:57.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.rOVKIjQEEY 2024-03-07T07:34:57.306 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.rOVKIjQEEY is 304KB 2024-03-07T07:34:57.371 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.rOVKIjQEEY 2024-03-07T07:34:57.380 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/data/mon.b.tgz 2024-03-07T07:34:57.380 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-03-07T07:34:57.390 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.5mY3QWP5L2 2024-03-07T07:34:57.390 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5mY3QWP5L2 2024-03-07T07:34:57.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.5mY3QWP5L2 2024-03-07T07:34:57.605 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.5mY3QWP5L2 is 406KB 2024-03-07T07:34:57.668 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.5mY3QWP5L2 2024-03-07T07:34:57.676 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/data/mon.c.tgz 2024-03-07T07:34:57.676 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-03-07T07:34:57.729 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.8dZK47Y8p5 2024-03-07T07:34:57.729 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8dZK47Y8p5 2024-03-07T07:34:57.865 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.8dZK47Y8p5 2024-03-07T07:34:57.939 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.8dZK47Y8p5 is 406KB 2024-03-07T07:34:58.008 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.8dZK47Y8p5 2024-03-07T07:34:58.016 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-07T07:34:58.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-07T07:34:58.020 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-07T07:34:58.089 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-07T07:34:58.125 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-07T07:34:58.126 INFO:tasks.ceph:Archiving crash dumps... 2024-03-07T07:34:58.128 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/remote/smithi084/crash 2024-03-07T07:34:58.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-07T07:34:58.153 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/remote/smithi161/crash 2024-03-07T07:34:58.154 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-07T07:34:58.187 INFO:tasks.ceph:Shutting down logrotate 2024-03-07T07:34:58.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:34:58.200 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T07:34:58.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-07T07:34:58.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-07T07:34:58.340 INFO:tasks.ceph:Compressing logs... 2024-03-07T07:34:58.340 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-07T07:34:58.348 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-07T07:34:58.364 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73322.log 2024-03-07T07:34:58.365 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33902.log 2024-03-07T07:34:58.366 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33907.log 2024-03-07T07:34:58.366 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73322.log.gz 2024-03-07T07:34:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35680.log 2024-03-07T07:34:58.367 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33902.log.gz 2024-03-07T07:34:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33907.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-07T07:34:58.368 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33907.log.gz 2024-03-07T07:34:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73860.log 2024-03-07T07:34:58.369 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35680.log.gz 2024-03-07T07:34:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35498.log 2024-03-07T07:34:58.370 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37300.log 2024-03-07T07:34:58.370 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73860.log.gz 2024-03-07T07:34:58.371 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34790.log 2024-03-07T07:34:58.372 INFO:teuthology.orchestra.run.smithi084.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35498.log.gz 2024-03-07T07:34:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-03-07T07:34:58.373 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37300.log.gz 2024-03-07T07:34:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34312.log 2024-03-07T07:34:58.373 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34790.log.gz 2024-03-07T07:34:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73114.log 2024-03-07T07:34:58.374 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-03-07T07:34:58.375 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34312.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-07T07:34:58.375 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34312.log.gz 2024-03-07T07:34:58.376 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36376.log 2024-03-07T07:34:58.376 INFO:teuthology.orchestra.run.smithi084.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73114.log.gz 2024-03-07T07:34:58.377 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34712.log 2024-03-07T07:34:58.377 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33895.log 2024-03-07T07:34:58.378 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36376.log.gz 2024-03-07T07:34:58.378 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34712.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34712.log.gz 2024-03-07T07:34:58.379 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35132.log 2024-03-07T07:34:58.379 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37170.log 2024-03-07T07:34:58.380 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33895.log.gz 2024-03-07T07:34:58.380 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35132.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.35132.log.gz 2024-03-07T07:34:58.381 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33750.log 2024-03-07T07:34:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-03-07T07:34:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33750.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37170.log.gz 2024-03-07T07:34:58.383 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33750.log.gz 2024-03-07T07:34:58.383 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36220.log 2024-03-07T07:34:58.385 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34304.log 2024-03-07T07:34:58.385 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34608.log: /var/log/ceph/ceph-client.admin.36220.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz -5 2024-03-07T07:34:58.385 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73964.log 2024-03-07T07:34:58.385 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36220.log.gz 2024-03-07T07:34:58.385 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2024-03-07T07:34:58.389 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34304.log.gz 2024-03-07T07:34:58.389 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73964.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73964.log.gz 2024-03-07T07:34:58.389 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73296.log 2024-03-07T07:34:58.389 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73393.log 2024-03-07T07:34:58.389 INFO:teuthology.orchestra.run.smithi084.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2024-03-07T07:34:58.390 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73296.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73296.log.gz 2024-03-07T07:34:58.390 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36060.log 2024-03-07T07:34:58.390 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36995.log 2024-03-07T07:34:58.391 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73393.log.gz 2024-03-07T07:34:58.391 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36034.log 2024-03-07T07:34:58.391 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36060.log.gz 2024-03-07T07:34:58.391 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35953.log 2024-03-07T07:34:58.392 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36995.log.gz 2024-03-07T07:34:58.402 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36246.log 2024-03-07T07:34:58.403 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36034.log.gz 2024-03-07T07:34:58.403 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35870.log 2024-03-07T07:34:58.403 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35953.log.gz 2024-03-07T07:34:58.403 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73270.log 2024-03-07T07:34:58.404 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36246.log.gz 2024-03-07T07:34:58.404 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35472.log 2024-03-07T07:34:58.404 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35870.log.gz 2024-03-07T07:34:58.408 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35766.log 2024-03-07T07:34:58.408 INFO:teuthology.orchestra.run.smithi084.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73270.log.gz 2024-03-07T07:34:58.408 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72333.log 2024-03-07T07:34:58.409 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35472.log.gz 2024-03-07T07:34:58.409 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73938.log 2024-03-07T07:34:58.409 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35766.log.gz 2024-03-07T07:34:58.410 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.72333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72333.log.gz 2024-03-07T07:34:58.410 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73445.log 2024-03-07T07:34:58.410 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73938.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-07T07:34:58.410 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73938.log.gz 2024-03-07T07:34:58.410 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35818.log 2024-03-07T07:34:58.411 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73445.log.gz 2024-03-07T07:34:58.411 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42347.log 2024-03-07T07:34:58.411 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37086.log 2024-03-07T07:34:58.411 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35818.log.gz 2024-03-07T07:34:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27578.log 2024-03-07T07:34:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27602.log 2024-03-07T07:34:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.27578.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-07T07:34:58.417 INFO:teuthology.orchestra.run.smithi161.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27578.log.gz 2024-03-07T07:34:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.27602.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-07T07:34:58.417 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27602.log.gz 2024-03-07T07:34:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27674.log 2024-03-07T07:34:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-07T07:34:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.27674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32827.log 2024-03-07T07:34:58.417 INFO:teuthology.orchestra.run.smithi161.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27674.log.gz 2024-03-07T07:34:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-07T07:34:58.432 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.32827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32827.log.gz 2024-03-07T07:34:58.432 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-07T07:34:58.433 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27722.log 2024-03-07T07:34:58.433 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27650.log 2024-03-07T07:34:58.433 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.27722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27626.log 2024-03-07T07:34:58.433 INFO:teuthology.orchestra.run.smithi161.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-07T07:34:58.434 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27722.log.gz 2024-03-07T07:34:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.27650.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-07T07:34:58.434 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27650.log.gz 2024-03-07T07:34:58.434 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-07T07:34:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.27626.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27626.log.gz 2024-03-07T07:34:58.435 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32921.log 2024-03-07T07:34:58.435 INFO:teuthology.orchestra.run.smithi161.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-07T07:34:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-07T07:34:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.3.32921.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-07T07:34:58.436 INFO:teuthology.orchestra.run.smithi161.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.32921.log.gz 2024-03-07T07:34:58.436 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-07T07:34:58.437 INFO:teuthology.orchestra.run.smithi161.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-07T07:34:58.437 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27554.log 2024-03-07T07:34:58.437 INFO:teuthology.orchestra.run.smithi161.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-07T07:34:58.438 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-07T07:34:58.438 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.27554.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27554.log.gz 2024-03-07T07:34:58.438 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27698.log 2024-03-07T07:34:58.444 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.27698.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27698.log.gz 2024-03-07T07:34:58.457 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.42347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33901.log 2024-03-07T07:34:58.457 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37086.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42347.log.gz 2024-03-07T07:34:58.458 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37086.log.gz 2024-03-07T07:34:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33184.log 2024-03-07T07:34:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35732.log 2024-03-07T07:34:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33901.log: /var/log/ceph/ceph-client.admin.33184.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33901.log.gz 2024-03-07T07:34:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35524.log 2024-03-07T07:34:58.458 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33184.log.gz 2024-03-07T07:34:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-03-07T07:34:58.458 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35732.log.gz 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34504.log 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35524.log.gz 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34990.log 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34504.log.gz 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.34990.log: /var/log/ceph/ceph-client.admin.35420.log 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34990.log.gz 2024-03-07T07:34:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34634.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-07T07:34:58.460 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gz 2024-03-07T07:34:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33802.log 2024-03-07T07:34:58.460 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35420.log.gz 2024-03-07T07:34:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73652.log 2024-03-07T07:34:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34582.log 2024-03-07T07:34:58.460 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33802.log.gz 2024-03-07T07:34:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34102.log 2024-03-07T07:34:58.460 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73652.log.gz 2024-03-07T07:34:58.461 INFO:teuthology.orchestra.run.smithi084.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-07T07:34:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37274.log 2024-03-07T07:34:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34102.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34582.log.gz 2024-03-07T07:34:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34116.log 2024-03-07T07:34:58.461 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34102.log.gz 2024-03-07T07:34:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2024-03-07T07:34:58.461 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37274.log.gz 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35602.log 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34116.log.gz 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34738.log 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34107.log 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35602.log.gz 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34738.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34738.log.gz 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36086.log 2024-03-07T07:34:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73808.log 2024-03-07T07:34:58.463 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34107.log.gz 2024-03-07T07:34:58.463 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73678.log 2024-03-07T07:34:58.463 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36086.log.gz 2024-03-07T07:34:58.465 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33249.log 2024-03-07T07:34:58.466 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.73808.log.gz 2024-03-07T07:34:58.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34098.log 2024-03-07T07:34:58.466 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73678.log.gz 2024-03-07T07:34:58.468 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73990.log 2024-03-07T07:34:58.468 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33249.log.gz 2024-03-07T07:34:58.468 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72952.log 2024-03-07T07:34:58.469 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34098.log.gz 2024-03-07T07:34:58.469 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2024-03-07T07:34:58.469 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73990.log.gz 2024-03-07T07:34:58.469 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.72952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34115.log 2024-03-07T07:34:58.470 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72952.log.gz 2024-03-07T07:34:58.470 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73704.log 2024-03-07T07:34:58.470 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2024-03-07T07:34:58.470 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73626.log 2024-03-07T07:34:58.471 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34115.log.gz 2024-03-07T07:34:58.471 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36813.log 2024-03-07T07:34:58.471 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.73704.log.gz 2024-03-07T07:34:58.471 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36532.log 2024-03-07T07:34:58.472 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73626.log.gz 2024-03-07T07:34:58.472 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35262.log 2024-03-07T07:34:58.472 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36813.log.gz 2024-03-07T07:34:58.472 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35210.log 2024-03-07T07:34:58.473 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36532.log.gz 2024-03-07T07:34:58.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-03-07T07:34:58.473 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35262.log.gz 2024-03-07T07:34:58.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33672.log 2024-03-07T07:34:58.474 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35210.log.gz 2024-03-07T07:34:58.474 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36454.log 2024-03-07T07:34:58.474 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-03-07T07:34:58.474 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36194.log 2024-03-07T07:34:58.475 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33672.log.gz 2024-03-07T07:34:58.475 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/ceph-client.admin.36454.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33354.log 2024-03-07T07:34:58.475 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36454.log.gz 2024-03-07T07:34:58.475 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35184.log 2024-03-07T07:34:58.476 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36194.log.gz 2024-03-07T07:34:58.476 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73546.log 2024-03-07T07:34:58.476 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33354.log.gz 2024-03-07T07:34:58.477 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37404.log 2024-03-07T07:34:58.477 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35184.log.gz 2024-03-07T07:34:58.478 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73546.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73546.log.gz 2024-03-07T07:34:58.478 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33302.log 2024-03-07T07:34:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35368.log 2024-03-07T07:34:58.479 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37404.log.gz 2024-03-07T07:34:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72926.log 2024-03-07T07:34:58.479 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33302.log.gz 2024-03-07T07:34:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35792.log 2024-03-07T07:34:58.480 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35368.log.gz 2024-03-07T07:34:58.480 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.72926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36584.log 2024-03-07T07:34:58.480 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72926.log.gz 2024-03-07T07:34:58.481 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33776.log 2024-03-07T07:34:58.481 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35792.log.gz 2024-03-07T07:34:58.481 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73756.log 2024-03-07T07:34:58.481 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36584.log.gz 2024-03-07T07:34:58.482 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73192.log 2024-03-07T07:34:58.482 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33776.log.gz 2024-03-07T07:34:58.482 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36891.log 2024-03-07T07:34:58.482 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73756.log.gz 2024-03-07T07:34:58.483 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73192.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-07T07:34:58.483 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73192.log.gz 2024-03-07T07:34:58.483 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36138.log 2024-03-07T07:34:58.483 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36891.log.gz 2024-03-07T07:34:58.484 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33905.log 2024-03-07T07:34:58.484 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-03-07T07:34:58.484 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36138.log.gz 2024-03-07T07:34:58.485 INFO:teuthology.orchestra.run.smithi161.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-07T07:34:58.501 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35550.log 2024-03-07T07:34:58.501 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33905.log.gz 2024-03-07T07:34:58.501 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73166.log 2024-03-07T07:34:58.501 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-03-07T07:34:58.501 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35844.log 2024-03-07T07:34:58.502 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35550.log.gz 2024-03-07T07:34:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37506.log 2024-03-07T07:34:58.502 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73166.log.gz 2024-03-07T07:34:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34100.log 2024-03-07T07:34:58.502 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35844.log.gz 2024-03-07T07:34:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33828.log 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37506.log.gz 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36865.log 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34100.log.gz 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33828.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33828.log.gz 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33406.log 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36865.log.gz 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37023.log 2024-03-07T07:34:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33892.log 2024-03-07T07:34:58.504 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33406.log.gz 2024-03-07T07:34:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37023.log.gz 2024-03-07T07:34:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36969.log 2024-03-07T07:34:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33892.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33892.log.gz 2024-03-07T07:34:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35028.log 2024-03-07T07:34:58.504 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33436.log 2024-03-07T07:34:58.504 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36969.log.gz 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35028.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35028.log.gz 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33436.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33436.log.gz 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34686.log 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37552.log 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33490.log 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34686.log.gz 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.37552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37552.log.gz 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33490.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33490.log.gz 2024-03-07T07:34:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36272.log 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37430.log 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35342.log 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36272.log.gz 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37430.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37430.log.gz 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35342.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35342.log.gz 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37352.log 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74016.log 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35158.log 2024-03-07T07:34:58.506 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37352.log.gz 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.74016.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74016.log.gz 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35158.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35158.log.gz 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34110.log 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73886.log 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33328.log 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34110.log.gz 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73886.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73886.log.gz 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33328.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33328.log.gz 2024-03-07T07:34:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37222.log 2024-03-07T07:34:58.508 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36610.log 2024-03-07T07:34:58.508 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35979.log 2024-03-07T07:34:58.508 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37222.log.gz 2024-03-07T07:34:58.508 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36610.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36610.log.gz 2024-03-07T07:34:58.509 INFO:teuthology.orchestra.run.smithi161.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-07T07:34:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35979.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35979.log.gz 2024-03-07T07:34:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27664.log 2024-03-07T07:34:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73036.log 2024-03-07T07:34:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.27664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36350.log 2024-03-07T07:34:58.512 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27664.log.gz 2024-03-07T07:34:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73036.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73036.log.gz 2024-03-07T07:34:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36350.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36350.log.gz 2024-03-07T07:34:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35576.log 2024-03-07T07:34:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-07T07:34:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36669.log 2024-03-07T07:34:58.512 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35576.log.gz 2024-03-07T07:34:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.log: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-07T07:34:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36669.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36669.log.gz 2024-03-07T07:34:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36112.log 2024-03-07T07:34:58.514 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35394.log 2024-03-07T07:34:58.515 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33275.log 2024-03-07T07:34:58.515 INFO:teuthology.orchestra.run.smithi084.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36112.log.gz 2024-03-07T07:34:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35394.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35394.log.gz 2024-03-07T07:34:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33275.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.33275.log.gz 2024-03-07T07:34:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36480.log 2024-03-07T07:34:58.519 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73419.log 2024-03-07T07:34:58.520 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37456.log 2024-03-07T07:34:58.521 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36480.log.gz 2024-03-07T07:34:58.522 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34301.log 2024-03-07T07:34:58.522 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73419.log.gz 2024-03-07T07:34:58.523 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37456.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37456.log.gz 2024-03-07T07:34:58.524 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73088.log 2024-03-07T07:34:58.524 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34301.log.gz 2024-03-07T07:34:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36402.log 2024-03-07T07:34:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36734.log 2024-03-07T07:34:58.527 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73088.log.gz 2024-03-07T07:34:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36402.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36402.log.gz 2024-03-07T07:34:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36734.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36734.log.gz 2024-03-07T07:34:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34764.log 2024-03-07T07:34:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27548.log 2024-03-07T07:34:58.532 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34530.log 2024-03-07T07:34:58.532 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34764.log.gz 2024-03-07T07:34:58.533 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.27548.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27548.log.gz 2024-03-07T07:34:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34530.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34530.log.gz 2024-03-07T07:34:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73912.log 2024-03-07T07:34:58.535 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33908.log 2024-03-07T07:34:58.537 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72900.log 2024-03-07T07:34:58.537 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73912.log.gz 2024-03-07T07:34:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33908.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33908.log.gz 2024-03-07T07:34:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.72900.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72900.log.gz 2024-03-07T07:34:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34311.log 2024-03-07T07:34:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33854.log 2024-03-07T07:34:58.542 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34311.log: gzip -5 --verbose -- /var/log/ceph/xfstests-dev-results/results/check.log 2024-03-07T07:34:58.542 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34311.log.gz 2024-03-07T07:34:58.543 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33854.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33854.log.gz 2024-03-07T07:34:58.544 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: 18.0% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2024-03-07T07:34:58.544 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-03-07T07:34:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35236.log 2024-03-07T07:34:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73140.log 2024-03-07T07:34:58.547 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-03-07T07:34:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37112.log 2024-03-07T07:34:58.548 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35236.log.gz 2024-03-07T07:34:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73140.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-07T07:34:58.549 INFO:teuthology.orchestra.run.smithi084.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.73140.log.gz 2024-03-07T07:34:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36005.log 2024-03-07T07:34:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37112.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37112.log.gz 2024-03-07T07:34:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36786.log 2024-03-07T07:34:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36005.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22576.log 2024-03-07T07:34:58.552 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36005.log.gz 2024-03-07T07:34:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36786.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-07T07:34:58.553 INFO:teuthology.orchestra.run.smithi161.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-07T07:34:58.554 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36786.log.gz 2024-03-07T07:34:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.tmp-client.admin.22576.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22576.log.gz 2024-03-07T07:34:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33889.log 2024-03-07T07:34:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-07T07:34:58.557 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36760.log 2024-03-07T07:34:58.557 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-07T07:34:58.557 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33889.log.gz 2024-03-07T07:34:58.557 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-07T07:34:58.558 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34876.log 2024-03-07T07:34:58.558 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36760.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36760.log.gz 2024-03-07T07:34:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.34876.log: 93.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-07T07:34:58.560 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34876.log.gz 2024-03-07T07:34:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36839.log 2024-03-07T07:34:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73218.log 2024-03-07T07:34:58.563 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73494.log 2024-03-07T07:34:58.563 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36839.log.gz 2024-03-07T07:34:58.564 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-03-07T07:34:58.564 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73218.log.gz 2024-03-07T07:34:58.565 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73494.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73494.log.gz 2024-03-07T07:34:58.565 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72978.log 2024-03-07T07:34:58.566 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33380.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-03-07T07:34:58.566 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27429.log 2024-03-07T07:34:58.567 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35706.log 2024-03-07T07:34:58.568 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.72978.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72978.log.gz 2024-03-07T07:34:58.568 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.27429.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27429.log.gz 2024-03-07T07:34:58.569 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73572.log 2024-03-07T07:34:58.570 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35706.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35706.log.gz 2024-03-07T07:34:58.571 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35110.log 2024-03-07T07:34:58.571 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36917.log 2024-03-07T07:34:58.572 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73572.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73572.log.gz/var/log/ceph/ceph-client.2.35110.log: 2024-03-07T07:34:58.572 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35110.log.gz 2024-03-07T07:34:58.573 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73782.log 2024-03-07T07:34:58.573 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36917.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36917.log.gz 2024-03-07T07:34:58.574 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34114.log 2024-03-07T07:34:58.574 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35901.log 2024-03-07T07:34:58.575 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73782.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73782.log.gz 2024-03-07T07:34:58.576 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33151.log 2024-03-07T07:34:58.576 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34114.log.gz 2024-03-07T07:34:58.577 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73520.log 2024-03-07T07:34:58.577 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35901.log.gz 2024-03-07T07:34:58.578 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73600.log 2024-03-07T07:34:58.578 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33151.log.gz 2024-03-07T07:34:58.579 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-03-07T07:34:58.579 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73520.log.gz 2024-03-07T07:34:58.581 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73600.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73600.log.gz 2024-03-07T07:34:58.581 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34660.log 2024-03-07T07:34:58.582 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-03-07T07:34:58.582 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34660.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-03-07T07:34:58.583 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34660.log.gz 2024-03-07T07:34:58.584 INFO:teuthology.orchestra.run.smithi161.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-07T07:34:58.584 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35290.log 2024-03-07T07:34:58.584 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33698.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2024-03-07T07:34:58.585 INFO:teuthology.orchestra.run.smithi161.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-07T07:34:58.585 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36637.log 2024-03-07T07:34:58.586 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37196.log 2024-03-07T07:34:58.587 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35290.log.gz 2024-03-07T07:34:58.587 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36637.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36637.log.gz 2024-03-07T07:34:58.588 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36943.log 2024-03-07T07:34:58.588 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37196.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37196.log.gz 2024-03-07T07:34:58.589 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-03-07T07:34:58.590 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35446.log 2024-03-07T07:34:58.591 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36943.log: 88.2%/var/log/ceph/ceph-client.admin.33568.log: -- replaced with /var/log/ceph/ceph-client.admin.36943.log.gz 2024-03-07T07:34:58.591 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-03-07T07:34:58.592 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73730.log 2024-03-07T07:34:58.592 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35446.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35446.log.gz 2024-03-07T07:34:58.593 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72417.log 2024-03-07T07:34:58.594 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33516.log 2024-03-07T07:34:58.594 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73730.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73730.log.gz 2024-03-07T07:34:58.594 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.72417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72417.log.gz 2024-03-07T07:34:58.595 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73834.log 2024-03-07T07:34:58.596 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33516.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33516.log.gz 2024-03-07T07:34:58.596 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72404.log 2024-03-07T07:34:58.597 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33542.log 2024-03-07T07:34:58.598 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73834.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.73834.log.gz 2024-03-07T07:34:58.598 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.72404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72404.log.gz 2024-03-07T07:34:58.598 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33724.log 2024-03-07T07:34:58.599 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33542.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33542.log.gz 2024-03-07T07:34:58.600 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74040.log 2024-03-07T07:34:58.600 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33646.log 2024-03-07T07:34:58.601 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33724.log: /var/log/ceph/ceph-client.admin.74040.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33724.log.gz 2024-03-07T07:34:58.602 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74040.log.gz 2024-03-07T07:34:58.602 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-03-07T07:34:58.603 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33646.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33646.log.gz 2024-03-07T07:34:58.604 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35628.log 2024-03-07T07:34:58.604 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73367.log 2024-03-07T07:34:58.605 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33620.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz/var/log/ceph/ceph-client.admin.35628.log: 2024-03-07T07:34:58.606 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37378.log 2024-03-07T07:34:58.606 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35628.log.gz 2024-03-07T07:34:58.607 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73004.log 2024-03-07T07:34:58.608 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73367.log.gz 2024-03-07T07:34:58.608 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42321.log 2024-03-07T07:34:58.608 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37378.log.gz 2024-03-07T07:34:58.609 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34426.log 2024-03-07T07:34:58.610 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73004.log.gz 2024-03-07T07:34:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.42321.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42321.log.gz 2024-03-07T07:34:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34478.log 2024-03-07T07:34:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34426.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34426.log.gz 2024-03-07T07:34:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74066.log 2024-03-07T07:34:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36506.log 2024-03-07T07:34:58.616 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.34478.log: /var/log/ceph/ceph-client.admin.74066.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34478.log.gz 2024-03-07T07:34:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33083.log 2024-03-07T07:34:58.618 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74066.log.gz 2024-03-07T07:34:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36506.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73244.log 2024-03-07T07:34:58.619 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36506.log.gz 2024-03-07T07:34:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35927.log 2024-03-07T07:34:58.619 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33083.log.gz 2024-03-07T07:34:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36168.log 2024-03-07T07:34:58.619 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73244.log.gz 2024-03-07T07:34:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37248.log 2024-03-07T07:34:58.620 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35927.log.gz 2024-03-07T07:34:58.621 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33464.log 2024-03-07T07:34:58.621 INFO:teuthology.orchestra.run.smithi084.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36168.log.gz 2024-03-07T07:34:58.621 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37248.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37248.log.gz 2024-03-07T07:34:58.622 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35654.log 2024-03-07T07:34:58.622 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33464.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33464.log.gz 2024-03-07T07:34:58.704 INFO:teuthology.orchestra.run.smithi161.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-07T07:34:58.705 INFO:teuthology.orchestra.run.smithi161.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-07T07:34:58.705 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-03-07T07:34:58.705 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m0.271s 2024-03-07T07:34:58.705 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m0.985s 2024-03-07T07:34:58.705 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m0.130s 2024-03-07T07:34:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37326.log 2024-03-07T07:34:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37051.log 2024-03-07T07:34:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35654.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35654.log.gz 2024-03-07T07:34:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37326.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37326.log.gz 2024-03-07T07:34:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73062.log 2024-03-07T07:34:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37051.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37051.log.gz 2024-03-07T07:34:58.708 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36558.log 2024-03-07T07:34:58.708 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35316.log 2024-03-07T07:34:58.708 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.73062.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73062.log.gz 2024-03-07T07:34:58.708 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.36558.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-07T07:34:58.708 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36558.log.gz 2024-03-07T07:34:58.708 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.35316.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35316.log.gz 2024-03-07T07:34:58.708 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-07T07:34:58.708 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-07T07:34:58.709 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-07T07:34:58.826 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-07T07:34:58.828 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-03-07T07:34:58.828 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m0.478s 2024-03-07T07:34:58.829 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m1.534s 2024-03-07T07:34:58.829 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.485s 2024-03-07T07:34:58.830 INFO:tasks.ceph:Archiving logs... 2024-03-07T07:34:58.830 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/remote/smithi084/log 2024-03-07T07:34:58.831 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-07T07:34:59.216 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/remote/smithi161/log 2024-03-07T07:34:59.217 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-07T07:34:59.351 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-07T07:34:59.368 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-07T07:34:59.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-07T07:34:59.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-07T07:34:59.449 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-07T07:34:59.458 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-07T07:34:59.459 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-07T07:34:59.462 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-07T07:34:59.473 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2024-03-07T07:34:59.474 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2024-03-07T07:34:59.474 INFO:teuthology.orchestra.run.smithi084.stdout:*hv01.front.sepi 44.4.53.2 2 u 52 64 177 0.123 -2.187 1.286 2024-03-07T07:34:59.474 INFO:teuthology.orchestra.run.smithi084.stdout:+hv02.front.sepi 96.245.170.99 3 u 52 64 177 0.117 +0.899 1.228 2024-03-07T07:34:59.474 INFO:teuthology.orchestra.run.smithi084.stdout:+hv03.front.sepi 74.6.168.72 3 u 56 64 177 0.118 +0.358 1.218 2024-03-07T07:34:59.475 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:34:59.477 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-03-07T07:34:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-03-07T07:34:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:+hv01.front.sepi 44.4.53.2 2 u 52 64 177 0.085 -2.144 1.915 2024-03-07T07:34:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:*hv02.front.sepi 96.245.170.99 3 u 49 64 177 0.080 -0.046 1.253 2024-03-07T07:34:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 64 177 0.087 -0.537 1.225 2024-03-07T07:34:59.478 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-07T07:34:59.479 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-07T07:34:59.488 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-07T07:34:59.489 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-07T07:34:59.497 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-07T07:34:59.506 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-07T07:34:59.517 INFO:teuthology.task.internal:Duration was 905.911660 seconds 2024-03-07T07:34:59.517 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-07T07:34:59.528 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-07T07:34:59.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-07T07:34:59.531 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-07T07:34:59.636 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-07T07:34:59.637 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-03-07T07:34:59.637 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-07T07:34:59.657 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-03-07T07:34:59.657 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-07T07:34:59.678 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-07T07:34:59.678 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-07T07:34:59.703 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-07T07:34:59.756 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-07T07:34:59.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-07T07:34:59.783 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-07T07:34:59.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-07T07:34:59.877 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-07T07:34:59.877 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-07T07:34:59.897 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-07T07:34:59.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-07T07:34:59.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-07T07:34:59.948 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-07T07:34:59.961 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-03-07T07:34:59.978 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-03-07T07:34:59.996 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-07T07:35:00.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:35:00.027 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-07T07:35:00.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T07:35:00.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-07T07:35:00.054 INFO:teuthology.task.internal:Transferring archived files... 2024-03-07T07:35:00.055 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/remote/smithi084 2024-03-07T07:35:00.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-07T07:35:00.099 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970/remote/smithi161 2024-03-07T07:35:00.099 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-07T07:35:00.126 INFO:teuthology.task.internal:Removing archive directory... 2024-03-07T07:35:00.126 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-07T07:35:00.139 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-07T07:35:00.173 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-07T07:35:00.184 INFO:teuthology.task.internal:Not uploading archives. 2024-03-07T07:35:00.184 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-07T07:35:00.199 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-07T07:35:00.200 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-07T07:35:00.203 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-07T07:35:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: 655464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 7 07:35 /home/ubuntu/cephtest 2024-03-07T07:35:00.226 INFO:teuthology.orchestra.run.smithi161.stdout: 658113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 7 07:35 /home/ubuntu/cephtest 2024-03-07T07:35:00.228 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-07T07:35:00.242 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-07T07:35:00.273 INFO:teuthology.nuke:Checking targets against current locks 2024-03-07T07:35:00.295 DEBUG:teuthology.nuke:shortname: smithi084 2024-03-07T07:35:00.295 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-07T07:35:00.321 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-07 07:10:12.202014', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDjGICKhvRDijBnv5tRIjBVpkGl23gDM76uebAyb2PPUrtYDh7ARwqDW5uAzFNt0GfiDMuH/EiiJ0jYIHfaw0oA='} 2024-03-07T07:35:00.326 DEBUG:teuthology.nuke:shortname: smithi161 2024-03-07T07:35:00.326 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-07T07:35:00.349 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7583970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-07 07:10:12.203342', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCXGBTrTKe7QVMym/vyxAxzz9JqVjdNSTspfFbFMRZB7Z8V9CzuGMe5DpYnLlA1snmJzSbUjKR3HNzxY3JIAIA='} 2024-03-07T07:35:00.378 INFO:teuthology.orchestra.console.smithi084:Power off 2024-03-07T07:35:00.378 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-07T07:35:00.401 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-03-07T07:35:00.402 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T07:35:00.422 INFO:teuthology.orchestra.console.smithi161:Power off 2024-03-07T07:35:00.423 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-07T07:35:00.436 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-03-07T07:35:00.451 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-03-07T07:35:00.451 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T07:35:00.482 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-07T07:35:04.438 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T07:35:04.483 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T07:35:04.550 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-03-07T07:35:04.596 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-07T07:35:08.552 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T07:35:08.598 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T07:35:08.663 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-03-07T07:35:08.709 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-07T07:35:08.765 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-03-07T07:35:08.810 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-03-07T07:35:08.915 INFO:teuthology.run:Summary data: client.0-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 client.1-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/acls} duration: 905.9116604328156 failure_reason: 'Test failure: test_acls (tasks.cephfs.test_acls.TestACLs)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=da4744cf63fc40898bb458f696d7365d status: fail success: false 2024-03-07T07:35:08.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T07:35:09.005 INFO:teuthology.run:FAIL